Jun 06 20:43:55.308395 ip-10-0-132-80 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 06 20:43:55.308407 ip-10-0-132-80 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 06 20:43:55.308413 ip-10-0-132-80 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 06 20:43:55.308573 ip-10-0-132-80 systemd[1]: Failed to start Kubernetes Kubelet. Jun 06 20:44:05.342865 ip-10-0-132-80 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 06 20:44:05.342883 ip-10-0-132-80 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f4681bb489254f34880c63fdfe149226 -- Jun 06 20:46:24.942084 ip-10-0-132-80 systemd[1]: Starting Kubernetes Kubelet... Jun 06 20:46:25.288374 ip-10-0-132-80 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 20:46:25.288374 ip-10-0-132-80 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 06 20:46:25.288374 ip-10-0-132-80 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 20:46:25.288374 ip-10-0-132-80 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 06 20:46:25.288374 ip-10-0-132-80 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 20:46:25.289630 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.289113 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 06 20:46:25.294168 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294146 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:46:25.294168 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294163 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:46:25.294168 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294169 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:46:25.294168 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294172 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:46:25.294168 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294176 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294180 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294185 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294188 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294192 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294196 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294200 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294203 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294206 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294210 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294214 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294218 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294222 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294226 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294230 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294235 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294240 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294243 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294247 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294256 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:46:25.294462 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294260 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294264 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294268 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294272 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294276 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294280 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294284 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294288 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294293 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294296 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294300 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294304 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294309 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294313 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294319 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294324 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294328 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294333 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294337 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:46:25.295034 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294341 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294348 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294354 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294360 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294365 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294371 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294375 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294380 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294384 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294389 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294393 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294398 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294402 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294406 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294411 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294415 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294419 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294423 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294427 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:46:25.295496 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294431 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294436 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294441 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294445 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294449 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294453 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294457 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294462 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294466 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294472 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294476 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294482 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294486 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294490 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294495 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294499 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294503 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294507 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294511 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294516 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:46:25.295992 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294520 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294524 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294528 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294532 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294536 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294541 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294547 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294553 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294557 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294564 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294569 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294574 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294579 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294584 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294588 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294593 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.294621 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295353 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295360 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:46:25.296489 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295364 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295367 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295371 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295374 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295376 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295379 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295383 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295388 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295391 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295393 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295396 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295399 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295402 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295404 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295407 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295410 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295412 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295415 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295417 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:46:25.297000 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295420 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295422 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295425 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295428 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295431 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295433 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295436 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295438 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295441 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295444 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295446 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295451 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295454 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295457 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295459 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295462 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295464 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295467 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295469 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295472 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:46:25.297494 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295475 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295477 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295480 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295483 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295486 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295489 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295491 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295494 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295496 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295499 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295501 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295504 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295508 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295512 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295515 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295519 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295521 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295524 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295527 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295530 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:46:25.298105 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295533 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295535 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295538 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295541 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295544 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295547 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295550 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295552 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295554 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295557 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295560 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295563 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295566 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295569 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295571 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295573 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295576 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295579 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295581 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:46:25.298596 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295584 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295586 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295589 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295591 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295594 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295596 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295599 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295601 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295604 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295606 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295608 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295611 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295614 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295616 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295618 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295622 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295627 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295631 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.295634 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296007 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:46:25.299084 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296013 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296016 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296019 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296022 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296025 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296027 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296030 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296032 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296035 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296038 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296040 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296043 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296045 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296048 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296051 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296054 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296057 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296059 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296062 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:46:25.299573 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296065 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296067 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296070 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296072 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296075 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296077 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296080 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296082 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296085 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296088 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296091 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296095 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296098 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296101 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296103 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296106 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296108 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296111 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296113 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296116 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:46:25.300069 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296118 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296121 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296123 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296126 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296128 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296132 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296136 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296140 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296144 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296147 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296149 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296152 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296155 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296157 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296160 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296162 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296169 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296172 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296175 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:46:25.300570 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296178 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296180 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296185 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296188 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296190 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296196 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296199 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296201 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296204 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296206 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296209 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296211 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296214 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296216 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296219 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296222 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296225 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296227 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296230 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296232 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:46:25.301067 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296235 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296237 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296240 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296244 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296247 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296250 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296253 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296255 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296258 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296262 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296264 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296267 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296269 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296272 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296276 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296278 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296281 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296284 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296287 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296289 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296352 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 06 20:46:25.301550 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296359 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296365 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296369 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296373 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296376 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296380 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296384 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296387 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296389 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296393 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296395 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296398 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296401 2561 flags.go:64] FLAG: --cgroup-root="" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296404 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296407 2561 flags.go:64] FLAG: --client-ca-file="" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296410 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296413 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296417 2561 flags.go:64] FLAG: --cluster-domain="" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296420 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296423 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296427 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296431 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296434 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 06 20:46:25.302114 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296437 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296440 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296444 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296448 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296451 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296454 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296457 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296460 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296464 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296467 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296470 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296473 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296476 2561 flags.go:64] FLAG: --enable-server="true" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296478 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296482 2561 flags.go:64] FLAG: --event-burst="100" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296485 2561 flags.go:64] FLAG: --event-qps="50" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296488 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296491 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296494 2561 flags.go:64] FLAG: --eviction-hard="" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296498 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296501 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296504 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296507 2561 flags.go:64] FLAG: --eviction-soft="" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296510 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296513 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 06 20:46:25.302684 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296516 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296519 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296522 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296525 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296530 2561 flags.go:64] FLAG: --feature-gates="" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296533 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296536 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296539 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296542 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296547 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296550 2561 flags.go:64] FLAG: --help="false" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296553 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296556 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296559 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296562 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296565 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296569 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296571 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296574 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296577 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296580 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296583 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296586 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296589 2561 flags.go:64] FLAG: --kube-reserved="" Jun 06 20:46:25.303366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296591 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296594 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296597 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296599 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296602 2561 flags.go:64] FLAG: --lock-file="" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296605 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296607 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296610 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296615 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296618 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296621 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296623 2561 flags.go:64] FLAG: --logging-format="text" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296627 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296631 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296633 2561 flags.go:64] FLAG: --manifest-url="" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296636 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296640 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296644 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296648 2561 flags.go:64] FLAG: --max-pods="110" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296651 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296654 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296657 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296660 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296662 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296666 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 06 20:46:25.303960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296669 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296675 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296678 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296681 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296684 2561 flags.go:64] FLAG: --pod-cidr="" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296687 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296692 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296695 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296699 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296701 2561 flags.go:64] FLAG: --port="10250" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296704 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296707 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-042f0726758829d51" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296710 2561 flags.go:64] FLAG: --qos-reserved="" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296713 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296716 2561 flags.go:64] FLAG: --register-node="true" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296719 2561 flags.go:64] FLAG: --register-with-taints="" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296722 2561 flags.go:64] FLAG: --registry-burst="10" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296725 2561 flags.go:64] FLAG: --registry-qps="5" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296728 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296731 2561 flags.go:64] FLAG: --reserved-memory="" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296735 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296738 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296742 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296744 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296753 2561 flags.go:64] FLAG: --runonce="false" Jun 06 20:46:25.304570 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296755 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296759 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296762 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296765 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296767 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296770 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296773 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296777 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296780 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296783 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296785 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296789 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296792 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296795 2561 flags.go:64] FLAG: --system-cgroups="" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296798 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296803 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296806 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296809 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296813 2561 flags.go:64] FLAG: --tls-min-version="" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296816 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296818 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296821 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296824 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296827 2561 flags.go:64] FLAG: --v="2" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296844 2561 flags.go:64] FLAG: --version="false" Jun 06 20:46:25.305220 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296848 2561 flags.go:64] FLAG: --vmodule="" Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296851 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.296856 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296979 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296983 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296986 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296990 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296993 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296996 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.296999 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297002 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297006 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297010 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297013 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297016 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297019 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297022 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297024 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297027 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:46:25.305845 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297029 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297032 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297035 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297051 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297055 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297057 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297060 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297062 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297065 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297068 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297071 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297073 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297076 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297079 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297083 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297088 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297090 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297093 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297096 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297100 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:46:25.306328 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297103 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297105 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297108 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297110 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297113 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297116 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297118 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297121 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297124 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297129 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297132 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297134 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297137 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297140 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297143 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297146 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297148 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297151 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297153 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:46:25.306821 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297156 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297158 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297161 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297163 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297166 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297168 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297171 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297173 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297177 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297180 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297183 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297185 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297189 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297192 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297195 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297198 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297200 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297203 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297205 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297208 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:46:25.307360 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297210 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297213 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297215 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297219 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297221 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297224 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297226 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297229 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297231 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297234 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297237 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297239 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297241 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297244 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297246 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297249 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297251 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297254 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297257 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297259 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:46:25.307910 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297263 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297266 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297268 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.297271 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.297278 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.303913 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.303928 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.303947 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.303955 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304009 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304014 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304017 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304022 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304026 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:46:25.308423 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304029 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304034 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304037 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304040 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304043 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304046 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304049 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304052 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304055 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304058 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304060 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304063 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304066 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304069 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304072 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304074 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304078 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304082 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304085 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:46:25.308773 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304088 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304091 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304094 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304097 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304099 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304102 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304105 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304108 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304110 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304114 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304117 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304120 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304123 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304126 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304128 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304131 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304134 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304137 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304139 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304142 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:46:25.309305 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304145 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304147 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304150 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304153 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304156 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304159 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304161 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304164 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304166 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304169 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304172 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304174 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304177 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304179 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304182 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304184 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304187 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304190 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304193 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304196 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:46:25.309812 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304198 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304201 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304204 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304206 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304209 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304212 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304214 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304217 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304220 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304222 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304225 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304227 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304230 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304233 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304235 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304238 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304241 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304244 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304246 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304249 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:46:25.310322 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304251 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304254 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304256 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304259 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304261 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304264 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304267 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304269 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304272 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304275 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304278 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304280 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304283 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304286 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304288 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:46:25.310823 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.304293 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304416 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304420 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304423 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304426 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304429 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304432 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304435 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304438 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304440 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304443 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304446 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304448 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304451 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304454 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304456 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304459 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304461 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304464 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304466 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:46:25.311257 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304469 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304471 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304474 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304477 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304479 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304482 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304484 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304487 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304490 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304493 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304496 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304498 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304501 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304504 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304506 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304509 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304511 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304514 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304517 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304520 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:46:25.312053 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304522 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304525 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304528 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304530 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304533 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304536 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304539 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304541 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304545 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304549 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304551 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304554 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304556 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304559 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304562 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304564 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304567 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304569 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304572 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:46:25.312678 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304575 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304578 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304581 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304585 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304589 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304592 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304595 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304597 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304600 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304603 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304605 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304608 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304610 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304624 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304627 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304630 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304632 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304635 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304637 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:46:25.313266 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304640 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304643 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304646 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304648 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304652 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304656 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304659 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304663 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304667 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304671 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304674 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304677 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304680 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304683 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304686 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304688 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304691 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304695 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304698 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304702 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:46:25.313828 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304705 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:46:25.314369 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:25.304709 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:46:25.314369 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.304714 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 20:46:25.314369 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.304808 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 06 20:46:25.314369 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.306948 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 06 20:46:25.314369 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.308307 2561 server.go:1019] "Starting client certificate rotation" Jun 06 20:46:25.314369 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.308410 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 20:46:25.314369 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.308442 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 20:46:25.314369 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.311967 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 20:46:25.315289 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.315273 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 20:46:25.323087 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.323070 2561 log.go:25] "Validated CRI v1 runtime API" Jun 06 20:46:25.327040 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.327027 2561 log.go:25] "Validated CRI v1 image API" Jun 06 20:46:25.329028 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.329013 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 06 20:46:25.331348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.331326 2561 fs.go:135] Filesystem UUIDs: map[222c68e5-884a-4a6e-a35e-77d4058cb842:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d2af7619-55e5-4ae9-8961-337d06f28c35:/dev/nvme0n1p4] Jun 06 20:46:25.331421 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.331343 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 06 20:46:25.335476 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.335371 2561 manager.go:216] Machine: {Timestamp:2026-06-06 20:46:25.334906002 +0000 UTC m=+0.290446976 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100220 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20deb2d971e53979943e80ddd16425 SystemUUID:ec20deb2-d971-e539-7994-3e80ddd16425 BootID:f4681bb4-8925-4f34-880c-63fdfe149226 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e1:3f:03:74:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e1:3f:03:74:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:ff:1a:ce:9e:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 06 20:46:25.335476 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.335472 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 06 20:46:25.335569 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.335553 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 06 20:46:25.338377 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.338355 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 06 20:46:25.338531 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.338380 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-80.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 06 20:46:25.339112 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.339101 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 06 20:46:25.339144 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.339116 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 06 20:46:25.339144 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.339123 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 20:46:25.339742 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.339732 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 20:46:25.340782 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.340772 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 06 20:46:25.341126 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.341112 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 20:46:25.343821 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.343809 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 06 20:46:25.343955 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.343945 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 06 20:46:25.343990 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.343976 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 06 20:46:25.343990 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.343989 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 06 20:46:25.344082 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.344011 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 06 20:46:25.344082 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.344024 2561 kubelet.go:398] "Adding apiserver pod source" Jun 06 20:46:25.344082 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.344035 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 06 20:46:25.344380 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.344367 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 20:46:25.344428 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.344388 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 20:46:25.346253 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.346233 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 06 20:46:25.348282 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348268 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 06 20:46:25.348335 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348298 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 06 20:46:25.348882 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348868 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 06 20:46:25.348926 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348887 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 06 20:46:25.348926 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348894 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 06 20:46:25.348926 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348900 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 06 20:46:25.348926 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348908 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 06 20:46:25.348926 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348913 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 06 20:46:25.349071 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348939 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 06 20:46:25.349071 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348945 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 06 20:46:25.349071 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348951 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 06 20:46:25.349071 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348968 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 06 20:46:25.349071 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348985 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 06 20:46:25.349071 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.348993 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 06 20:46:25.349595 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.349586 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 06 20:46:25.349595 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.349594 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 06 20:46:25.352520 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.352505 2561 server.go:1268] "Started kubelet" Jun 06 20:46:25.352632 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.352583 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 06 20:46:25.352632 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.352590 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 06 20:46:25.352965 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.352943 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 06 20:46:25.354202 ip-10-0-132-80 systemd[1]: Started Kubernetes Kubelet. Jun 06 20:46:25.355306 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.355291 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 06 20:46:25.355879 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.355802 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 06 20:46:25.355998 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.355983 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 06 20:46:25.356060 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.356002 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-80.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 06 20:46:25.356113 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.356047 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 06 20:46:25.360387 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.360369 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 06 20:46:25.361570 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.360773 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-80.ec2.internal.18b698decc7c76ab default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-80.ec2.internal,UID:ip-10-0-132-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-80.ec2.internal,},FirstTimestamp:2026-06-06 20:46:25.352480427 +0000 UTC m=+0.308021399,LastTimestamp:2026-06-06 20:46:25.352480427 +0000 UTC m=+0.308021399,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-80.ec2.internal,}" Jun 06 20:46:25.364764 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.364746 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 06 20:46:25.364764 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.364756 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 06 20:46:25.364942 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.364808 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:25.365183 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365144 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2t2s7" Jun 06 20:46:25.365423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365403 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 06 20:46:25.365423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365408 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 06 20:46:25.365576 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365433 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 06 20:46:25.365576 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365556 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 06 20:46:25.365576 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365566 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 06 20:46:25.365726 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365650 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 06 20:46:25.365726 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365665 2561 factory.go:55] Registering systemd factory Jun 06 20:46:25.365726 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365674 2561 factory.go:223] Registration of the systemd container factory successfully Jun 06 20:46:25.365892 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365880 2561 factory.go:153] Registering CRI-O factory Jun 06 20:46:25.365944 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365896 2561 factory.go:223] Registration of the crio container factory successfully Jun 06 20:46:25.365944 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365917 2561 factory.go:103] Registering Raw factory Jun 06 20:46:25.365944 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.365932 2561 manager.go:1196] Started watching for new ooms in manager Jun 06 20:46:25.366324 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.366305 2561 manager.go:349] Starting recovery of all containers Jun 06 20:46:25.372873 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.372726 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2t2s7" Jun 06 20:46:25.374307 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.374281 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 06 20:46:25.374395 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.374328 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 06 20:46:25.376119 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.376103 2561 manager.go:354] Recovery completed Jun 06 20:46:25.380571 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.380560 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:25.382238 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.382221 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:25.382322 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.382254 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:25.382322 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.382265 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:25.382767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.382755 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 06 20:46:25.382767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.382762 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:25.382767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.382768 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 06 20:46:25.382884 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.382786 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 06 20:46:25.383426 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.383412 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:25.383477 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.383436 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:25.383477 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.383445 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:25.383754 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.383743 2561 policy_none.go:49] "None policy: Start" Jun 06 20:46:25.383784 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.383759 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 06 20:46:25.383784 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.383769 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 06 20:46:25.384715 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.384703 2561 policy_none.go:47] "Start" Jun 06 20:46:25.421394 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.421378 2561 manager.go:337] "Starting Device Plugin manager" Jun 06 20:46:25.428956 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.421411 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 06 20:46:25.428956 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.421423 2561 server.go:87] "Starting device plugin registration server" Jun 06 20:46:25.428956 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.421605 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 06 20:46:25.428956 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.421617 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 06 20:46:25.428956 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.421697 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 06 20:46:25.428956 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.421784 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 06 20:46:25.428956 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.421793 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 06 20:46:25.428956 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.422453 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 06 20:46:25.428956 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.422494 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:25.430156 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.430129 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 06 20:46:25.431273 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.431258 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 06 20:46:25.431346 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.431295 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 06 20:46:25.431346 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.431313 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 06 20:46:25.431450 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.431345 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 06 20:46:25.433366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.433349 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:46:25.522162 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.522140 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:25.522993 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.522980 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:25.523055 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.523005 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:25.523055 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.523016 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:25.523055 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.523035 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.528396 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.528382 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.528448 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.528402 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-80.ec2.internal\": node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:25.531400 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.531383 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-80.ec2.internal"] Jun 06 20:46:25.531453 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.531445 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:25.532777 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.532759 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:25.532885 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.532788 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:25.532885 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.532797 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:25.533962 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.533949 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:25.534086 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.534072 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.534148 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.534136 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:25.534562 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.534547 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:25.534640 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.534568 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:25.534640 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.534577 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:25.534739 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.534639 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:25.534739 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.534662 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:25.534739 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.534680 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:25.535794 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.535778 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.535885 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.535809 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:46:25.536437 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.536420 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:46:25.536501 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.536451 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:46:25.536501 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.536464 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:46:25.542378 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.542360 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:25.564370 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.564352 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-80.ec2.internal\" not found" node="ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.568676 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.568662 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-80.ec2.internal\" not found" node="ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.643015 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.642988 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:25.666511 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.666492 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d27d8ba139fdcee96eb4901dcd08628-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal\" (UID: \"9d27d8ba139fdcee96eb4901dcd08628\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.666559 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.666516 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d27d8ba139fdcee96eb4901dcd08628-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal\" (UID: \"9d27d8ba139fdcee96eb4901dcd08628\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.666559 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.666544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05e793a3013e7e8f3e625c9bad9e9e51-config\") pod \"kube-apiserver-proxy-ip-10-0-132-80.ec2.internal\" (UID: \"05e793a3013e7e8f3e625c9bad9e9e51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.743251 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.743227 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:25.767542 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.767519 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d27d8ba139fdcee96eb4901dcd08628-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal\" (UID: \"9d27d8ba139fdcee96eb4901dcd08628\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.767616 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.767565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d27d8ba139fdcee96eb4901dcd08628-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal\" (UID: \"9d27d8ba139fdcee96eb4901dcd08628\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.767616 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.767574 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d27d8ba139fdcee96eb4901dcd08628-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal\" (UID: \"9d27d8ba139fdcee96eb4901dcd08628\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.767616 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.767594 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05e793a3013e7e8f3e625c9bad9e9e51-config\") pod \"kube-apiserver-proxy-ip-10-0-132-80.ec2.internal\" (UID: \"05e793a3013e7e8f3e625c9bad9e9e51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.767740 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.767618 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d27d8ba139fdcee96eb4901dcd08628-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal\" (UID: \"9d27d8ba139fdcee96eb4901dcd08628\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.767740 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.767658 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05e793a3013e7e8f3e625c9bad9e9e51-config\") pod \"kube-apiserver-proxy-ip-10-0-132-80.ec2.internal\" (UID: \"05e793a3013e7e8f3e625c9bad9e9e51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.843827 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.843775 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:25.869334 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.869314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.873598 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:25.873584 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-80.ec2.internal" Jun 06 20:46:25.944767 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:25.944739 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:26.045204 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:26.045183 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:26.145760 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:26.145709 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:26.246243 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:26.246224 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:26.307789 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.307764 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 06 20:46:26.308360 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.307924 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 20:46:26.347221 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:26.347200 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:26.355320 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:26.355294 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d27d8ba139fdcee96eb4901dcd08628.slice/crio-8cfc6e300e91b58fcca3e23cc8f34fd1cbb0e4ec0f1d8987a6efeb9d5eadd333 WatchSource:0}: Error finding container 8cfc6e300e91b58fcca3e23cc8f34fd1cbb0e4ec0f1d8987a6efeb9d5eadd333: Status 404 returned error can't find the container with id 8cfc6e300e91b58fcca3e23cc8f34fd1cbb0e4ec0f1d8987a6efeb9d5eadd333 Jun 06 20:46:26.355642 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:26.355626 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e793a3013e7e8f3e625c9bad9e9e51.slice/crio-8dad8547f50d2636125e26909a64c2ec296d73406bef5e5c3346711b8411e732 WatchSource:0}: Error finding container 8dad8547f50d2636125e26909a64c2ec296d73406bef5e5c3346711b8411e732: Status 404 returned error can't find the container with id 8dad8547f50d2636125e26909a64c2ec296d73406bef5e5c3346711b8411e732 Jun 06 20:46:26.361974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.361958 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 20:46:26.374463 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.374436 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 20:41:25 +0000 UTC" deadline="2027-12-26 16:55:23.667591484 +0000 UTC" Jun 06 20:46:26.374463 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.374457 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13628h8m57.29313648s" Jun 06 20:46:26.433924 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.433860 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-80.ec2.internal" event={"ID":"05e793a3013e7e8f3e625c9bad9e9e51","Type":"ContainerStarted","Data":"8dad8547f50d2636125e26909a64c2ec296d73406bef5e5c3346711b8411e732"} Jun 06 20:46:26.434949 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.434929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" event={"ID":"9d27d8ba139fdcee96eb4901dcd08628","Type":"ContainerStarted","Data":"8cfc6e300e91b58fcca3e23cc8f34fd1cbb0e4ec0f1d8987a6efeb9d5eadd333"} Jun 06 20:46:26.448092 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:26.448077 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:26.548601 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:26.548581 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:26.649081 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:26.649054 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-80.ec2.internal\" not found" Jun 06 20:46:26.697345 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.697291 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:46:26.725863 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.725829 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:46:26.727757 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.727735 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:46:26.765259 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.765238 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" Jun 06 20:46:26.779701 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.779680 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 20:46:26.782517 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.782332 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-80.ec2.internal" Jun 06 20:46:26.788662 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:26.788642 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 20:46:27.345965 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.345936 2561 apiserver.go:52] "Watching apiserver" Jun 06 20:46:27.354085 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.354057 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 06 20:46:27.354466 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.354445 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wkssg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624","openshift-cluster-node-tuning-operator/tuned-7znx8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal","openshift-multus/multus-additional-cni-plugins-mtkz9","openshift-network-diagnostics/network-check-target-ggpw7","kube-system/konnectivity-agent-v22ns","kube-system/kube-apiserver-proxy-ip-10-0-132-80.ec2.internal","openshift-dns/node-resolver-qf8k2","openshift-image-registry/node-ca-225jx","openshift-multus/multus-m8jvk","openshift-multus/network-metrics-daemon-xtdmx","openshift-network-operator/iptables-alerter-fklhr","openshift-ovn-kubernetes/ovnkube-node-5ftq4"] Jun 06 20:46:27.357116 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.357093 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-225jx" Jun 06 20:46:27.359226 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.359206 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fklhr" Jun 06 20:46:27.359730 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.359706 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 06 20:46:27.359730 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.359708 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 06 20:46:27.359927 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.359719 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 06 20:46:27.359927 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.359813 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-prpcd\"" Jun 06 20:46:27.361651 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.361441 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 06 20:46:27.361651 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.361464 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.361651 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.361518 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:46:27.361651 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.361525 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 06 20:46:27.361923 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.361897 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wsnjm\"" Jun 06 20:46:27.363594 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.363572 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:46:27.363691 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.363613 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.363802 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.363784 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-whdd6\"" Jun 06 20:46:27.364120 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.364091 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 06 20:46:27.365781 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.365745 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 06 20:46:27.366117 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.365880 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 06 20:46:27.366200 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.366136 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 06 20:46:27.366200 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.366180 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.367278 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.367257 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 06 20:46:27.367278 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.367277 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 06 20:46:27.367427 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.367301 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2th5g\"" Jun 06 20:46:27.367574 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.367559 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 06 20:46:27.367655 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.367640 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 06 20:46:27.368234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.368157 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:27.368345 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:27.368230 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:27.368724 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.368572 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 06 20:46:27.368724 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.368614 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 06 20:46:27.368724 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.368630 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 06 20:46:27.370113 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.369568 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 06 20:46:27.370113 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.369586 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 06 20:46:27.370113 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.369668 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hdpqc\"" Jun 06 20:46:27.371441 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.371214 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qf8k2" Jun 06 20:46:27.373476 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.373457 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 06 20:46:27.373887 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.373865 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v22ns" Jun 06 20:46:27.374490 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.374329 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 06 20:46:27.374490 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.374355 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rhcpf\"" Jun 06 20:46:27.376322 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.376303 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 06 20:46:27.376545 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.376519 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.376907 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.376888 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 06 20:46:27.376983 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.376901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4156b345-8f3e-4eed-a385-c1469420457d-host\") pod \"node-ca-225jx\" (UID: \"4156b345-8f3e-4eed-a385-c1469420457d\") " pod="openshift-image-registry/node-ca-225jx" Jun 06 20:46:27.376983 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.376933 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-sysctl-conf\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.376983 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.376954 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-run\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.376983 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.376975 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-cni-netd\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.377212 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.376996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.377212 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzq24\" (UniqueName: \"kubernetes.io/projected/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-kube-api-access-lzq24\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.377212 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn58l\" (UniqueName: \"kubernetes.io/projected/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-kube-api-access-xn58l\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.377212 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-modprobe-d\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.377212 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377100 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-kubernetes\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.377212 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-var-lib-kubelet\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.377212 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-ovnkube-script-lib\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.377212 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4156b345-8f3e-4eed-a385-c1469420457d-serviceca\") pod \"node-ca-225jx\" (UID: \"4156b345-8f3e-4eed-a385-c1469420457d\") " pod="openshift-image-registry/node-ca-225jx" Jun 06 20:46:27.377212 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhjtp\" (UniqueName: \"kubernetes.io/projected/4156b345-8f3e-4eed-a385-c1469420457d-kube-api-access-vhjtp\") pod \"node-ca-225jx\" (UID: \"4156b345-8f3e-4eed-a385-c1469420457d\") " pod="openshift-image-registry/node-ca-225jx" Jun 06 20:46:27.377212 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377202 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gm8c\" (UniqueName: \"kubernetes.io/projected/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-kube-api-access-5gm8c\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.377751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-run-systemd\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.377751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377246 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-etc-openvswitch\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.377751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.377751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377299 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-sys\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.377751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-host\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.377751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377367 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-env-overrides\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.377751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377413 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.377751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377432 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-89j2r\"" Jun 06 20:46:27.377751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377443 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce-host-slash\") pod \"iptables-alerter-fklhr\" (UID: \"8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce\") " pod="openshift-network-operator/iptables-alerter-fklhr" Jun 06 20:46:27.377751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-sysconfig\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.377751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-systemd\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.377751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-lib-modules\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-tuned\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-run-ovn\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.377955 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-log-socket\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-tmp\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-kubelet\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378088 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-systemd-units\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-run-ovn-kubernetes\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-cni-bin\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-ovn-node-metrics-cert\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378171 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f9vv\" (UniqueName: \"kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv\") pod \"network-check-target-ggpw7\" (UID: \"0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582\") " pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce-iptables-alerter-script\") pod \"iptables-alerter-fklhr\" (UID: \"8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce\") " pod="openshift-network-operator/iptables-alerter-fklhr" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-slash\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-run-netns\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378237 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-var-lib-openvswitch\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378919 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-ovnkube-config\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378919 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-cnibin\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.378919 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378358 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-os-release\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.378919 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.378919 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378471 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2d2w\" (UniqueName: \"kubernetes.io/projected/8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce-kube-api-access-d2d2w\") pod \"iptables-alerter-fklhr\" (UID: \"8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce\") " pod="openshift-network-operator/iptables-alerter-fklhr" Jun 06 20:46:27.378919 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-sysctl-d\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.378919 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378520 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-run-openvswitch\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378919 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378546 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 06 20:46:27.378919 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-node-log\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.378919 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-system-cni-dir\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.378919 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-cni-binary-copy\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.378919 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.378926 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:27.379454 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:27.379012 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:27.379454 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.379417 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c8cfm\"" Jun 06 20:46:27.379650 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.379509 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 06 20:46:27.379712 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.379659 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 06 20:46:27.379712 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.379687 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 20:46:27.381431 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.381413 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.383672 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.383655 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 06 20:46:27.383969 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.383953 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rcbvw\"" Jun 06 20:46:27.384059 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.383962 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:27.384129 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:27.384112 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:27.400945 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.400925 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r77bt" Jun 06 20:46:27.412090 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.412062 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r77bt" Jun 06 20:46:27.466420 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.466396 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 06 20:46:27.479246 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-socket-dir\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.479359 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479252 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-run-netns\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.479359 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-modprobe-d\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.479359 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-var-lib-kubelet\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.479359 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-multus-socket-dir-parent\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.479532 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b68a212d-020d-4c2f-9597-800e58ac80ef-hosts-file\") pod \"node-resolver-qf8k2\" (UID: \"b68a212d-020d-4c2f-9597-800e58ac80ef\") " pod="openshift-dns/node-resolver-qf8k2" Jun 06 20:46:27.479532 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-env-overrides\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.479532 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479424 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-var-lib-cni-multus\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.479532 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479434 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-var-lib-kubelet\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.479532 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479424 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-modprobe-d\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.479532 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-run-ovn-kubernetes\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.479532 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-systemd\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.479532 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479499 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-run-ovn-kubernetes\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.479532 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479517 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-device-dir\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479561 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-systemd\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479563 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p8cv\" (UniqueName: \"kubernetes.io/projected/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-kube-api-access-5p8cv\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479604 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2beb3bb9-4934-4da1-9472-289193555adb-dbus\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-tmp\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-kubelet\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479678 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-systemd-units\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479705 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-ovn-node-metrics-cert\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479709 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-kubelet\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-systemd-units\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9vv\" (UniqueName: \"kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv\") pod \"network-check-target-ggpw7\" (UID: \"0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582\") " pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479755 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcb68591-97bc-4e9b-960a-f6ed0aecd0da-agent-certs\") pod \"konnectivity-agent-v22ns\" (UID: \"dcb68591-97bc-4e9b-960a-f6ed0aecd0da\") " pod="kube-system/konnectivity-agent-v22ns" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479870 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-run-multus-certs\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce-iptables-alerter-script\") pod \"iptables-alerter-fklhr\" (UID: \"8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce\") " pod="openshift-network-operator/iptables-alerter-fklhr" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-slash\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479954 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479956 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-env-overrides\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.480009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479969 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-ovnkube-config\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.479997 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-cnibin\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480002 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-slash\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480040 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4156b345-8f3e-4eed-a385-c1469420457d-serviceca\") pod \"node-ca-225jx\" (UID: \"4156b345-8f3e-4eed-a385-c1469420457d\") " pod="openshift-image-registry/node-ca-225jx" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480057 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-cnibin\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-multus-cni-dir\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480095 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-cnibin\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-run-openvswitch\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480167 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-system-cni-dir\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480191 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvcx9\" (UniqueName: \"kubernetes.io/projected/a38f8798-b100-40c5-be25-f6828d3db580-kube-api-access-fvcx9\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480215 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab0e8860-58f5-4601-afad-1ff7f00de91e-multus-daemon-config\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480248 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480263 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-etc-kubernetes\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480287 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-run\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-cni-netd\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.480751 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-kubernetes\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480403 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-ovnkube-script-lib\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480426 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhjtp\" (UniqueName: \"kubernetes.io/projected/4156b345-8f3e-4eed-a385-c1469420457d-kube-api-access-vhjtp\") pod \"node-ca-225jx\" (UID: \"4156b345-8f3e-4eed-a385-c1469420457d\") " pod="openshift-image-registry/node-ca-225jx" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480449 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-registration-dir\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-hostroot\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gm8c\" (UniqueName: \"kubernetes.io/projected/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-kube-api-access-5gm8c\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480532 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce-iptables-alerter-script\") pod \"iptables-alerter-fklhr\" (UID: \"8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce\") " pod="openshift-network-operator/iptables-alerter-fklhr" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-run-systemd\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-cni-netd\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480589 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-run-systemd\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480625 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-etc-openvswitch\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480635 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4156b345-8f3e-4eed-a385-c1469420457d-serviceca\") pod \"node-ca-225jx\" (UID: \"4156b345-8f3e-4eed-a385-c1469420457d\") " pod="openshift-image-registry/node-ca-225jx" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480666 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-system-cni-dir\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480587 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-etc-openvswitch\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480650 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.481537 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480539 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-ovnkube-config\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480732 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-run\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2beb3bb9-4934-4da1-9472-289193555adb-kubelet-config\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480865 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-run-openvswitch\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-run-k8s-cni-cncf-io\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.480963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-var-lib-kubelet\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-sys\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-host\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481050 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-sys\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-system-cni-dir\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481088 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-kubernetes\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481104 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-host\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481132 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-os-release\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-multus-conf-dir\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481197 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-cni-bin\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.482348 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481229 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce-host-slash\") pod \"iptables-alerter-fklhr\" (UID: \"8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce\") " pod="openshift-network-operator/iptables-alerter-fklhr" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-sysconfig\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-lib-modules\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-tuned\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481309 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce-host-slash\") pod \"iptables-alerter-fklhr\" (UID: \"8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce\") " pod="openshift-network-operator/iptables-alerter-fklhr" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481326 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-run-ovn\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-log-socket\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481352 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-cni-bin\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b68a212d-020d-4c2f-9597-800e58ac80ef-tmp-dir\") pod \"node-resolver-qf8k2\" (UID: \"b68a212d-020d-4c2f-9597-800e58ac80ef\") " pod="openshift-dns/node-resolver-qf8k2" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481395 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96hdm\" (UniqueName: \"kubernetes.io/projected/b68a212d-020d-4c2f-9597-800e58ac80ef-kube-api-access-96hdm\") pod \"node-resolver-qf8k2\" (UID: \"b68a212d-020d-4c2f-9597-800e58ac80ef\") " pod="openshift-dns/node-resolver-qf8k2" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481430 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-log-socket\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481440 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-var-lib-cni-bin\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481465 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-run-netns\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481483 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-run-ovn\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481488 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-var-lib-openvswitch\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481517 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-os-release\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481525 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.483175 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481536 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-ovnkube-script-lib\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481544 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481597 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-var-lib-openvswitch\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481611 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-sysconfig\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481613 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-host-run-netns\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481634 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcb68591-97bc-4e9b-960a-f6ed0aecd0da-konnectivity-ca\") pod \"konnectivity-agent-v22ns\" (UID: \"dcb68591-97bc-4e9b-960a-f6ed0aecd0da\") " pod="kube-system/konnectivity-agent-v22ns" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481661 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-sys-fs\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481688 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvx7m\" (UniqueName: \"kubernetes.io/projected/ab0e8860-58f5-4601-afad-1ff7f00de91e-kube-api-access-pvx7m\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481717 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2d2w\" (UniqueName: \"kubernetes.io/projected/8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce-kube-api-access-d2d2w\") pod \"iptables-alerter-fklhr\" (UID: \"8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce\") " pod="openshift-network-operator/iptables-alerter-fklhr" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481697 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-os-release\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481741 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-sysctl-d\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481749 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-lib-modules\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481786 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-node-log\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-cni-binary-copy\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481852 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-sysctl-d\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481859 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4156b345-8f3e-4eed-a385-c1469420457d-host\") pod \"node-ca-225jx\" (UID: \"4156b345-8f3e-4eed-a385-c1469420457d\") " pod="openshift-image-registry/node-ca-225jx" Jun 06 20:46:27.483974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481887 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-etc-selinux\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.484458 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab0e8860-58f5-4601-afad-1ff7f00de91e-cni-binary-copy\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.484458 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481941 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-sysctl-conf\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.484458 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzq24\" (UniqueName: \"kubernetes.io/projected/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-kube-api-access-lzq24\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.484458 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.481991 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn58l\" (UniqueName: \"kubernetes.io/projected/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-kube-api-access-xn58l\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.484458 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.482217 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4156b345-8f3e-4eed-a385-c1469420457d-host\") pod \"node-ca-225jx\" (UID: \"4156b345-8f3e-4eed-a385-c1469420457d\") " pod="openshift-image-registry/node-ca-225jx" Jun 06 20:46:27.484458 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.482284 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-cni-binary-copy\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.484458 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.482341 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-sysctl-conf\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.484458 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.482344 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-node-log\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.484458 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.483631 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-tmp\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.484458 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.483858 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-ovn-node-metrics-cert\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.484458 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.484109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-etc-tuned\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.486141 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:27.486121 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:27.486260 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:27.486143 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:27.486260 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:27.486161 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2f9vv for pod openshift-network-diagnostics/network-check-target-ggpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:27.486260 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:27.486219 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv podName:0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:27.986204161 +0000 UTC m=+2.941745136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2f9vv" (UniqueName: "kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv") pod "network-check-target-ggpw7" (UID: "0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:27.488335 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.487764 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhjtp\" (UniqueName: \"kubernetes.io/projected/4156b345-8f3e-4eed-a385-c1469420457d-kube-api-access-vhjtp\") pod \"node-ca-225jx\" (UID: \"4156b345-8f3e-4eed-a385-c1469420457d\") " pod="openshift-image-registry/node-ca-225jx" Jun 06 20:46:27.488521 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.488500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gm8c\" (UniqueName: \"kubernetes.io/projected/a23e6dfd-75d3-4cf5-93b9-16bf692defb1-kube-api-access-5gm8c\") pod \"tuned-7znx8\" (UID: \"a23e6dfd-75d3-4cf5-93b9-16bf692defb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.489319 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.489294 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2d2w\" (UniqueName: \"kubernetes.io/projected/8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce-kube-api-access-d2d2w\") pod \"iptables-alerter-fklhr\" (UID: \"8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce\") " pod="openshift-network-operator/iptables-alerter-fklhr" Jun 06 20:46:27.489814 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.489798 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzq24\" (UniqueName: \"kubernetes.io/projected/f444c70e-29cd-4a6a-8c48-e7a814a4fff8-kube-api-access-lzq24\") pod \"ovnkube-node-5ftq4\" (UID: \"f444c70e-29cd-4a6a-8c48-e7a814a4fff8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.489982 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.489961 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn58l\" (UniqueName: \"kubernetes.io/projected/9a48bfbc-be4a-4dba-bea8-a6c00d72d275-kube-api-access-xn58l\") pod \"multus-additional-cni-plugins-mtkz9\" (UID: \"9a48bfbc-be4a-4dba-bea8-a6c00d72d275\") " pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.582299 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582264 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-system-cni-dir\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.582299 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-os-release\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.582516 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582317 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-multus-conf-dir\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.582516 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582366 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-multus-conf-dir\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.582516 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b68a212d-020d-4c2f-9597-800e58ac80ef-tmp-dir\") pod \"node-resolver-qf8k2\" (UID: \"b68a212d-020d-4c2f-9597-800e58ac80ef\") " pod="openshift-dns/node-resolver-qf8k2" Jun 06 20:46:27.582516 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96hdm\" (UniqueName: \"kubernetes.io/projected/b68a212d-020d-4c2f-9597-800e58ac80ef-kube-api-access-96hdm\") pod \"node-resolver-qf8k2\" (UID: \"b68a212d-020d-4c2f-9597-800e58ac80ef\") " pod="openshift-dns/node-resolver-qf8k2" Jun 06 20:46:27.582516 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582422 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-os-release\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.582516 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582387 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-system-cni-dir\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.582516 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-var-lib-cni-bin\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.582516 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582485 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:27.582516 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582496 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-var-lib-cni-bin\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.582516 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcb68591-97bc-4e9b-960a-f6ed0aecd0da-konnectivity-ca\") pod \"konnectivity-agent-v22ns\" (UID: \"dcb68591-97bc-4e9b-960a-f6ed0aecd0da\") " pod="kube-system/konnectivity-agent-v22ns" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582551 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-sys-fs\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvx7m\" (UniqueName: \"kubernetes.io/projected/ab0e8860-58f5-4601-afad-1ff7f00de91e-kube-api-access-pvx7m\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:27.582587 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-etc-selinux\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab0e8860-58f5-4601-afad-1ff7f00de91e-cni-binary-copy\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:27.582647 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs podName:a38f8798-b100-40c5-be25-f6828d3db580 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:28.082628718 +0000 UTC m=+3.038169700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs") pod "network-metrics-daemon-xtdmx" (UID: "a38f8798-b100-40c5-be25-f6828d3db580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582669 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b68a212d-020d-4c2f-9597-800e58ac80ef-tmp-dir\") pod \"node-resolver-qf8k2\" (UID: \"b68a212d-020d-4c2f-9597-800e58ac80ef\") " pod="openshift-dns/node-resolver-qf8k2" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582674 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-sys-fs\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-socket-dir\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582777 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-socket-dir\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582786 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-run-netns\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582812 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-etc-selinux\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582828 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-multus-socket-dir-parent\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b68a212d-020d-4c2f-9597-800e58ac80ef-hosts-file\") pod \"node-resolver-qf8k2\" (UID: \"b68a212d-020d-4c2f-9597-800e58ac80ef\") " pod="openshift-dns/node-resolver-qf8k2" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582881 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-run-netns\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582886 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-multus-socket-dir-parent\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582906 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-var-lib-cni-multus\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582934 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-device-dir\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582948 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b68a212d-020d-4c2f-9597-800e58ac80ef-hosts-file\") pod \"node-resolver-qf8k2\" (UID: \"b68a212d-020d-4c2f-9597-800e58ac80ef\") " pod="openshift-dns/node-resolver-qf8k2" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582962 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8cv\" (UniqueName: \"kubernetes.io/projected/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-kube-api-access-5p8cv\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2beb3bb9-4934-4da1-9472-289193555adb-dbus\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582988 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-var-lib-cni-multus\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.582995 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-device-dir\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcb68591-97bc-4e9b-960a-f6ed0aecd0da-agent-certs\") pod \"konnectivity-agent-v22ns\" (UID: \"dcb68591-97bc-4e9b-960a-f6ed0aecd0da\") " pod="kube-system/konnectivity-agent-v22ns" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-run-multus-certs\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-multus-cni-dir\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583098 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-cnibin\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583110 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcb68591-97bc-4e9b-960a-f6ed0aecd0da-konnectivity-ca\") pod \"konnectivity-agent-v22ns\" (UID: \"dcb68591-97bc-4e9b-960a-f6ed0aecd0da\") " pod="kube-system/konnectivity-agent-v22ns" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583124 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvcx9\" (UniqueName: \"kubernetes.io/projected/a38f8798-b100-40c5-be25-f6828d3db580-kube-api-access-fvcx9\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583129 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2beb3bb9-4934-4da1-9472-289193555adb-dbus\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583157 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583167 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab0e8860-58f5-4601-afad-1ff7f00de91e-cni-binary-copy\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583195 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab0e8860-58f5-4601-afad-1ff7f00de91e-multus-daemon-config\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583214 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.583731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583219 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-cnibin\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583229 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-etc-kubernetes\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-run-multus-certs\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583260 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-etc-kubernetes\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-registration-dir\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583303 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-registration-dir\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-hostroot\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583331 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-multus-cni-dir\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:27.583376 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583418 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-hostroot\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2beb3bb9-4934-4da1-9472-289193555adb-kubelet-config\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-run-k8s-cni-cncf-io\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-var-lib-kubelet\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583516 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2beb3bb9-4934-4da1-9472-289193555adb-kubelet-config\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:27.583567 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret podName:2beb3bb9-4934-4da1-9472-289193555adb nodeName:}" failed. No retries permitted until 2026-06-06 20:46:28.083552118 +0000 UTC m=+3.039093078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret") pod "global-pull-secret-syncer-wkssg" (UID: "2beb3bb9-4934-4da1-9472-289193555adb") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583610 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-var-lib-kubelet\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.584395 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583627 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab0e8860-58f5-4601-afad-1ff7f00de91e-host-run-k8s-cni-cncf-io\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.584975 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.583632 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab0e8860-58f5-4601-afad-1ff7f00de91e-multus-daemon-config\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.585469 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.585452 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcb68591-97bc-4e9b-960a-f6ed0aecd0da-agent-certs\") pod \"konnectivity-agent-v22ns\" (UID: \"dcb68591-97bc-4e9b-960a-f6ed0aecd0da\") " pod="kube-system/konnectivity-agent-v22ns" Jun 06 20:46:27.591097 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.591076 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p8cv\" (UniqueName: \"kubernetes.io/projected/2dcc4533-7057-48f5-bbb2-7bb1eb7f608b-kube-api-access-5p8cv\") pod \"aws-ebs-csi-driver-node-cn624\" (UID: \"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.591189 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.591169 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96hdm\" (UniqueName: \"kubernetes.io/projected/b68a212d-020d-4c2f-9597-800e58ac80ef-kube-api-access-96hdm\") pod \"node-resolver-qf8k2\" (UID: \"b68a212d-020d-4c2f-9597-800e58ac80ef\") " pod="openshift-dns/node-resolver-qf8k2" Jun 06 20:46:27.591574 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.591550 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvx7m\" (UniqueName: \"kubernetes.io/projected/ab0e8860-58f5-4601-afad-1ff7f00de91e-kube-api-access-pvx7m\") pod \"multus-m8jvk\" (UID: \"ab0e8860-58f5-4601-afad-1ff7f00de91e\") " pod="openshift-multus/multus-m8jvk" Jun 06 20:46:27.591574 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.591569 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvcx9\" (UniqueName: \"kubernetes.io/projected/a38f8798-b100-40c5-be25-f6828d3db580-kube-api-access-fvcx9\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:27.623729 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.623680 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:46:27.669431 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.669410 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-225jx" Jun 06 20:46:27.683515 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.683497 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fklhr" Jun 06 20:46:27.688082 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.688066 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7znx8" Jun 06 20:46:27.692625 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.692608 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:27.700227 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.700208 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mtkz9" Jun 06 20:46:27.705672 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.705655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qf8k2" Jun 06 20:46:27.713644 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.713626 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v22ns" Jun 06 20:46:27.721350 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.721335 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" Jun 06 20:46:27.727818 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:27.727802 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m8jvk" Jun 06 20:46:28.086695 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.086616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9vv\" (UniqueName: \"kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv\") pod \"network-check-target-ggpw7\" (UID: \"0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582\") " pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:28.086695 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.086667 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:28.086923 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.086713 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:28.086923 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:28.086806 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:28.086923 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:28.086844 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:28.086923 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:28.086845 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:28.086923 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:28.086858 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2f9vv for pod openshift-network-diagnostics/network-check-target-ggpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:28.086923 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:28.086813 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:28.086923 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:28.086907 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs podName:a38f8798-b100-40c5-be25-f6828d3db580 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:29.086887352 +0000 UTC m=+4.042428331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs") pod "network-metrics-daemon-xtdmx" (UID: "a38f8798-b100-40c5-be25-f6828d3db580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:28.086923 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:28.086925 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv podName:0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:29.086915009 +0000 UTC m=+4.042455969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f9vv" (UniqueName: "kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv") pod "network-check-target-ggpw7" (UID: "0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:28.087295 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:28.086942 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret podName:2beb3bb9-4934-4da1-9472-289193555adb nodeName:}" failed. No retries permitted until 2026-06-06 20:46:29.086933362 +0000 UTC m=+4.042474321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret") pod "global-pull-secret-syncer-wkssg" (UID: "2beb3bb9-4934-4da1-9472-289193555adb") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:28.168416 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:28.168243 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23e6dfd_75d3_4cf5_93b9_16bf692defb1.slice/crio-432db1d31e49cbcec575311ec7f70da1f57b2c951ddc651c8ccd665403e2138a WatchSource:0}: Error finding container 432db1d31e49cbcec575311ec7f70da1f57b2c951ddc651c8ccd665403e2138a: Status 404 returned error can't find the container with id 432db1d31e49cbcec575311ec7f70da1f57b2c951ddc651c8ccd665403e2138a Jun 06 20:46:28.170223 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:28.170060 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcb68591_97bc_4e9b_960a_f6ed0aecd0da.slice/crio-36a943cb3d27a9f0e576e06e833beba0129688821c58ec3c2e18ebc254183670 WatchSource:0}: Error finding container 36a943cb3d27a9f0e576e06e833beba0129688821c58ec3c2e18ebc254183670: Status 404 returned error can't find the container with id 36a943cb3d27a9f0e576e06e833beba0129688821c58ec3c2e18ebc254183670 Jun 06 20:46:28.173049 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:28.172923 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4156b345_8f3e_4eed_a385_c1469420457d.slice/crio-8183e16526599fa814898aebbba301104b8d2dbaddef2f0b3c7b6b7003e05133 WatchSource:0}: Error finding container 8183e16526599fa814898aebbba301104b8d2dbaddef2f0b3c7b6b7003e05133: Status 404 returned error can't find the container with id 8183e16526599fa814898aebbba301104b8d2dbaddef2f0b3c7b6b7003e05133 Jun 06 20:46:28.173566 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:28.173542 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0e8860_58f5_4601_afad_1ff7f00de91e.slice/crio-0b069a22b1a818aa4533db43236d1081e78cc7fef9493eb0c356f71f127e1a30 WatchSource:0}: Error finding container 0b069a22b1a818aa4533db43236d1081e78cc7fef9493eb0c356f71f127e1a30: Status 404 returned error can't find the container with id 0b069a22b1a818aa4533db43236d1081e78cc7fef9493eb0c356f71f127e1a30 Jun 06 20:46:28.195128 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:28.195107 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68a212d_020d_4c2f_9597_800e58ac80ef.slice/crio-724e2c18085c8b37a35423e6468956951b073cc1f80f15b310e34102ede85f4a WatchSource:0}: Error finding container 724e2c18085c8b37a35423e6468956951b073cc1f80f15b310e34102ede85f4a: Status 404 returned error can't find the container with id 724e2c18085c8b37a35423e6468956951b073cc1f80f15b310e34102ede85f4a Jun 06 20:46:28.196483 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:28.196446 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf444c70e_29cd_4a6a_8c48_e7a814a4fff8.slice/crio-20fe8a493b513e8f5d88380bab0ae13355043ed9f6e32e9b464dfabb49abd368 WatchSource:0}: Error finding container 20fe8a493b513e8f5d88380bab0ae13355043ed9f6e32e9b464dfabb49abd368: Status 404 returned error can't find the container with id 20fe8a493b513e8f5d88380bab0ae13355043ed9f6e32e9b464dfabb49abd368 Jun 06 20:46:28.197357 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:28.197330 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbf0cfd_8c33_403f_97cb_8b83bf11c2ce.slice/crio-e8b6173b1497b66dcf2cb0803cf8ffe310bf8dcff569956c3b6ca35a8a214090 WatchSource:0}: Error finding container e8b6173b1497b66dcf2cb0803cf8ffe310bf8dcff569956c3b6ca35a8a214090: Status 404 returned error can't find the container with id e8b6173b1497b66dcf2cb0803cf8ffe310bf8dcff569956c3b6ca35a8a214090 Jun 06 20:46:28.199455 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:28.199412 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a48bfbc_be4a_4dba_bea8_a6c00d72d275.slice/crio-d87d28cab433f041118008d1cc4d423628f227ceb839440633f130cf77c23c6f WatchSource:0}: Error finding container d87d28cab433f041118008d1cc4d423628f227ceb839440633f130cf77c23c6f: Status 404 returned error can't find the container with id d87d28cab433f041118008d1cc4d423628f227ceb839440633f130cf77c23c6f Jun 06 20:46:28.200148 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:46:28.200117 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dcc4533_7057_48f5_bbb2_7bb1eb7f608b.slice/crio-43ed4e78984c4e43dfe2d13ac606697efd90b5c768d546327ad3b12f255c4b0f WatchSource:0}: Error finding container 43ed4e78984c4e43dfe2d13ac606697efd90b5c768d546327ad3b12f255c4b0f: Status 404 returned error can't find the container with id 43ed4e78984c4e43dfe2d13ac606697efd90b5c768d546327ad3b12f255c4b0f Jun 06 20:46:28.415904 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.415761 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 20:41:27 +0000 UTC" deadline="2027-11-20 16:32:31.212656298 +0000 UTC" Jun 06 20:46:28.415904 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.415822 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12763h46m2.796837324s" Jun 06 20:46:28.440509 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.440482 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" event={"ID":"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b","Type":"ContainerStarted","Data":"43ed4e78984c4e43dfe2d13ac606697efd90b5c768d546327ad3b12f255c4b0f"} Jun 06 20:46:28.442424 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.442397 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" event={"ID":"f444c70e-29cd-4a6a-8c48-e7a814a4fff8","Type":"ContainerStarted","Data":"20fe8a493b513e8f5d88380bab0ae13355043ed9f6e32e9b464dfabb49abd368"} Jun 06 20:46:28.443428 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.443394 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qf8k2" event={"ID":"b68a212d-020d-4c2f-9597-800e58ac80ef","Type":"ContainerStarted","Data":"724e2c18085c8b37a35423e6468956951b073cc1f80f15b310e34102ede85f4a"} Jun 06 20:46:28.444813 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.444780 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m8jvk" event={"ID":"ab0e8860-58f5-4601-afad-1ff7f00de91e","Type":"ContainerStarted","Data":"0b069a22b1a818aa4533db43236d1081e78cc7fef9493eb0c356f71f127e1a30"} Jun 06 20:46:28.445958 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.445934 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-225jx" event={"ID":"4156b345-8f3e-4eed-a385-c1469420457d","Type":"ContainerStarted","Data":"8183e16526599fa814898aebbba301104b8d2dbaddef2f0b3c7b6b7003e05133"} Jun 06 20:46:28.447074 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.447053 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v22ns" event={"ID":"dcb68591-97bc-4e9b-960a-f6ed0aecd0da","Type":"ContainerStarted","Data":"36a943cb3d27a9f0e576e06e833beba0129688821c58ec3c2e18ebc254183670"} Jun 06 20:46:28.448094 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.448075 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7znx8" event={"ID":"a23e6dfd-75d3-4cf5-93b9-16bf692defb1","Type":"ContainerStarted","Data":"432db1d31e49cbcec575311ec7f70da1f57b2c951ddc651c8ccd665403e2138a"} Jun 06 20:46:28.450440 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.450415 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-80.ec2.internal" event={"ID":"05e793a3013e7e8f3e625c9bad9e9e51","Type":"ContainerStarted","Data":"ba2d3db65a41b13ddf0c587736c5573e0c96972f75dbf03761b712a6f36a1819"} Jun 06 20:46:28.453582 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.453555 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtkz9" event={"ID":"9a48bfbc-be4a-4dba-bea8-a6c00d72d275","Type":"ContainerStarted","Data":"d87d28cab433f041118008d1cc4d423628f227ceb839440633f130cf77c23c6f"} Jun 06 20:46:28.454910 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.454883 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fklhr" event={"ID":"8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce","Type":"ContainerStarted","Data":"e8b6173b1497b66dcf2cb0803cf8ffe310bf8dcff569956c3b6ca35a8a214090"} Jun 06 20:46:28.465426 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:28.465384 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-80.ec2.internal" podStartSLOduration=2.4653719499999998 podStartE2EDuration="2.46537195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:28.465349981 +0000 UTC m=+3.420890962" watchObservedRunningTime="2026-06-06 20:46:28.46537195 +0000 UTC m=+3.420912931" Jun 06 20:46:29.092801 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:29.092623 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9vv\" (UniqueName: \"kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv\") pod \"network-check-target-ggpw7\" (UID: \"0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582\") " pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:29.092801 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:29.092690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:29.092801 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:29.092773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:29.093120 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:29.092913 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:29.093120 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:29.092976 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs podName:a38f8798-b100-40c5-be25-f6828d3db580 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:31.092956376 +0000 UTC m=+6.048497359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs") pod "network-metrics-daemon-xtdmx" (UID: "a38f8798-b100-40c5-be25-f6828d3db580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:29.093567 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:29.093379 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:29.093567 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:29.093400 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:29.093567 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:29.093414 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2f9vv for pod openshift-network-diagnostics/network-check-target-ggpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:29.093567 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:29.093462 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv podName:0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:31.093445569 +0000 UTC m=+6.048986544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f9vv" (UniqueName: "kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv") pod "network-check-target-ggpw7" (UID: "0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:29.093567 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:29.093520 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:29.093567 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:29.093554 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret podName:2beb3bb9-4934-4da1-9472-289193555adb nodeName:}" failed. No retries permitted until 2026-06-06 20:46:31.093542406 +0000 UTC m=+6.049083380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret") pod "global-pull-secret-syncer-wkssg" (UID: "2beb3bb9-4934-4da1-9472-289193555adb") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:29.416491 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:29.416404 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 20:41:27 +0000 UTC" deadline="2027-11-03 16:48:22.004863019 +0000 UTC" Jun 06 20:46:29.416491 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:29.416449 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12356h1m52.588422333s" Jun 06 20:46:29.431778 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:29.431747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:29.431919 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:29.431894 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:29.432321 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:29.432301 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:29.432429 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:29.432409 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:29.432588 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:29.432568 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:29.432701 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:29.432678 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:29.462092 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:29.462066 2561 generic.go:356] "Generic (PLEG): container finished" podID="9d27d8ba139fdcee96eb4901dcd08628" containerID="95fc895037d0e18f65abb9120d847983dd599ced94d46465dd615080327d97c5" exitCode=0 Jun 06 20:46:29.474241 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:29.471657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" event={"ID":"9d27d8ba139fdcee96eb4901dcd08628","Type":"ContainerDied","Data":"95fc895037d0e18f65abb9120d847983dd599ced94d46465dd615080327d97c5"} Jun 06 20:46:30.482017 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:30.481922 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" event={"ID":"9d27d8ba139fdcee96eb4901dcd08628","Type":"ContainerStarted","Data":"3cd44dec9312abfe7de3b649523c039a50b602c3ce8aa7cf4a83f390c63d12e5"} Jun 06 20:46:31.111736 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:31.111697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9vv\" (UniqueName: \"kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv\") pod \"network-check-target-ggpw7\" (UID: \"0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582\") " pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:31.111986 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:31.111763 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:31.111986 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:31.111806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:31.111986 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:31.111939 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:31.112153 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:31.112002 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs podName:a38f8798-b100-40c5-be25-f6828d3db580 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:35.111982893 +0000 UTC m=+10.067523877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs") pod "network-metrics-daemon-xtdmx" (UID: "a38f8798-b100-40c5-be25-f6828d3db580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:31.112153 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:31.112084 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:31.112153 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:31.112101 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:31.112153 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:31.112114 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2f9vv for pod openshift-network-diagnostics/network-check-target-ggpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:31.112153 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:31.112150 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv podName:0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:35.112138577 +0000 UTC m=+10.067679552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f9vv" (UniqueName: "kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv") pod "network-check-target-ggpw7" (UID: "0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:31.112398 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:31.112204 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:31.112398 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:31.112236 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret podName:2beb3bb9-4934-4da1-9472-289193555adb nodeName:}" failed. No retries permitted until 2026-06-06 20:46:35.112223816 +0000 UTC m=+10.067764789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret") pod "global-pull-secret-syncer-wkssg" (UID: "2beb3bb9-4934-4da1-9472-289193555adb") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:31.432517 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:31.432035 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:31.432517 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:31.432166 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:31.433154 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:31.432826 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:31.433154 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:31.432959 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:31.433154 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:31.433028 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:31.433154 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:31.433114 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:33.433012 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:33.432508 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:33.433012 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:33.432641 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:33.433012 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:33.432788 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:33.433012 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:33.432821 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:33.433012 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:33.432957 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:33.433652 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:33.433058 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:35.146463 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:35.146418 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9vv\" (UniqueName: \"kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv\") pod \"network-check-target-ggpw7\" (UID: \"0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582\") " pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:35.146929 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:35.146489 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:35.146929 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:35.146535 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:35.146929 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:35.146653 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:35.146929 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:35.146686 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:35.146929 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:35.146711 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:35.146929 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:35.146719 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret podName:2beb3bb9-4934-4da1-9472-289193555adb nodeName:}" failed. No retries permitted until 2026-06-06 20:46:43.146699896 +0000 UTC m=+18.102240871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret") pod "global-pull-secret-syncer-wkssg" (UID: "2beb3bb9-4934-4da1-9472-289193555adb") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:35.146929 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:35.146724 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2f9vv for pod openshift-network-diagnostics/network-check-target-ggpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:35.146929 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:35.146695 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:35.146929 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:35.146776 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv podName:0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:43.146759324 +0000 UTC m=+18.102300295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f9vv" (UniqueName: "kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv") pod "network-check-target-ggpw7" (UID: "0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:35.146929 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:35.146870 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs podName:a38f8798-b100-40c5-be25-f6828d3db580 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:43.146847137 +0000 UTC m=+18.102388109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs") pod "network-metrics-daemon-xtdmx" (UID: "a38f8798-b100-40c5-be25-f6828d3db580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:35.432217 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:35.431847 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:35.432217 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:35.431973 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:35.432418 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:35.432379 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:35.432523 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:35.432477 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:35.433796 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:35.433635 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:35.433796 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:35.433736 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:37.432362 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:37.432331 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:37.432846 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:37.432371 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:37.432846 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:37.432331 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:37.432846 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:37.432465 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:37.432846 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:37.432534 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:37.432846 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:37.432610 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:39.432619 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:39.432583 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:39.433140 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:39.432643 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:39.433140 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:39.432655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:39.433140 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:39.432741 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:39.433140 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:39.432806 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:39.433140 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:39.432912 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:41.432333 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:41.432289 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:41.432333 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:41.432328 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:41.432818 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:41.432299 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:41.432818 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:41.432414 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:41.432818 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:41.432487 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:41.432818 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:41.432566 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:43.211401 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:43.211366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9vv\" (UniqueName: \"kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv\") pod \"network-check-target-ggpw7\" (UID: \"0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582\") " pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:43.211925 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:43.211426 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:43.211925 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:43.211474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:43.211925 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:43.211567 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:43.211925 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:43.211598 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:43.211925 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:43.211608 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2f9vv for pod openshift-network-diagnostics/network-check-target-ggpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:43.211925 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:43.211652 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv podName:0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:59.211639088 +0000 UTC m=+34.167180060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f9vv" (UniqueName: "kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv") pod "network-check-target-ggpw7" (UID: "0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:43.211925 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:43.211573 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:43.211925 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:43.211573 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:43.211925 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:43.211718 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs podName:a38f8798-b100-40c5-be25-f6828d3db580 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:59.211700934 +0000 UTC m=+34.167241915 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs") pod "network-metrics-daemon-xtdmx" (UID: "a38f8798-b100-40c5-be25-f6828d3db580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:43.211925 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:43.211778 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret podName:2beb3bb9-4934-4da1-9472-289193555adb nodeName:}" failed. No retries permitted until 2026-06-06 20:46:59.211751017 +0000 UTC m=+34.167291990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret") pod "global-pull-secret-syncer-wkssg" (UID: "2beb3bb9-4934-4da1-9472-289193555adb") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:43.432361 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:43.432329 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:43.432361 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:43.432347 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:43.432589 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:43.432330 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:43.432589 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:43.432445 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:43.432589 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:43.432536 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:43.432739 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:43.432640 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:45.432985 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:45.432954 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:45.433411 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:45.433069 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:45.433411 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:45.433096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:45.433411 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:45.433095 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:45.433411 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:45.433201 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:45.433411 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:45.433273 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:47.431828 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.431662 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:47.432385 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:47.431956 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:47.432385 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.431662 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:47.432385 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.431744 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:47.432385 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:47.432111 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:47.432385 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:47.432169 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:47.513825 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.513798 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7znx8" event={"ID":"a23e6dfd-75d3-4cf5-93b9-16bf692defb1","Type":"ContainerStarted","Data":"3c1b8dee4dfa8dfe4bad82ff00f6af40ec0b5f1999c1b226a51eb909a0f886cb"} Jun 06 20:46:47.515320 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.515293 2561 generic.go:356] "Generic (PLEG): container finished" podID="9a48bfbc-be4a-4dba-bea8-a6c00d72d275" containerID="a80b46997bd9b0a9a944f51d8a5b6cd70d96fc132f6a3de0cd82446b817a521a" exitCode=0 Jun 06 20:46:47.515402 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.515368 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtkz9" event={"ID":"9a48bfbc-be4a-4dba-bea8-a6c00d72d275","Type":"ContainerDied","Data":"a80b46997bd9b0a9a944f51d8a5b6cd70d96fc132f6a3de0cd82446b817a521a"} Jun 06 20:46:47.516985 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.516962 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" event={"ID":"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b","Type":"ContainerStarted","Data":"6324f9dc41ca0cc3e596cc71cbfb93c8bdf502a4c7b37db20c6ad0dd168e0f0a"} Jun 06 20:46:47.521345 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.521317 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" event={"ID":"f444c70e-29cd-4a6a-8c48-e7a814a4fff8","Type":"ContainerStarted","Data":"d2482ac03b0f6d12f1656fc033616826066b361194daeddcc8df6ba7d9e553fc"} Jun 06 20:46:47.521441 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.521399 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" event={"ID":"f444c70e-29cd-4a6a-8c48-e7a814a4fff8","Type":"ContainerStarted","Data":"6311af6c56de3f6165520c16ecd34c142f165c1e8b033bc8160871ef10324500"} Jun 06 20:46:47.521480 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.521454 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" event={"ID":"f444c70e-29cd-4a6a-8c48-e7a814a4fff8","Type":"ContainerStarted","Data":"b7e9e8199736ed51613ea161ee49cf38d4b44f3eb2fd4b13513679fe55042bcc"} Jun 06 20:46:47.522829 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.522809 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qf8k2" event={"ID":"b68a212d-020d-4c2f-9597-800e58ac80ef","Type":"ContainerStarted","Data":"c650eb7147a7b0124271e00f2eab79f3aa4f7dedfd730268fcf532066076ecd1"} Jun 06 20:46:47.524321 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.524297 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m8jvk" event={"ID":"ab0e8860-58f5-4601-afad-1ff7f00de91e","Type":"ContainerStarted","Data":"149b9f0b0b87e0cb93c31bf3d1f206a1b65f40379255531e879fb80a83274073"} Jun 06 20:46:47.525620 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.525586 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-225jx" event={"ID":"4156b345-8f3e-4eed-a385-c1469420457d","Type":"ContainerStarted","Data":"6c62733a2aae4919e2f5b3ae3960f1d14f5b4e733b042d8875c394a6680c46b6"} Jun 06 20:46:47.526973 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.526951 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v22ns" event={"ID":"dcb68591-97bc-4e9b-960a-f6ed0aecd0da","Type":"ContainerStarted","Data":"46d13b6439170a98b83e40abb037ad9b9d08f6f27bf382b7d5185cef4f7ecd9b"} Jun 06 20:46:47.529866 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.529815 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7znx8" podStartSLOduration=3.846473746 podStartE2EDuration="22.529803657s" totalImagesPullingTime="18.683329911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:47.529353038 +0000 UTC m=+22.484894018" watchObservedRunningTime="2026-06-06 20:46:47.529803657 +0000 UTC m=+22.485344638" Jun 06 20:46:47.529947 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.529922 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-80.ec2.internal" podStartSLOduration=21.529917851 podStartE2EDuration="21.529917851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:30.497792241 +0000 UTC m=+5.453333225" watchObservedRunningTime="2026-06-06 20:46:47.529917851 +0000 UTC m=+22.485458829" Jun 06 20:46:47.543978 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.543935 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-225jx" podStartSLOduration=3.918518615 podStartE2EDuration="22.543920712s" totalImagesPullingTime="18.625402097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:47.543852869 +0000 UTC m=+22.499393848" watchObservedRunningTime="2026-06-06 20:46:47.543920712 +0000 UTC m=+22.499461695" Jun 06 20:46:47.558022 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.557977 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qf8k2" podStartSLOduration=3.900329073 podStartE2EDuration="22.55796156s" totalImagesPullingTime="18.657632487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:47.557457091 +0000 UTC m=+22.512998071" watchObservedRunningTime="2026-06-06 20:46:47.55796156 +0000 UTC m=+22.513502542" Jun 06 20:46:47.592231 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.592187 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v22ns" podStartSLOduration=8.096127802 podStartE2EDuration="22.592163437s" totalImagesPullingTime="14.496035635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:47.592105826 +0000 UTC m=+22.547646807" watchObservedRunningTime="2026-06-06 20:46:47.592163437 +0000 UTC m=+22.547704418" Jun 06 20:46:47.609253 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:47.609218 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m8jvk" podStartSLOduration=3.907022165 podStartE2EDuration="22.609208351s" totalImagesPullingTime="18.702186186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:47.609169223 +0000 UTC m=+22.564710223" watchObservedRunningTime="2026-06-06 20:46:47.609208351 +0000 UTC m=+22.564749331" Jun 06 20:46:48.342968 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:48.342943 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 06 20:46:48.434527 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:48.434386 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T20:46:48.342964567Z","UUID":"35ce36e4-db74-48cb-b341-69fb7cea1376","Handler":null,"Name":"","Endpoint":""} Jun 06 20:46:48.435744 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:48.435724 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 06 20:46:48.435860 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:48.435768 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 06 20:46:48.531626 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:48.531593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" event={"ID":"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b","Type":"ContainerStarted","Data":"a2dc04f068328e38e360825839c8b6128de34dd088375a3a293d50ff2d29da31"} Jun 06 20:46:48.534926 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:48.534902 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" event={"ID":"f444c70e-29cd-4a6a-8c48-e7a814a4fff8","Type":"ContainerStarted","Data":"59317a3d8c3df8da48e860b262aed1fea5df82f22eb2a6aaa2d3ae70700ca6b6"} Jun 06 20:46:48.535042 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:48.534978 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" event={"ID":"f444c70e-29cd-4a6a-8c48-e7a814a4fff8","Type":"ContainerStarted","Data":"534b07524c5b0a3390506f53a58af770fa9af198ce23eb1fa3dc46f4c6372a05"} Jun 06 20:46:48.535042 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:48.535036 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" event={"ID":"f444c70e-29cd-4a6a-8c48-e7a814a4fff8","Type":"ContainerStarted","Data":"11c79c06892d6435322dea4dda4f9949786cf90644a3afdfe5bb1676551cc911"} Jun 06 20:46:48.536643 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:48.536615 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fklhr" event={"ID":"8cbf0cfd-8c33-403f-97cb-8b83bf11c2ce","Type":"ContainerStarted","Data":"97da4dce20c9c37e13f66a4093369d1d281225dc905417aeb30a3016c7394c94"} Jun 06 20:46:49.432048 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:49.431869 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:49.432180 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:49.431869 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:49.432180 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:49.432161 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:49.432272 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:49.431869 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:49.432319 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:49.432205 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:49.432364 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:49.432327 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:49.540942 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:49.540911 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" event={"ID":"2dcc4533-7057-48f5-bbb2-7bb1eb7f608b","Type":"ContainerStarted","Data":"83401527b972ce79d57915801faeaa52acf2c5aa38f017654155ebe76aff24f9"} Jun 06 20:46:49.569702 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:49.569660 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fklhr" podStartSLOduration=5.9493183609999996 podStartE2EDuration="24.569645796s" totalImagesPullingTime="18.620327435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:48.549879884 +0000 UTC m=+23.505420865" watchObservedRunningTime="2026-06-06 20:46:49.569645796 +0000 UTC m=+24.525186777" Jun 06 20:46:49.569926 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:49.569888 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cn624" podStartSLOduration=3.833747777 podStartE2EDuration="24.569878377s" totalImagesPullingTime="20.7361306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:49.558340228 +0000 UTC m=+24.513881209" watchObservedRunningTime="2026-06-06 20:46:49.569878377 +0000 UTC m=+24.525419360" Jun 06 20:46:50.547555 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:50.547520 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" event={"ID":"f444c70e-29cd-4a6a-8c48-e7a814a4fff8","Type":"ContainerStarted","Data":"b303d8d82139fdfed6eeeea200ae20e342189a6c8315422e49cfca4c8eb86358"} Jun 06 20:46:51.432190 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:51.432142 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:51.432359 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:51.432160 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:51.432359 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:51.432270 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:51.432476 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:51.432391 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:51.432476 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:51.432443 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:51.432569 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:51.432510 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:51.575280 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:51.575209 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v22ns" Jun 06 20:46:51.575985 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:51.575807 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v22ns" Jun 06 20:46:52.557746 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:52.557435 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" event={"ID":"f444c70e-29cd-4a6a-8c48-e7a814a4fff8","Type":"ContainerStarted","Data":"43e5b997f6523495bb71eeaed27d4d5185da52e0e8505d2b97546fdbea1a9010"} Jun 06 20:46:52.557942 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:52.557754 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:52.557942 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:52.557812 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:52.559580 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:52.559553 2561 generic.go:356] "Generic (PLEG): container finished" podID="9a48bfbc-be4a-4dba-bea8-a6c00d72d275" containerID="7ea0632a87fd93e4e624d238fb391efb33595f1ba1a1fb7fb249b45c20e08ae0" exitCode=0 Jun 06 20:46:52.559733 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:52.559640 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtkz9" event={"ID":"9a48bfbc-be4a-4dba-bea8-a6c00d72d275","Type":"ContainerDied","Data":"7ea0632a87fd93e4e624d238fb391efb33595f1ba1a1fb7fb249b45c20e08ae0"} Jun 06 20:46:52.560039 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:52.560015 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v22ns" Jun 06 20:46:52.560426 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:52.560412 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v22ns" Jun 06 20:46:52.573214 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:52.573195 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:52.573488 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:52.573475 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:52.585146 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:52.585109 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" podStartSLOduration=8.764018467 podStartE2EDuration="27.585098743s" totalImagesPullingTime="18.821080276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:52.584576533 +0000 UTC m=+27.540117514" watchObservedRunningTime="2026-06-06 20:46:52.585098743 +0000 UTC m=+27.540639724" Jun 06 20:46:53.435342 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:53.435315 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:53.435640 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:53.435424 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:53.435640 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:53.435449 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:53.435640 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:53.435440 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:53.435640 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:53.435517 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:53.435640 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:53.435573 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:53.562770 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:53.562743 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:46:53.941578 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:53.941382 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wkssg"] Jun 06 20:46:53.942019 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:53.941613 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:53.942019 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:53.941727 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:53.944524 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:53.944498 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ggpw7"] Jun 06 20:46:53.944645 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:53.944594 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:53.944707 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:53.944690 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:53.945180 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:53.945161 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xtdmx"] Jun 06 20:46:53.945261 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:53.945253 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:53.945376 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:53.945358 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:54.566506 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:54.566479 2561 generic.go:356] "Generic (PLEG): container finished" podID="9a48bfbc-be4a-4dba-bea8-a6c00d72d275" containerID="a3a5ed95cf53aa60df64c790ae6fe5404d306c5d46c940bf90e017f5e2367417" exitCode=0 Jun 06 20:46:54.566681 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:54.566565 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtkz9" event={"ID":"9a48bfbc-be4a-4dba-bea8-a6c00d72d275","Type":"ContainerDied","Data":"a3a5ed95cf53aa60df64c790ae6fe5404d306c5d46c940bf90e017f5e2367417"} Jun 06 20:46:55.432213 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:55.432183 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:55.432661 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:55.432258 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:55.432661 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:55.432345 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:55.432661 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:55.432431 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:55.432661 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:55.432473 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:55.432661 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:55.432585 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:56.574317 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:56.574289 2561 generic.go:356] "Generic (PLEG): container finished" podID="9a48bfbc-be4a-4dba-bea8-a6c00d72d275" containerID="a524b23ab6ddbcec547205be3a38d5700c82198dbc837ee7db4a6924f3891ef2" exitCode=0 Jun 06 20:46:56.574855 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:56.574344 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtkz9" event={"ID":"9a48bfbc-be4a-4dba-bea8-a6c00d72d275","Type":"ContainerDied","Data":"a524b23ab6ddbcec547205be3a38d5700c82198dbc837ee7db4a6924f3891ef2"} Jun 06 20:46:57.432244 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:57.432192 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:57.432244 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:57.432229 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:57.432495 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:57.432329 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:57.432495 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:57.432408 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:57.432495 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:57.432475 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:57.432625 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:57.432559 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:59.234771 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.234735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:59.235400 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.234805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9vv\" (UniqueName: \"kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv\") pod \"network-check-target-ggpw7\" (UID: \"0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582\") " pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:59.235400 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.234861 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:59.235400 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:59.234905 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:59.235400 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:59.234953 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:46:59.235400 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:59.234968 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs podName:a38f8798-b100-40c5-be25-f6828d3db580 nodeName:}" failed. No retries permitted until 2026-06-06 20:47:31.234948816 +0000 UTC m=+66.190489790 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs") pod "network-metrics-daemon-xtdmx" (UID: "a38f8798-b100-40c5-be25-f6828d3db580") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:46:59.235400 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:59.234974 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:46:59.235400 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:59.234984 2561 projected.go:196] Error preparing data for projected volume kube-api-access-2f9vv for pod openshift-network-diagnostics/network-check-target-ggpw7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:59.235400 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:59.235026 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv podName:0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582 nodeName:}" failed. No retries permitted until 2026-06-06 20:47:31.235010952 +0000 UTC m=+66.190551925 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f9vv" (UniqueName: "kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv") pod "network-check-target-ggpw7" (UID: "0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:46:59.235400 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:59.234957 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:59.235400 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:59.235054 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret podName:2beb3bb9-4934-4da1-9472-289193555adb nodeName:}" failed. No retries permitted until 2026-06-06 20:47:31.23504834 +0000 UTC m=+66.190589346 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret") pod "global-pull-secret-syncer-wkssg" (UID: "2beb3bb9-4934-4da1-9472-289193555adb") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:46:59.431580 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.431503 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:46:59.431580 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.431546 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:46:59.431771 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:59.431644 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:46:59.431771 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:59.431689 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkssg" podUID="2beb3bb9-4934-4da1-9472-289193555adb" Jun 06 20:46:59.431771 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.431700 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:46:59.431979 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:46:59.431785 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ggpw7" podUID="0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582" Jun 06 20:46:59.888238 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.888212 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-80.ec2.internal" event="NodeReady" Jun 06 20:46:59.888412 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.888326 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 06 20:46:59.928887 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.928855 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vsg97"] Jun 06 20:46:59.936774 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.936740 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p4n8h"] Jun 06 20:46:59.936940 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.936869 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vsg97" Jun 06 20:46:59.939565 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.939540 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 06 20:46:59.939781 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.939763 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 06 20:46:59.939871 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.939805 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9qr76\"" Jun 06 20:46:59.940222 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.940200 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p4n8h" Jun 06 20:46:59.942227 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.942019 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vsg97"] Jun 06 20:46:59.942664 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.942645 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 06 20:46:59.942771 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.942751 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 06 20:46:59.943088 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.943057 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-22d9j\"" Jun 06 20:46:59.943233 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.943130 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 06 20:46:59.950990 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:46:59.950800 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p4n8h"] Jun 06 20:47:00.039353 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.039318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:00.039353 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.039361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7fqq\" (UniqueName: \"kubernetes.io/projected/a66425d1-33e6-4fe8-961b-79d20a4c5a36-kube-api-access-t7fqq\") pod \"ingress-canary-p4n8h\" (UID: \"a66425d1-33e6-4fe8-961b-79d20a4c5a36\") " pod="openshift-ingress-canary/ingress-canary-p4n8h" Jun 06 20:47:00.039715 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.039397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfmdq\" (UniqueName: \"kubernetes.io/projected/a6dbc555-220e-4e15-aeb3-ed473af4bb35-kube-api-access-lfmdq\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:00.039715 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.039447 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6dbc555-220e-4e15-aeb3-ed473af4bb35-config-volume\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:00.039715 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.039472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6dbc555-220e-4e15-aeb3-ed473af4bb35-tmp-dir\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:00.039715 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.039563 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a66425d1-33e6-4fe8-961b-79d20a4c5a36-cert\") pod \"ingress-canary-p4n8h\" (UID: \"a66425d1-33e6-4fe8-961b-79d20a4c5a36\") " pod="openshift-ingress-canary/ingress-canary-p4n8h" Jun 06 20:47:00.140707 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.140638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7fqq\" (UniqueName: \"kubernetes.io/projected/a66425d1-33e6-4fe8-961b-79d20a4c5a36-kube-api-access-t7fqq\") pod \"ingress-canary-p4n8h\" (UID: \"a66425d1-33e6-4fe8-961b-79d20a4c5a36\") " pod="openshift-ingress-canary/ingress-canary-p4n8h" Jun 06 20:47:00.140707 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.140671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfmdq\" (UniqueName: \"kubernetes.io/projected/a6dbc555-220e-4e15-aeb3-ed473af4bb35-kube-api-access-lfmdq\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:00.140932 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.140716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6dbc555-220e-4e15-aeb3-ed473af4bb35-config-volume\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:00.140932 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.140740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6dbc555-220e-4e15-aeb3-ed473af4bb35-tmp-dir\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:00.140932 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.140805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a66425d1-33e6-4fe8-961b-79d20a4c5a36-cert\") pod \"ingress-canary-p4n8h\" (UID: \"a66425d1-33e6-4fe8-961b-79d20a4c5a36\") " pod="openshift-ingress-canary/ingress-canary-p4n8h" Jun 06 20:47:00.140932 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.140848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:00.141159 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:00.140949 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:47:00.141159 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:00.141038 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls podName:a6dbc555-220e-4e15-aeb3-ed473af4bb35 nodeName:}" failed. No retries permitted until 2026-06-06 20:47:00.641008108 +0000 UTC m=+35.596549080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls") pod "dns-default-vsg97" (UID: "a6dbc555-220e-4e15-aeb3-ed473af4bb35") : secret "dns-default-metrics-tls" not found Jun 06 20:47:00.141284 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.141216 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6dbc555-220e-4e15-aeb3-ed473af4bb35-tmp-dir\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:00.141402 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.141381 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6dbc555-220e-4e15-aeb3-ed473af4bb35-config-volume\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:00.145667 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.145643 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a66425d1-33e6-4fe8-961b-79d20a4c5a36-cert\") pod \"ingress-canary-p4n8h\" (UID: \"a66425d1-33e6-4fe8-961b-79d20a4c5a36\") " pod="openshift-ingress-canary/ingress-canary-p4n8h" Jun 06 20:47:00.150091 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.149892 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7fqq\" (UniqueName: \"kubernetes.io/projected/a66425d1-33e6-4fe8-961b-79d20a4c5a36-kube-api-access-t7fqq\") pod \"ingress-canary-p4n8h\" (UID: \"a66425d1-33e6-4fe8-961b-79d20a4c5a36\") " pod="openshift-ingress-canary/ingress-canary-p4n8h" Jun 06 20:47:00.150245 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.150228 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfmdq\" (UniqueName: \"kubernetes.io/projected/a6dbc555-220e-4e15-aeb3-ed473af4bb35-kube-api-access-lfmdq\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:00.256151 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.256119 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p4n8h" Jun 06 20:47:00.506882 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.506854 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p4n8h"] Jun 06 20:47:00.510335 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:47:00.510310 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda66425d1_33e6_4fe8_961b_79d20a4c5a36.slice/crio-6f5df787b9d6baeb25d7c8b1618a8516002c0973611e0f4b50077acf0c6c46a2 WatchSource:0}: Error finding container 6f5df787b9d6baeb25d7c8b1618a8516002c0973611e0f4b50077acf0c6c46a2: Status 404 returned error can't find the container with id 6f5df787b9d6baeb25d7c8b1618a8516002c0973611e0f4b50077acf0c6c46a2 Jun 06 20:47:00.585712 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.585680 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p4n8h" event={"ID":"a66425d1-33e6-4fe8-961b-79d20a4c5a36","Type":"ContainerStarted","Data":"6f5df787b9d6baeb25d7c8b1618a8516002c0973611e0f4b50077acf0c6c46a2"} Jun 06 20:47:00.588657 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.588630 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtkz9" event={"ID":"9a48bfbc-be4a-4dba-bea8-a6c00d72d275","Type":"ContainerStarted","Data":"fd1ccc6338f5a34725decf2f5720ab61ea161f33246c42d41250aad463008a70"} Jun 06 20:47:00.644769 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:00.644741 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:00.644929 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:00.644911 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:47:00.644986 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:00.644971 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls podName:a6dbc555-220e-4e15-aeb3-ed473af4bb35 nodeName:}" failed. No retries permitted until 2026-06-06 20:47:01.644956456 +0000 UTC m=+36.600497415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls") pod "dns-default-vsg97" (UID: "a6dbc555-220e-4e15-aeb3-ed473af4bb35") : secret "dns-default-metrics-tls" not found Jun 06 20:47:01.435383 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:01.435311 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:47:01.435796 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:01.435408 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:47:01.435796 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:01.435439 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:47:01.438127 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:01.438100 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 20:47:01.438334 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:01.438318 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 20:47:01.439438 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:01.439405 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 20:47:01.439556 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:01.439421 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 20:47:01.439556 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:01.439498 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dltkl\"" Jun 06 20:47:01.439663 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:01.439454 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9xvqt\"" Jun 06 20:47:01.594216 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:01.594181 2561 generic.go:356] "Generic (PLEG): container finished" podID="9a48bfbc-be4a-4dba-bea8-a6c00d72d275" containerID="fd1ccc6338f5a34725decf2f5720ab61ea161f33246c42d41250aad463008a70" exitCode=0 Jun 06 20:47:01.594386 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:01.594228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtkz9" event={"ID":"9a48bfbc-be4a-4dba-bea8-a6c00d72d275","Type":"ContainerDied","Data":"fd1ccc6338f5a34725decf2f5720ab61ea161f33246c42d41250aad463008a70"} Jun 06 20:47:01.652596 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:01.652567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:01.652726 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:01.652688 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:47:01.652778 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:01.652746 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls podName:a6dbc555-220e-4e15-aeb3-ed473af4bb35 nodeName:}" failed. No retries permitted until 2026-06-06 20:47:03.652728747 +0000 UTC m=+38.608269706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls") pod "dns-default-vsg97" (UID: "a6dbc555-220e-4e15-aeb3-ed473af4bb35") : secret "dns-default-metrics-tls" not found Jun 06 20:47:02.599256 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:02.599083 2561 generic.go:356] "Generic (PLEG): container finished" podID="9a48bfbc-be4a-4dba-bea8-a6c00d72d275" containerID="edc9899d454d029f3d1b6e0285012022614ec89da86307a864be548fceec60e6" exitCode=0 Jun 06 20:47:02.599682 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:02.599155 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtkz9" event={"ID":"9a48bfbc-be4a-4dba-bea8-a6c00d72d275","Type":"ContainerDied","Data":"edc9899d454d029f3d1b6e0285012022614ec89da86307a864be548fceec60e6"} Jun 06 20:47:02.600703 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:02.600681 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p4n8h" event={"ID":"a66425d1-33e6-4fe8-961b-79d20a4c5a36","Type":"ContainerStarted","Data":"fd0bf0a9a65628de3e08da342980e1c05dd7f7a7a23704a8a12d08f1417f7f86"} Jun 06 20:47:02.638739 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:02.638689 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p4n8h" podStartSLOduration=2.197081514 podStartE2EDuration="3.638669455s" totalImagesPullingTime="1.441587941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:02.638076261 +0000 UTC m=+37.593617242" watchObservedRunningTime="2026-06-06 20:47:02.638669455 +0000 UTC m=+37.594210436" Jun 06 20:47:03.606314 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:03.606282 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtkz9" event={"ID":"9a48bfbc-be4a-4dba-bea8-a6c00d72d275","Type":"ContainerStarted","Data":"505ffc2b3c6defbcef5d4a4a5cdd673e3e98e0d2a3489d266248981a94deba49"} Jun 06 20:47:03.629813 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:03.629773 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mtkz9" podStartSLOduration=9.843279998 podStartE2EDuration="38.629759064s" totalImagesPullingTime="28.786479066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:03.628190504 +0000 UTC m=+38.583731485" watchObservedRunningTime="2026-06-06 20:47:03.629759064 +0000 UTC m=+38.585300045" Jun 06 20:47:03.666666 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:03.666636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:03.666796 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:03.666780 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:47:03.666865 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:03.666855 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls podName:a6dbc555-220e-4e15-aeb3-ed473af4bb35 nodeName:}" failed. No retries permitted until 2026-06-06 20:47:07.666823889 +0000 UTC m=+42.622364862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls") pod "dns-default-vsg97" (UID: "a6dbc555-220e-4e15-aeb3-ed473af4bb35") : secret "dns-default-metrics-tls" not found Jun 06 20:47:07.691639 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:07.691608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:07.692105 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:07.691762 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:47:07.692105 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:07.691852 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls podName:a6dbc555-220e-4e15-aeb3-ed473af4bb35 nodeName:}" failed. No retries permitted until 2026-06-06 20:47:15.69181976 +0000 UTC m=+50.647360719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls") pod "dns-default-vsg97" (UID: "a6dbc555-220e-4e15-aeb3-ed473af4bb35") : secret "dns-default-metrics-tls" not found Jun 06 20:47:15.741556 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:15.741522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:15.742052 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:15.741618 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:47:15.742052 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:15.741669 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls podName:a6dbc555-220e-4e15-aeb3-ed473af4bb35 nodeName:}" failed. No retries permitted until 2026-06-06 20:47:31.741654285 +0000 UTC m=+66.697195243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls") pod "dns-default-vsg97" (UID: "a6dbc555-220e-4e15-aeb3-ed473af4bb35") : secret "dns-default-metrics-tls" not found Jun 06 20:47:24.576750 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:24.576724 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ftq4" Jun 06 20:47:29.024851 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.024816 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt"] Jun 06 20:47:29.027149 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.027131 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:29.029739 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.029710 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 06 20:47:29.030937 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.030913 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 06 20:47:29.031026 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.030916 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 06 20:47:29.031026 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.030918 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 06 20:47:29.035565 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.035541 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt"] Jun 06 20:47:29.041196 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.041176 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st"] Jun 06 20:47:29.043445 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.043424 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.046689 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.046671 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 06 20:47:29.046785 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.046708 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 06 20:47:29.046785 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.046681 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 06 20:47:29.046785 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.046728 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 06 20:47:29.055581 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.055561 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st"] Jun 06 20:47:29.128358 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.128338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwnnw\" (UniqueName: \"kubernetes.io/projected/cc8e5244-be10-402a-873d-371680664958-kube-api-access-jwnnw\") pod \"klusterlet-addon-workmgr-ccdd48788-gx6dt\" (UID: \"cc8e5244-be10-402a-873d-371680664958\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:29.128457 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.128364 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cc8e5244-be10-402a-873d-371680664958-klusterlet-config\") pod \"klusterlet-addon-workmgr-ccdd48788-gx6dt\" (UID: \"cc8e5244-be10-402a-873d-371680664958\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:29.128457 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.128381 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/71f53229-c465-48aa-9eed-979ea035b041-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.128457 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.128399 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f53229-c465-48aa-9eed-979ea035b041-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.128457 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.128421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/71f53229-c465-48aa-9eed-979ea035b041-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.128457 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.128446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnc87\" (UniqueName: \"kubernetes.io/projected/71f53229-c465-48aa-9eed-979ea035b041-kube-api-access-wnc87\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.128617 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.128487 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc8e5244-be10-402a-873d-371680664958-tmp\") pod \"klusterlet-addon-workmgr-ccdd48788-gx6dt\" (UID: \"cc8e5244-be10-402a-873d-371680664958\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:29.128617 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.128554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/71f53229-c465-48aa-9eed-979ea035b041-ca\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.128617 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.128576 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/71f53229-c465-48aa-9eed-979ea035b041-hub\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.229612 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.229588 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwnnw\" (UniqueName: \"kubernetes.io/projected/cc8e5244-be10-402a-873d-371680664958-kube-api-access-jwnnw\") pod \"klusterlet-addon-workmgr-ccdd48788-gx6dt\" (UID: \"cc8e5244-be10-402a-873d-371680664958\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:29.229692 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.229615 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cc8e5244-be10-402a-873d-371680664958-klusterlet-config\") pod \"klusterlet-addon-workmgr-ccdd48788-gx6dt\" (UID: \"cc8e5244-be10-402a-873d-371680664958\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:29.229692 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.229631 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/71f53229-c465-48aa-9eed-979ea035b041-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.229692 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.229646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f53229-c465-48aa-9eed-979ea035b041-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.229692 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.229663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/71f53229-c465-48aa-9eed-979ea035b041-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.229692 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.229687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnc87\" (UniqueName: \"kubernetes.io/projected/71f53229-c465-48aa-9eed-979ea035b041-kube-api-access-wnc87\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.229960 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.229710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc8e5244-be10-402a-873d-371680664958-tmp\") pod \"klusterlet-addon-workmgr-ccdd48788-gx6dt\" (UID: \"cc8e5244-be10-402a-873d-371680664958\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:29.230016 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.229985 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/71f53229-c465-48aa-9eed-979ea035b041-ca\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.230060 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.230027 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/71f53229-c465-48aa-9eed-979ea035b041-hub\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.230126 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.230106 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc8e5244-be10-402a-873d-371680664958-tmp\") pod \"klusterlet-addon-workmgr-ccdd48788-gx6dt\" (UID: \"cc8e5244-be10-402a-873d-371680664958\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:29.230445 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.230419 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f53229-c465-48aa-9eed-979ea035b041-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.233286 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.233264 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/71f53229-c465-48aa-9eed-979ea035b041-ca\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.233375 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.233326 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cc8e5244-be10-402a-873d-371680664958-klusterlet-config\") pod \"klusterlet-addon-workmgr-ccdd48788-gx6dt\" (UID: \"cc8e5244-be10-402a-873d-371680664958\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:29.233375 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.233337 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/71f53229-c465-48aa-9eed-979ea035b041-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.233449 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.233433 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/71f53229-c465-48aa-9eed-979ea035b041-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.233495 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.233478 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/71f53229-c465-48aa-9eed-979ea035b041-hub\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.237362 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.237339 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwnnw\" (UniqueName: \"kubernetes.io/projected/cc8e5244-be10-402a-873d-371680664958-kube-api-access-jwnnw\") pod \"klusterlet-addon-workmgr-ccdd48788-gx6dt\" (UID: \"cc8e5244-be10-402a-873d-371680664958\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:29.237689 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.237665 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnc87\" (UniqueName: \"kubernetes.io/projected/71f53229-c465-48aa-9eed-979ea035b041-kube-api-access-wnc87\") pod \"cluster-proxy-proxy-agent-74cd9ffc56-bf6st\" (UID: \"71f53229-c465-48aa-9eed-979ea035b041\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.336862 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.336790 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:29.369707 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.369677 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:47:29.463044 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.463022 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt"] Jun 06 20:47:29.465877 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:47:29.465849 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8e5244_be10_402a_873d_371680664958.slice/crio-9f4627f566b014101bc7cabc9406bd26ca480254310808372d6e7de220a59a75 WatchSource:0}: Error finding container 9f4627f566b014101bc7cabc9406bd26ca480254310808372d6e7de220a59a75: Status 404 returned error can't find the container with id 9f4627f566b014101bc7cabc9406bd26ca480254310808372d6e7de220a59a75 Jun 06 20:47:29.504123 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.504100 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st"] Jun 06 20:47:29.506657 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:47:29.506631 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71f53229_c465_48aa_9eed_979ea035b041.slice/crio-c34d1f435fd3638eee3d3aed3fc80ae2d55b0ac99cf7ffd40062f2f659af2e95 WatchSource:0}: Error finding container c34d1f435fd3638eee3d3aed3fc80ae2d55b0ac99cf7ffd40062f2f659af2e95: Status 404 returned error can't find the container with id c34d1f435fd3638eee3d3aed3fc80ae2d55b0ac99cf7ffd40062f2f659af2e95 Jun 06 20:47:29.661555 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.661524 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" event={"ID":"cc8e5244-be10-402a-873d-371680664958","Type":"ContainerStarted","Data":"9f4627f566b014101bc7cabc9406bd26ca480254310808372d6e7de220a59a75"} Jun 06 20:47:29.662506 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:29.662485 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" event={"ID":"71f53229-c465-48aa-9eed-979ea035b041","Type":"ContainerStarted","Data":"c34d1f435fd3638eee3d3aed3fc80ae2d55b0ac99cf7ffd40062f2f659af2e95"} Jun 06 20:47:31.248947 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.248092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9vv\" (UniqueName: \"kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv\") pod \"network-check-target-ggpw7\" (UID: \"0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582\") " pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:47:31.248947 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.248159 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:47:31.248947 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.248214 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:47:31.252071 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.251650 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 20:47:31.252071 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.251916 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 20:47:31.252071 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.251968 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 20:47:31.259645 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:31.259268 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 20:47:31.259645 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:31.259338 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs podName:a38f8798-b100-40c5-be25-f6828d3db580 nodeName:}" failed. No retries permitted until 2026-06-06 20:48:35.259316385 +0000 UTC m=+130.214857363 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs") pod "network-metrics-daemon-xtdmx" (UID: "a38f8798-b100-40c5-be25-f6828d3db580") : secret "metrics-daemon-secret" not found Jun 06 20:47:31.262123 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.261948 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 20:47:31.264637 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.264585 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2beb3bb9-4934-4da1-9472-289193555adb-original-pull-secret\") pod \"global-pull-secret-syncer-wkssg\" (UID: \"2beb3bb9-4934-4da1-9472-289193555adb\") " pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:47:31.273818 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.273788 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f9vv\" (UniqueName: \"kubernetes.io/projected/0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582-kube-api-access-2f9vv\") pod \"network-check-target-ggpw7\" (UID: \"0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582\") " pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:47:31.445618 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.445538 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkssg" Jun 06 20:47:31.454196 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.454159 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dltkl\"" Jun 06 20:47:31.462023 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.462000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:47:31.753587 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.753546 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:47:31.753779 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:31.753736 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:47:31.753846 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:47:31.753820 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls podName:a6dbc555-220e-4e15-aeb3-ed473af4bb35 nodeName:}" failed. No retries permitted until 2026-06-06 20:48:03.75379671 +0000 UTC m=+98.709337681 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls") pod "dns-default-vsg97" (UID: "a6dbc555-220e-4e15-aeb3-ed473af4bb35") : secret "dns-default-metrics-tls" not found Jun 06 20:47:31.857104 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.856860 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wkssg"] Jun 06 20:47:31.863046 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:47:31.863013 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2beb3bb9_4934_4da1_9472_289193555adb.slice/crio-811fa93b848fd0024a55a5577072ed67d7a3afc2d35967356d9bb3a5d440ff45 WatchSource:0}: Error finding container 811fa93b848fd0024a55a5577072ed67d7a3afc2d35967356d9bb3a5d440ff45: Status 404 returned error can't find the container with id 811fa93b848fd0024a55a5577072ed67d7a3afc2d35967356d9bb3a5d440ff45 Jun 06 20:47:31.878268 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:31.878206 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ggpw7"] Jun 06 20:47:31.882032 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:47:31.882002 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d08e1c7_bbab_4ef4_ac10_bfe7e93ba582.slice/crio-37a6cc35500211eac732d65ba0aecea0bf3455bf9758dae478ba3765ae8e4625 WatchSource:0}: Error finding container 37a6cc35500211eac732d65ba0aecea0bf3455bf9758dae478ba3765ae8e4625: Status 404 returned error can't find the container with id 37a6cc35500211eac732d65ba0aecea0bf3455bf9758dae478ba3765ae8e4625 Jun 06 20:47:32.673651 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:32.673609 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wkssg" event={"ID":"2beb3bb9-4934-4da1-9472-289193555adb","Type":"ContainerStarted","Data":"811fa93b848fd0024a55a5577072ed67d7a3afc2d35967356d9bb3a5d440ff45"} Jun 06 20:47:32.675148 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:32.675119 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ggpw7" event={"ID":"0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582","Type":"ContainerStarted","Data":"37a6cc35500211eac732d65ba0aecea0bf3455bf9758dae478ba3765ae8e4625"} Jun 06 20:47:38.694594 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.694555 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" event={"ID":"cc8e5244-be10-402a-873d-371680664958","Type":"ContainerStarted","Data":"a9ab1d198bc675a680950e55575848c2a942588ffc0024e99a0bc2a28cba4839"} Jun 06 20:47:38.695068 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.694767 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:38.696285 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.696254 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wkssg" event={"ID":"2beb3bb9-4934-4da1-9472-289193555adb","Type":"ContainerStarted","Data":"52255efabea079e79fa9664a9ec2795f879b9e5d1ad00785f093afd61641f347"} Jun 06 20:47:38.696718 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.696697 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:47:38.698410 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.698385 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" event={"ID":"71f53229-c465-48aa-9eed-979ea035b041","Type":"ContainerStarted","Data":"249a5247f63bfad3450610f09442d6ee86a639d32d6e38c800b45c781049d9ef"} Jun 06 20:47:38.698485 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.698413 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" event={"ID":"71f53229-c465-48aa-9eed-979ea035b041","Type":"ContainerStarted","Data":"7d02347cf58760fc78cb8cc5905452cdebca086ce8cc85cf2852a05562511ebe"} Jun 06 20:47:38.698485 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.698429 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" event={"ID":"71f53229-c465-48aa-9eed-979ea035b041","Type":"ContainerStarted","Data":"2f15ea89915055910ef8672b96be8df92a1289dd962278b23b67712dacadb2bf"} Jun 06 20:47:38.699711 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.699692 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ggpw7" event={"ID":"0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582","Type":"ContainerStarted","Data":"242299a8aacde6adeef4a75244bb60f66f04c18e2d7cc119cc39290677defe54"} Jun 06 20:47:38.699822 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.699806 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:47:38.710338 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.710292 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" podStartSLOduration=0.946263537 podStartE2EDuration="9.710279231s" totalImagesPullingTime="8.764015694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:38.709395821 +0000 UTC m=+73.664936802" watchObservedRunningTime="2026-06-06 20:47:38.710279231 +0000 UTC m=+73.665820191" Jun 06 20:47:38.724374 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.724335 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ggpw7" podStartSLOduration=67.380228818 podStartE2EDuration="1m13.724323143s" totalImagesPullingTime="6.344094325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:38.724009808 +0000 UTC m=+73.679550782" watchObservedRunningTime="2026-06-06 20:47:38.724323143 +0000 UTC m=+73.679864124" Jun 06 20:47:38.737403 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.737362 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wkssg" podStartSLOduration=67.377923782 podStartE2EDuration="1m13.737351406s" totalImagesPullingTime="6.359427624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:38.736528046 +0000 UTC m=+73.692069027" watchObservedRunningTime="2026-06-06 20:47:38.737351406 +0000 UTC m=+73.692892386" Jun 06 20:47:38.767314 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:47:38.767274 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" podStartSLOduration=1.06098714 podStartE2EDuration="9.767259399s" totalImagesPullingTime="8.706272259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:38.766925521 +0000 UTC m=+73.722466504" watchObservedRunningTime="2026-06-06 20:47:38.767259399 +0000 UTC m=+73.722800380" Jun 06 20:48:03.767597 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:48:03.767526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:48:03.768000 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:48:03.767650 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:48:03.768000 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:48:03.767712 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls podName:a6dbc555-220e-4e15-aeb3-ed473af4bb35 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:07.767696571 +0000 UTC m=+162.723237530 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls") pod "dns-default-vsg97" (UID: "a6dbc555-220e-4e15-aeb3-ed473af4bb35") : secret "dns-default-metrics-tls" not found Jun 06 20:48:09.705221 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:48:09.705181 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ggpw7" Jun 06 20:48:35.269213 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:48:35.269176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:48:35.269661 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:48:35.269284 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 20:48:35.269661 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:48:35.269349 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs podName:a38f8798-b100-40c5-be25-f6828d3db580 nodeName:}" failed. No retries permitted until 2026-06-06 20:50:37.269332959 +0000 UTC m=+252.224873918 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs") pod "network-metrics-daemon-xtdmx" (UID: "a38f8798-b100-40c5-be25-f6828d3db580") : secret "metrics-daemon-secret" not found Jun 06 20:49:02.949453 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:49:02.949413 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vsg97" podUID="a6dbc555-220e-4e15-aeb3-ed473af4bb35" Jun 06 20:49:03.934756 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:03.934730 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vsg97" Jun 06 20:49:04.457238 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:49:04.457202 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xtdmx" podUID="a38f8798-b100-40c5-be25-f6828d3db580" Jun 06 20:49:07.777680 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:07.777638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:49:07.778066 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:49:07.777743 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:49:07.778066 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:49:07.777802 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls podName:a6dbc555-220e-4e15-aeb3-ed473af4bb35 nodeName:}" failed. No retries permitted until 2026-06-06 20:51:09.777787782 +0000 UTC m=+284.733328741 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls") pod "dns-default-vsg97" (UID: "a6dbc555-220e-4e15-aeb3-ed473af4bb35") : secret "dns-default-metrics-tls" not found Jun 06 20:49:19.431868 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:19.431778 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:49:38.695655 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:38.695610 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" podUID="cc8e5244-be10-402a-873d-371680664958" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jun 06 20:49:39.027750 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:39.027666 2561 generic.go:356] "Generic (PLEG): container finished" podID="cc8e5244-be10-402a-873d-371680664958" containerID="a9ab1d198bc675a680950e55575848c2a942588ffc0024e99a0bc2a28cba4839" exitCode=1 Jun 06 20:49:39.027750 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:39.027707 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" event={"ID":"cc8e5244-be10-402a-873d-371680664958","Type":"ContainerDied","Data":"a9ab1d198bc675a680950e55575848c2a942588ffc0024e99a0bc2a28cba4839"} Jun 06 20:49:39.027998 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:39.027984 2561 scope.go:117] "RemoveContainer" containerID="a9ab1d198bc675a680950e55575848c2a942588ffc0024e99a0bc2a28cba4839" Jun 06 20:49:39.337063 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:39.336994 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:49:40.033022 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:40.032989 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" event={"ID":"cc8e5244-be10-402a-873d-371680664958","Type":"ContainerStarted","Data":"2c0ad999fc50fac0f5e14aed5c309a22d352d96eae720fc93e91e9c12949996a"} Jun 06 20:49:40.033428 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:40.033199 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:49:40.034107 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:40.034089 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ccdd48788-gx6dt" Jun 06 20:49:43.050062 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:43.050036 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qf8k2_b68a212d-020d-4c2f-9597-800e58ac80ef/dns-node-resolver/0.log" Jun 06 20:49:43.850059 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:43.850030 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-225jx_4156b345-8f3e-4eed-a385-c1469420457d/node-ca/0.log" Jun 06 20:49:44.850648 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:49:44.850621 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p4n8h_a66425d1-33e6-4fe8-961b-79d20a4c5a36/serve-healthcheck-canary/0.log" Jun 06 20:50:03.023389 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.023357 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pjqd6"] Jun 06 20:50:03.025068 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.025053 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.027920 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.027900 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 06 20:50:03.029246 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.029223 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-28rxg\"" Jun 06 20:50:03.029437 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.029256 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 06 20:50:03.029437 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.029259 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 06 20:50:03.029437 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.029288 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 06 20:50:03.037385 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.037347 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pjqd6"] Jun 06 20:50:03.142930 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.142896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fw6x\" (UniqueName: \"kubernetes.io/projected/896f7aa6-292b-4e51-9f2d-87912760f946-kube-api-access-5fw6x\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.143080 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.142941 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/896f7aa6-292b-4e51-9f2d-87912760f946-data-volume\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.143080 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.142966 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896f7aa6-292b-4e51-9f2d-87912760f946-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.143080 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.143054 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896f7aa6-292b-4e51-9f2d-87912760f946-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.143184 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.143123 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/896f7aa6-292b-4e51-9f2d-87912760f946-crio-socket\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.244280 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.244253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896f7aa6-292b-4e51-9f2d-87912760f946-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.244418 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.244292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/896f7aa6-292b-4e51-9f2d-87912760f946-crio-socket\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.244418 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.244319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fw6x\" (UniqueName: \"kubernetes.io/projected/896f7aa6-292b-4e51-9f2d-87912760f946-kube-api-access-5fw6x\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.244418 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.244350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/896f7aa6-292b-4e51-9f2d-87912760f946-data-volume\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.244418 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.244367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896f7aa6-292b-4e51-9f2d-87912760f946-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.244606 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.244453 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/896f7aa6-292b-4e51-9f2d-87912760f946-crio-socket\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.244780 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.244758 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/896f7aa6-292b-4e51-9f2d-87912760f946-data-volume\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.244923 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.244907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896f7aa6-292b-4e51-9f2d-87912760f946-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.246557 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.246536 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896f7aa6-292b-4e51-9f2d-87912760f946-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.252258 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.252237 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fw6x\" (UniqueName: \"kubernetes.io/projected/896f7aa6-292b-4e51-9f2d-87912760f946-kube-api-access-5fw6x\") pod \"insights-runtime-extractor-pjqd6\" (UID: \"896f7aa6-292b-4e51-9f2d-87912760f946\") " pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.333981 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.333932 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pjqd6" Jun 06 20:50:03.453221 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:03.453189 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pjqd6"] Jun 06 20:50:03.457670 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:50:03.457649 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896f7aa6_292b_4e51_9f2d_87912760f946.slice/crio-6d4e03ee36f0b27706a11b282423385e9492b59b34be74b88240780a508eec61 WatchSource:0}: Error finding container 6d4e03ee36f0b27706a11b282423385e9492b59b34be74b88240780a508eec61: Status 404 returned error can't find the container with id 6d4e03ee36f0b27706a11b282423385e9492b59b34be74b88240780a508eec61 Jun 06 20:50:04.102656 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:04.102633 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pjqd6" event={"ID":"896f7aa6-292b-4e51-9f2d-87912760f946","Type":"ContainerStarted","Data":"318f155df7101ea10d603337911ea8919b417aa2ac82097fdf0828156a8d4d6c"} Jun 06 20:50:04.102956 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:04.102685 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pjqd6" event={"ID":"896f7aa6-292b-4e51-9f2d-87912760f946","Type":"ContainerStarted","Data":"6d4e03ee36f0b27706a11b282423385e9492b59b34be74b88240780a508eec61"} Jun 06 20:50:05.108452 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:05.108406 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pjqd6" event={"ID":"896f7aa6-292b-4e51-9f2d-87912760f946","Type":"ContainerStarted","Data":"ab408894a46b51ec46f475edc04feaaf94df8a13c33ec24e259c8106ed57179d"} Jun 06 20:50:06.115113 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:06.115028 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pjqd6" event={"ID":"896f7aa6-292b-4e51-9f2d-87912760f946","Type":"ContainerStarted","Data":"0fb890af9640024f733f3cdab55153f5ab8aa096e51c297ec98100fbec3ebb83"} Jun 06 20:50:06.132105 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:06.132062 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pjqd6" podStartSLOduration=1.962768984 podStartE2EDuration="4.132047263s" totalImagesPullingTime="2.169278279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:50:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:06.130541614 +0000 UTC m=+221.086082595" watchObservedRunningTime="2026-06-06 20:50:06.132047263 +0000 UTC m=+221.087588243" Jun 06 20:50:10.727815 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.727785 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-698d6897d6-94dpv"] Jun 06 20:50:10.729741 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.729725 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.732514 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.732485 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 06 20:50:10.732514 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.732507 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 06 20:50:10.733553 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.733529 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 06 20:50:10.733695 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.733557 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 06 20:50:10.733870 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.733822 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 06 20:50:10.733950 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.733862 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mlw9n\"" Jun 06 20:50:10.733950 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.733892 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 06 20:50:10.733950 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.733912 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 06 20:50:10.741349 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.741329 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-698d6897d6-94dpv"] Jun 06 20:50:10.797296 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.797270 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/953ced7b-fe2c-4647-9110-e15083ec748b-console-serving-cert\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.797403 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.797302 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-oauth-serving-cert\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.797403 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.797351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/953ced7b-fe2c-4647-9110-e15083ec748b-console-oauth-config\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.797403 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.797375 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-console-config\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.797403 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.797398 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx5hb\" (UniqueName: \"kubernetes.io/projected/953ced7b-fe2c-4647-9110-e15083ec748b-kube-api-access-bx5hb\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.797564 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.797458 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-service-ca\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.898292 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.898264 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-service-ca\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.898433 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.898311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/953ced7b-fe2c-4647-9110-e15083ec748b-console-serving-cert\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.898433 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.898329 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-oauth-serving-cert\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.898433 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.898356 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/953ced7b-fe2c-4647-9110-e15083ec748b-console-oauth-config\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.898433 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.898372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-console-config\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.898433 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.898386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx5hb\" (UniqueName: \"kubernetes.io/projected/953ced7b-fe2c-4647-9110-e15083ec748b-kube-api-access-bx5hb\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.899072 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.899041 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-service-ca\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.899072 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.899052 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-console-config\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.899216 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.899146 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-oauth-serving-cert\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.900736 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.900719 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/953ced7b-fe2c-4647-9110-e15083ec748b-console-serving-cert\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.900801 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.900752 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/953ced7b-fe2c-4647-9110-e15083ec748b-console-oauth-config\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.915920 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.915892 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx5hb\" (UniqueName: \"kubernetes.io/projected/953ced7b-fe2c-4647-9110-e15083ec748b-kube-api-access-bx5hb\") pod \"console-698d6897d6-94dpv\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:10.933253 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.933233 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kp9b7"] Jun 06 20:50:10.935485 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.935471 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:10.938262 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.938239 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 06 20:50:10.938350 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.938272 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xcx7p\"" Jun 06 20:50:10.938432 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.938412 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 06 20:50:10.938495 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.938419 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 06 20:50:10.938495 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.938452 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 06 20:50:10.938712 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.938697 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 06 20:50:10.938786 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.938766 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 06 20:50:10.999077 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.999024 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-wtmp\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:10.999077 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.999054 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-tls\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:10.999206 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.999083 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:10.999206 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.999110 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:10.999270 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.999219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9c08aab4-6d11-465c-b3d7-f13e963723f7-root\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:10.999270 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.999241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2mv6\" (UniqueName: \"kubernetes.io/projected/9c08aab4-6d11-465c-b3d7-f13e963723f7-kube-api-access-p2mv6\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:10.999270 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.999261 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c08aab4-6d11-465c-b3d7-f13e963723f7-metrics-client-ca\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:10.999394 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.999292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-textfile\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:10.999394 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:10.999343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c08aab4-6d11-465c-b3d7-f13e963723f7-sys\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.038196 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.038178 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:11.100573 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.100542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-textfile\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.100711 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.100581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c08aab4-6d11-465c-b3d7-f13e963723f7-sys\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.100711 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.100611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-wtmp\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.100711 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.100636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-tls\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.100711 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.100668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.100711 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.100698 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.101015 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:50:11.100794 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 06 20:50:11.101015 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:50:11.100878 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-tls podName:9c08aab4-6d11-465c-b3d7-f13e963723f7 nodeName:}" failed. No retries permitted until 2026-06-06 20:50:11.600860868 +0000 UTC m=+226.556401827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-tls") pod "node-exporter-kp9b7" (UID: "9c08aab4-6d11-465c-b3d7-f13e963723f7") : secret "node-exporter-tls" not found Jun 06 20:50:11.101015 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.100936 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-textfile\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.101170 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.101062 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9c08aab4-6d11-465c-b3d7-f13e963723f7-root\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.101170 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.101091 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2mv6\" (UniqueName: \"kubernetes.io/projected/9c08aab4-6d11-465c-b3d7-f13e963723f7-kube-api-access-p2mv6\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.101170 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.101118 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c08aab4-6d11-465c-b3d7-f13e963723f7-metrics-client-ca\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.101170 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.101148 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9c08aab4-6d11-465c-b3d7-f13e963723f7-root\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.101405 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.101369 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-wtmp\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.101405 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.100813 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c08aab4-6d11-465c-b3d7-f13e963723f7-sys\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.101649 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.101437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.101649 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.101561 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c08aab4-6d11-465c-b3d7-f13e963723f7-metrics-client-ca\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.103013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.102996 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.108819 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.108799 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2mv6\" (UniqueName: \"kubernetes.io/projected/9c08aab4-6d11-465c-b3d7-f13e963723f7-kube-api-access-p2mv6\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.166848 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.166807 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-698d6897d6-94dpv"] Jun 06 20:50:11.169518 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:50:11.169488 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953ced7b_fe2c_4647_9110_e15083ec748b.slice/crio-f6bbac386986f439b921b0a00f0858816e5a971bb11410738642754260551237 WatchSource:0}: Error finding container f6bbac386986f439b921b0a00f0858816e5a971bb11410738642754260551237: Status 404 returned error can't find the container with id f6bbac386986f439b921b0a00f0858816e5a971bb11410738642754260551237 Jun 06 20:50:11.604787 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.604749 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-tls\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.606890 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.606873 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9c08aab4-6d11-465c-b3d7-f13e963723f7-node-exporter-tls\") pod \"node-exporter-kp9b7\" (UID: \"9c08aab4-6d11-465c-b3d7-f13e963723f7\") " pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.844943 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:11.844914 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kp9b7" Jun 06 20:50:11.856107 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:50:11.856042 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c08aab4_6d11_465c_b3d7_f13e963723f7.slice/crio-35e43ed81bbd1322e0d1a01f6df86bae08925dfbb6244586b1e1aa407b8a0c9b WatchSource:0}: Error finding container 35e43ed81bbd1322e0d1a01f6df86bae08925dfbb6244586b1e1aa407b8a0c9b: Status 404 returned error can't find the container with id 35e43ed81bbd1322e0d1a01f6df86bae08925dfbb6244586b1e1aa407b8a0c9b Jun 06 20:50:12.136940 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:12.136860 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698d6897d6-94dpv" event={"ID":"953ced7b-fe2c-4647-9110-e15083ec748b","Type":"ContainerStarted","Data":"f6bbac386986f439b921b0a00f0858816e5a971bb11410738642754260551237"} Jun 06 20:50:12.138071 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:12.138036 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kp9b7" event={"ID":"9c08aab4-6d11-465c-b3d7-f13e963723f7","Type":"ContainerStarted","Data":"35e43ed81bbd1322e0d1a01f6df86bae08925dfbb6244586b1e1aa407b8a0c9b"} Jun 06 20:50:13.143801 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:13.143722 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c08aab4-6d11-465c-b3d7-f13e963723f7" containerID="3187ac0ba35a53806bb7319b52f518b66979d1fd3168e99ac9c51940bdfdffc7" exitCode=0 Jun 06 20:50:13.143801 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:13.143764 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kp9b7" event={"ID":"9c08aab4-6d11-465c-b3d7-f13e963723f7","Type":"ContainerDied","Data":"3187ac0ba35a53806bb7319b52f518b66979d1fd3168e99ac9c51940bdfdffc7"} Jun 06 20:50:13.889415 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:13.889386 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-67787594d6-8bl9m"] Jun 06 20:50:13.892468 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:13.892446 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:13.895139 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:13.895016 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 06 20:50:13.895139 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:13.895040 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-53elt3k5lh7ta\"" Jun 06 20:50:13.895139 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:13.895085 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 06 20:50:13.895139 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:13.895139 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 06 20:50:13.895422 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:13.895214 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8t9dn\"" Jun 06 20:50:13.896190 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:13.896171 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 06 20:50:13.896278 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:13.896240 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 06 20:50:13.908855 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:13.907199 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67787594d6-8bl9m"] Jun 06 20:50:14.022426 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.022391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e3f7895-7efb-4ff5-9353-80127a176b23-metrics-client-ca\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.022604 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.022441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.022604 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.022463 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.022604 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.022484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-tls\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.022604 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.022540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zkqw\" (UniqueName: \"kubernetes.io/projected/7e3f7895-7efb-4ff5-9353-80127a176b23-kube-api-access-2zkqw\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.022794 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.022615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.022794 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.022636 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.022794 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.022664 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-grpc-tls\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.123366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.123331 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zkqw\" (UniqueName: \"kubernetes.io/projected/7e3f7895-7efb-4ff5-9353-80127a176b23-kube-api-access-2zkqw\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.123528 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.123390 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.123528 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.123411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.123528 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.123446 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-grpc-tls\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.123528 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.123473 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e3f7895-7efb-4ff5-9353-80127a176b23-metrics-client-ca\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.123528 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.123510 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.123772 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.123540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.123772 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.123570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-tls\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.124322 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.124257 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e3f7895-7efb-4ff5-9353-80127a176b23-metrics-client-ca\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.126157 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.126129 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.126258 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.126197 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.126616 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.126593 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-tls\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.126665 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.126647 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.126701 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.126691 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.126776 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.126755 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e3f7895-7efb-4ff5-9353-80127a176b23-secret-grpc-tls\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.131088 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.131064 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zkqw\" (UniqueName: \"kubernetes.io/projected/7e3f7895-7efb-4ff5-9353-80127a176b23-kube-api-access-2zkqw\") pod \"thanos-querier-67787594d6-8bl9m\" (UID: \"7e3f7895-7efb-4ff5-9353-80127a176b23\") " pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.203040 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.203013 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:14.347400 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:14.347331 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67787594d6-8bl9m"] Jun 06 20:50:14.349729 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:50:14.349687 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3f7895_7efb_4ff5_9353_80127a176b23.slice/crio-696d50f22e8776dc29f801e2e86476931620c770b20899f7dcbe25831e25f9b7 WatchSource:0}: Error finding container 696d50f22e8776dc29f801e2e86476931620c770b20899f7dcbe25831e25f9b7: Status 404 returned error can't find the container with id 696d50f22e8776dc29f801e2e86476931620c770b20899f7dcbe25831e25f9b7 Jun 06 20:50:15.151906 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.151872 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" event={"ID":"7e3f7895-7efb-4ff5-9353-80127a176b23","Type":"ContainerStarted","Data":"696d50f22e8776dc29f801e2e86476931620c770b20899f7dcbe25831e25f9b7"} Jun 06 20:50:15.153600 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.153570 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698d6897d6-94dpv" event={"ID":"953ced7b-fe2c-4647-9110-e15083ec748b","Type":"ContainerStarted","Data":"9b5e7b628779a9a3f04bfaf56ff986a58efb4cd3164e6f1dbe6844f774122f58"} Jun 06 20:50:15.155973 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.155946 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kp9b7" event={"ID":"9c08aab4-6d11-465c-b3d7-f13e963723f7","Type":"ContainerStarted","Data":"28218be8d90440ee668b8b116651830251de47ff61a340a3f101d7c0ae5b1e78"} Jun 06 20:50:15.156079 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.155994 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kp9b7" event={"ID":"9c08aab4-6d11-465c-b3d7-f13e963723f7","Type":"ContainerStarted","Data":"7f85543265db387e1afb51d37029fd516c9b736193eeeb10339b1b2764c5b3b2"} Jun 06 20:50:15.170936 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.170883 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-698d6897d6-94dpv" podStartSLOduration=2.179522819 podStartE2EDuration="5.170867458s" totalImagesPullingTime="2.991344639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:15.170131295 +0000 UTC m=+230.125672275" watchObservedRunningTime="2026-06-06 20:50:15.170867458 +0000 UTC m=+230.126408441" Jun 06 20:50:15.188848 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.188780 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kp9b7" podStartSLOduration=4.216995946 podStartE2EDuration="5.188762814s" totalImagesPullingTime="898.903352ms" totalInitContainerRuntime="72.863516ms" isStatefulPod=true podCreationTimestamp="2026-06-06 20:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:15.188077727 +0000 UTC m=+230.143618709" watchObservedRunningTime="2026-06-06 20:50:15.188762814 +0000 UTC m=+230.144303811" Jun 06 20:50:15.681991 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.681946 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2"] Jun 06 20:50:15.683768 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.683753 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" Jun 06 20:50:15.686445 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.686415 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 06 20:50:15.686565 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.686425 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cbr8q\"" Jun 06 20:50:15.691928 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.691907 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2"] Jun 06 20:50:15.697247 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.697225 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-698d6897d6-94dpv"] Jun 06 20:50:15.838300 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.838272 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsqql\" (UniqueName: \"kubernetes.io/projected/39e23856-fc66-4fec-9037-70ee379e0097-kube-api-access-qsqql\") pod \"monitoring-plugin-76b68cc874-9ksx2\" (UID: \"39e23856-fc66-4fec-9037-70ee379e0097\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" Jun 06 20:50:15.838475 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.838306 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39e23856-fc66-4fec-9037-70ee379e0097-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-9ksx2\" (UID: \"39e23856-fc66-4fec-9037-70ee379e0097\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" Jun 06 20:50:15.939098 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.939020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsqql\" (UniqueName: \"kubernetes.io/projected/39e23856-fc66-4fec-9037-70ee379e0097-kube-api-access-qsqql\") pod \"monitoring-plugin-76b68cc874-9ksx2\" (UID: \"39e23856-fc66-4fec-9037-70ee379e0097\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" Jun 06 20:50:15.939098 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.939070 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39e23856-fc66-4fec-9037-70ee379e0097-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-9ksx2\" (UID: \"39e23856-fc66-4fec-9037-70ee379e0097\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" Jun 06 20:50:15.941707 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.941679 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39e23856-fc66-4fec-9037-70ee379e0097-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-9ksx2\" (UID: \"39e23856-fc66-4fec-9037-70ee379e0097\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" Jun 06 20:50:15.947166 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.947140 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsqql\" (UniqueName: \"kubernetes.io/projected/39e23856-fc66-4fec-9037-70ee379e0097-kube-api-access-qsqql\") pod \"monitoring-plugin-76b68cc874-9ksx2\" (UID: \"39e23856-fc66-4fec-9037-70ee379e0097\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" Jun 06 20:50:15.993005 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:15.992969 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" Jun 06 20:50:16.349857 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:16.349820 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2"] Jun 06 20:50:16.351896 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:50:16.351868 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e23856_fc66_4fec_9037_70ee379e0097.slice/crio-5cfe0e4e14d9a54a4b464526d5c8dbd37aaf74876e585de7eb8deac9e70d6703 WatchSource:0}: Error finding container 5cfe0e4e14d9a54a4b464526d5c8dbd37aaf74876e585de7eb8deac9e70d6703: Status 404 returned error can't find the container with id 5cfe0e4e14d9a54a4b464526d5c8dbd37aaf74876e585de7eb8deac9e70d6703 Jun 06 20:50:17.115814 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.115780 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:50:17.118479 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.118457 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.121056 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.121012 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 06 20:50:17.124397 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.124371 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 06 20:50:17.124397 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.124390 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 06 20:50:17.124556 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.124326 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 06 20:50:17.124556 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.124395 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 20:50:17.126151 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.125870 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zcgfv\"" Jun 06 20:50:17.126151 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.125883 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 06 20:50:17.126151 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.125943 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 06 20:50:17.126151 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.125950 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 06 20:50:17.126151 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.126042 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 06 20:50:17.126151 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.126066 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 06 20:50:17.126151 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.126086 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 06 20:50:17.126536 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.126166 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 06 20:50:17.126536 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.126428 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 06 20:50:17.126905 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.126662 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3nlq43fts4cde\"" Jun 06 20:50:17.126973 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.126955 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 06 20:50:17.136598 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.136575 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 06 20:50:17.152966 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.152942 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:50:17.164125 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.164100 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" event={"ID":"39e23856-fc66-4fec-9037-70ee379e0097","Type":"ContainerStarted","Data":"5cfe0e4e14d9a54a4b464526d5c8dbd37aaf74876e585de7eb8deac9e70d6703"} Jun 06 20:50:17.166619 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.166596 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" event={"ID":"7e3f7895-7efb-4ff5-9353-80127a176b23","Type":"ContainerStarted","Data":"dceff4d665be3725aae6f9229bbf84f03238970a611be7324c8de54351aa6cbe"} Jun 06 20:50:17.166713 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.166679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" event={"ID":"7e3f7895-7efb-4ff5-9353-80127a176b23","Type":"ContainerStarted","Data":"d60db6a436623ca0d4101d6e5fd9690d96799328a9d882bd45fb7f8a3315540d"} Jun 06 20:50:17.166776 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.166726 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" event={"ID":"7e3f7895-7efb-4ff5-9353-80127a176b23","Type":"ContainerStarted","Data":"649c152835547f8c3774845238aea2f9c5ee24e848aec2f74344fdc026ff7443"} Jun 06 20:50:17.249143 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249247 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249157 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e44b58a-1751-42f1-b0c1-8783e092ad34-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249247 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249247 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249203 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249439 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249242 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249439 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249365 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249540 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249540 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249468 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249540 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249498 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249687 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249687 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e44b58a-1751-42f1-b0c1-8783e092ad34-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249687 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249687 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249639 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.249687 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249665 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.250206 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.250206 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249713 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngtwt\" (UniqueName: \"kubernetes.io/projected/0e44b58a-1751-42f1-b0c1-8783e092ad34-kube-api-access-ngtwt\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.250206 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249744 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.250206 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.250206 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.249797 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.250545 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.250382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-config\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.350906 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.350881 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351001 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.350939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351001 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.350957 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351001 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.350976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351001 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.350992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351178 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351017 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e44b58a-1751-42f1-b0c1-8783e092ad34-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351178 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351038 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351178 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351178 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351178 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351085 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351178 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngtwt\" (UniqueName: \"kubernetes.io/projected/0e44b58a-1751-42f1-b0c1-8783e092ad34-kube-api-access-ngtwt\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351178 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351133 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351178 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351155 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351178 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351574 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351195 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-config\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351574 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351214 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351574 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351231 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e44b58a-1751-42f1-b0c1-8783e092ad34-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351574 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351247 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351574 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.351574 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.351282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.354412 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.352380 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.354412 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.352388 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.354412 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.353345 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.354412 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.353949 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.354412 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.354407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.354731 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.354636 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.356708 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.356546 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.358438 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.356911 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.358438 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.357331 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.358438 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.357727 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-config\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.358438 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.357864 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.358438 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.358203 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.358438 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.358383 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.358438 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.358400 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e44b58a-1751-42f1-b0c1-8783e092ad34-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.359429 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.359399 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e44b58a-1751-42f1-b0c1-8783e092ad34-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.359534 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.359507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.359914 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.359881 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.360792 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.360769 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.361915 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.361861 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.362009 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.361938 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngtwt\" (UniqueName: \"kubernetes.io/projected/0e44b58a-1751-42f1-b0c1-8783e092ad34-kube-api-access-ngtwt\") pod \"prometheus-k8s-0\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.430526 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.430494 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:17.827415 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:17.827391 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:50:17.829482 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:50:17.829457 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e44b58a_1751_42f1_b0c1_8783e092ad34.slice/crio-6e807e19e58fc7528fb50dd9875b3f3e38914dfb07a66b92ba87b4f201331886 WatchSource:0}: Error finding container 6e807e19e58fc7528fb50dd9875b3f3e38914dfb07a66b92ba87b4f201331886: Status 404 returned error can't find the container with id 6e807e19e58fc7528fb50dd9875b3f3e38914dfb07a66b92ba87b4f201331886 Jun 06 20:50:18.170932 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:18.170896 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" event={"ID":"39e23856-fc66-4fec-9037-70ee379e0097","Type":"ContainerStarted","Data":"4e258d9e77fda1da1641749712b7876b01fabc60bd95cdab81ff2e4a36f78629"} Jun 06 20:50:18.171336 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:18.171030 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" Jun 06 20:50:18.172168 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:18.172141 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerStarted","Data":"6e807e19e58fc7528fb50dd9875b3f3e38914dfb07a66b92ba87b4f201331886"} Jun 06 20:50:18.175221 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:18.175197 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" event={"ID":"7e3f7895-7efb-4ff5-9353-80127a176b23","Type":"ContainerStarted","Data":"5ad0b96145dd8fd120d0a74b3e4e13bc5ad764f8b5bb8783ed2c44744cb1a6f7"} Jun 06 20:50:18.175341 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:18.175246 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" event={"ID":"7e3f7895-7efb-4ff5-9353-80127a176b23","Type":"ContainerStarted","Data":"1d394377c549304d633ef10c8d04e7f2466aae1b9174ef24d18e112fc8890995"} Jun 06 20:50:18.175341 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:18.175281 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" event={"ID":"7e3f7895-7efb-4ff5-9353-80127a176b23","Type":"ContainerStarted","Data":"a042c3773e123d2e2c916c10dd2cc09a10fe5f2dba88282ee693d3b0442c774e"} Jun 06 20:50:18.175444 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:18.175365 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:18.176029 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:18.176012 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" Jun 06 20:50:18.186689 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:18.186647 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-9ksx2" podStartSLOduration=1.7941357 podStartE2EDuration="3.186634333s" totalImagesPullingTime="1.392498633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:18.186255546 +0000 UTC m=+233.141796563" watchObservedRunningTime="2026-06-06 20:50:18.186634333 +0000 UTC m=+233.142175292" Jun 06 20:50:18.208127 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:18.208064 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" podStartSLOduration=2.578434975 podStartE2EDuration="5.208046431s" totalImagesPullingTime="2.629611456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:18.207261012 +0000 UTC m=+233.162801994" watchObservedRunningTime="2026-06-06 20:50:18.208046431 +0000 UTC m=+233.163587414" Jun 06 20:50:19.180091 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:19.180057 2561 generic.go:356] "Generic (PLEG): container finished" podID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerID="fe4334dd78c50560a19b2f3a08132b8697ca6e172ea14b9817bd5b00b75e8d60" exitCode=0 Jun 06 20:50:19.180533 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:19.180146 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerDied","Data":"fe4334dd78c50560a19b2f3a08132b8697ca6e172ea14b9817bd5b00b75e8d60"} Jun 06 20:50:21.038316 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:21.038278 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:23.198489 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:23.198454 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerStarted","Data":"ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc"} Jun 06 20:50:23.198867 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:23.198542 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerStarted","Data":"0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099"} Jun 06 20:50:23.198867 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:23.198567 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerStarted","Data":"2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f"} Jun 06 20:50:23.198867 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:23.198592 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerStarted","Data":"d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576"} Jun 06 20:50:23.198867 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:23.198616 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerStarted","Data":"2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1"} Jun 06 20:50:23.198867 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:23.198638 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerStarted","Data":"aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3"} Jun 06 20:50:23.228652 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:23.228594 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.299479082 podStartE2EDuration="6.228576847s" totalImagesPullingTime="3.908828588s" totalInitContainerRuntime="20.269177ms" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:23.227282643 +0000 UTC m=+238.182823649" watchObservedRunningTime="2026-06-06 20:50:23.228576847 +0000 UTC m=+238.184117829" Jun 06 20:50:24.185887 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:24.185856 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-67787594d6-8bl9m" Jun 06 20:50:27.430809 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:27.430778 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:50:29.371593 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:29.371551 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" podUID="71f53229-c465-48aa-9eed-979ea035b041" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 06 20:50:37.304447 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:37.304407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:50:37.306668 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:37.306640 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a38f8798-b100-40c5-be25-f6828d3db580-metrics-certs\") pod \"network-metrics-daemon-xtdmx\" (UID: \"a38f8798-b100-40c5-be25-f6828d3db580\") " pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:50:37.435064 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:37.435032 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9xvqt\"" Jun 06 20:50:37.443274 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:37.443255 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xtdmx" Jun 06 20:50:37.568542 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:37.568473 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xtdmx"] Jun 06 20:50:37.571350 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:50:37.571322 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38f8798_b100_40c5_be25_f6828d3db580.slice/crio-1e2413081e7268d0fe15c8d198377c3abd70beb05d47fdfbb3646dd9e0830722 WatchSource:0}: Error finding container 1e2413081e7268d0fe15c8d198377c3abd70beb05d47fdfbb3646dd9e0830722: Status 404 returned error can't find the container with id 1e2413081e7268d0fe15c8d198377c3abd70beb05d47fdfbb3646dd9e0830722 Jun 06 20:50:38.255439 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:38.255398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xtdmx" event={"ID":"a38f8798-b100-40c5-be25-f6828d3db580","Type":"ContainerStarted","Data":"1e2413081e7268d0fe15c8d198377c3abd70beb05d47fdfbb3646dd9e0830722"} Jun 06 20:50:39.261316 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:39.261285 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xtdmx" event={"ID":"a38f8798-b100-40c5-be25-f6828d3db580","Type":"ContainerStarted","Data":"765ff60120097e306dc80f3a75e17d1aede24735637f0c712b36bbb432fce10d"} Jun 06 20:50:39.261726 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:39.261338 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xtdmx" event={"ID":"a38f8798-b100-40c5-be25-f6828d3db580","Type":"ContainerStarted","Data":"f5b1db2e54ac7cf19e7b3c587f686470389bce2fe85749dc641c7d46875051cd"} Jun 06 20:50:39.278409 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:39.278357 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xtdmx" podStartSLOduration=253.438516157 podStartE2EDuration="4m14.278343351s" totalImagesPullingTime="839.827194ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:39.277329723 +0000 UTC m=+254.232870705" watchObservedRunningTime="2026-06-06 20:50:39.278343351 +0000 UTC m=+254.233884346" Jun 06 20:50:39.370908 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:39.370877 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" podUID="71f53229-c465-48aa-9eed-979ea035b041" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 06 20:50:42.195001 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:42.194961 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-698d6897d6-94dpv" podUID="953ced7b-fe2c-4647-9110-e15083ec748b" containerName="console" containerID="cri-o://9b5e7b628779a9a3f04bfaf56ff986a58efb4cd3164e6f1dbe6844f774122f58" gracePeriod=15 Jun 06 20:50:49.371213 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:49.371119 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" podUID="71f53229-c465-48aa-9eed-979ea035b041" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 06 20:50:49.371213 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:49.371210 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" Jun 06 20:50:49.371807 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:49.371772 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"249a5247f63bfad3450610f09442d6ee86a639d32d6e38c800b45c781049d9ef"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 06 20:50:49.371916 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:49.371857 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" podUID="71f53229-c465-48aa-9eed-979ea035b041" containerName="service-proxy" containerID="cri-o://249a5247f63bfad3450610f09442d6ee86a639d32d6e38c800b45c781049d9ef" gracePeriod=30 Jun 06 20:50:50.306544 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:50.306511 2561 generic.go:356] "Generic (PLEG): container finished" podID="71f53229-c465-48aa-9eed-979ea035b041" containerID="249a5247f63bfad3450610f09442d6ee86a639d32d6e38c800b45c781049d9ef" exitCode=2 Jun 06 20:50:50.306710 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:50.306575 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" event={"ID":"71f53229-c465-48aa-9eed-979ea035b041","Type":"ContainerDied","Data":"249a5247f63bfad3450610f09442d6ee86a639d32d6e38c800b45c781049d9ef"} Jun 06 20:50:50.306710 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:50.306612 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74cd9ffc56-bf6st" event={"ID":"71f53229-c465-48aa-9eed-979ea035b041","Type":"ContainerStarted","Data":"aee8f2661c147f99296bf9a4273d112f3931fffd72e63017920b4d3300ebaa28"} Jun 06 20:50:57.335812 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.335789 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-698d6897d6-94dpv_953ced7b-fe2c-4647-9110-e15083ec748b/console/0.log" Jun 06 20:50:57.336134 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.335825 2561 generic.go:356] "Generic (PLEG): container finished" podID="953ced7b-fe2c-4647-9110-e15083ec748b" containerID="9b5e7b628779a9a3f04bfaf56ff986a58efb4cd3164e6f1dbe6844f774122f58" exitCode=137 Jun 06 20:50:57.336134 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.335863 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698d6897d6-94dpv" event={"ID":"953ced7b-fe2c-4647-9110-e15083ec748b","Type":"ContainerDied","Data":"9b5e7b628779a9a3f04bfaf56ff986a58efb4cd3164e6f1dbe6844f774122f58"} Jun 06 20:50:57.357156 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.357139 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-698d6897d6-94dpv_953ced7b-fe2c-4647-9110-e15083ec748b/console/0.log" Jun 06 20:50:57.358861 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.358846 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:57.446399 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.446157 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/953ced7b-fe2c-4647-9110-e15083ec748b-console-oauth-config\") pod \"953ced7b-fe2c-4647-9110-e15083ec748b\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " Jun 06 20:50:57.446399 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.446253 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-oauth-serving-cert\") pod \"953ced7b-fe2c-4647-9110-e15083ec748b\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " Jun 06 20:50:57.446399 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.446284 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/953ced7b-fe2c-4647-9110-e15083ec748b-console-serving-cert\") pod \"953ced7b-fe2c-4647-9110-e15083ec748b\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " Jun 06 20:50:57.446399 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.446309 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-console-config\") pod \"953ced7b-fe2c-4647-9110-e15083ec748b\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " Jun 06 20:50:57.446721 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.446421 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-service-ca\") pod \"953ced7b-fe2c-4647-9110-e15083ec748b\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " Jun 06 20:50:57.446721 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.446479 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx5hb\" (UniqueName: \"kubernetes.io/projected/953ced7b-fe2c-4647-9110-e15083ec748b-kube-api-access-bx5hb\") pod \"953ced7b-fe2c-4647-9110-e15083ec748b\" (UID: \"953ced7b-fe2c-4647-9110-e15083ec748b\") " Jun 06 20:50:57.446721 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.446711 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "953ced7b-fe2c-4647-9110-e15083ec748b" (UID: "953ced7b-fe2c-4647-9110-e15083ec748b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:50:57.446882 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.446752 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-service-ca" (OuterVolumeSpecName: "service-ca") pod "953ced7b-fe2c-4647-9110-e15083ec748b" (UID: "953ced7b-fe2c-4647-9110-e15083ec748b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:50:57.446975 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.446951 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-oauth-serving-cert\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:50:57.447099 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.446982 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-service-ca\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:50:57.447315 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.446952 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-console-config" (OuterVolumeSpecName: "console-config") pod "953ced7b-fe2c-4647-9110-e15083ec748b" (UID: "953ced7b-fe2c-4647-9110-e15083ec748b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:50:57.448683 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.448627 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/953ced7b-fe2c-4647-9110-e15083ec748b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "953ced7b-fe2c-4647-9110-e15083ec748b" (UID: "953ced7b-fe2c-4647-9110-e15083ec748b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:50:57.448683 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.448658 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/953ced7b-fe2c-4647-9110-e15083ec748b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "953ced7b-fe2c-4647-9110-e15083ec748b" (UID: "953ced7b-fe2c-4647-9110-e15083ec748b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:50:57.448878 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.448811 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953ced7b-fe2c-4647-9110-e15083ec748b-kube-api-access-bx5hb" (OuterVolumeSpecName: "kube-api-access-bx5hb") pod "953ced7b-fe2c-4647-9110-e15083ec748b" (UID: "953ced7b-fe2c-4647-9110-e15083ec748b"). InnerVolumeSpecName "kube-api-access-bx5hb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:50:57.547630 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.547607 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/953ced7b-fe2c-4647-9110-e15083ec748b-console-serving-cert\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:50:57.547630 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.547630 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/953ced7b-fe2c-4647-9110-e15083ec748b-console-config\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:50:57.547779 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.547640 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx5hb\" (UniqueName: \"kubernetes.io/projected/953ced7b-fe2c-4647-9110-e15083ec748b-kube-api-access-bx5hb\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:50:57.547779 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:57.547649 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/953ced7b-fe2c-4647-9110-e15083ec748b-console-oauth-config\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:50:58.340763 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:58.340732 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-698d6897d6-94dpv_953ced7b-fe2c-4647-9110-e15083ec748b/console/0.log" Jun 06 20:50:58.341270 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:58.340819 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-698d6897d6-94dpv" event={"ID":"953ced7b-fe2c-4647-9110-e15083ec748b","Type":"ContainerDied","Data":"f6bbac386986f439b921b0a00f0858816e5a971bb11410738642754260551237"} Jun 06 20:50:58.341270 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:58.340857 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-698d6897d6-94dpv" Jun 06 20:50:58.341270 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:58.340961 2561 scope.go:117] "RemoveContainer" containerID="9b5e7b628779a9a3f04bfaf56ff986a58efb4cd3164e6f1dbe6844f774122f58" Jun 06 20:50:58.362603 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:58.362580 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-698d6897d6-94dpv"] Jun 06 20:50:58.366087 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:58.366064 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-698d6897d6-94dpv"] Jun 06 20:50:59.436442 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:50:59.436409 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="953ced7b-fe2c-4647-9110-e15083ec748b" path="/var/lib/kubelet/pods/953ced7b-fe2c-4647-9110-e15083ec748b/volumes" Jun 06 20:51:06.935456 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:51:06.935418 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vsg97" podUID="a6dbc555-220e-4e15-aeb3-ed473af4bb35" Jun 06 20:51:07.375309 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:07.375231 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vsg97" Jun 06 20:51:09.835742 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:09.835707 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:51:09.837999 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:09.837983 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6dbc555-220e-4e15-aeb3-ed473af4bb35-metrics-tls\") pod \"dns-default-vsg97\" (UID: \"a6dbc555-220e-4e15-aeb3-ed473af4bb35\") " pod="openshift-dns/dns-default-vsg97" Jun 06 20:51:10.078793 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:10.078763 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9qr76\"" Jun 06 20:51:10.086997 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:10.086947 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vsg97" Jun 06 20:51:10.213144 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:10.213091 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vsg97"] Jun 06 20:51:10.215942 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:51:10.215910 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6dbc555_220e_4e15_aeb3_ed473af4bb35.slice/crio-5b54d52e11b813ea5542d16585779ed5fa70a490797f80e4fbc8c79b734409ca WatchSource:0}: Error finding container 5b54d52e11b813ea5542d16585779ed5fa70a490797f80e4fbc8c79b734409ca: Status 404 returned error can't find the container with id 5b54d52e11b813ea5542d16585779ed5fa70a490797f80e4fbc8c79b734409ca Jun 06 20:51:10.385440 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:10.385363 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vsg97" event={"ID":"a6dbc555-220e-4e15-aeb3-ed473af4bb35","Type":"ContainerStarted","Data":"5b54d52e11b813ea5542d16585779ed5fa70a490797f80e4fbc8c79b734409ca"} Jun 06 20:51:10.650722 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:10.650645 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-9ksx2_39e23856-fc66-4fec-9037-70ee379e0097/monitoring-plugin/0.log" Jun 06 20:51:12.051579 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:12.051552 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kp9b7_9c08aab4-6d11-465c-b3d7-f13e963723f7/init-textfile/0.log" Jun 06 20:51:12.251545 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:12.251521 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kp9b7_9c08aab4-6d11-465c-b3d7-f13e963723f7/node-exporter/0.log" Jun 06 20:51:12.394940 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:12.394861 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vsg97" event={"ID":"a6dbc555-220e-4e15-aeb3-ed473af4bb35","Type":"ContainerStarted","Data":"cd4de3629b86e888422d982daea9abdf0521b2616ece48ace457848f98aab708"} Jun 06 20:51:12.394940 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:12.394922 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vsg97" event={"ID":"a6dbc555-220e-4e15-aeb3-ed473af4bb35","Type":"ContainerStarted","Data":"ac5f033d1fb1286f3f5dec0678fe4717fbb03ac1b8d04642efb33596d5ebd9c4"} Jun 06 20:51:12.395142 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:12.394955 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vsg97" Jun 06 20:51:12.412011 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:12.411964 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vsg97" podStartSLOduration=252.047477515 podStartE2EDuration="4m13.411946027s" totalImagesPullingTime="1.364468512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:51:12.411621905 +0000 UTC m=+287.367162924" watchObservedRunningTime="2026-06-06 20:51:12.411946027 +0000 UTC m=+287.367487019" Jun 06 20:51:12.451321 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:12.451295 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kp9b7_9c08aab4-6d11-465c-b3d7-f13e963723f7/kube-rbac-proxy/0.log" Jun 06 20:51:13.251360 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:13.251329 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e44b58a-1751-42f1-b0c1-8783e092ad34/init-config-reloader/0.log" Jun 06 20:51:13.451818 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:13.451790 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e44b58a-1751-42f1-b0c1-8783e092ad34/prometheus/0.log" Jun 06 20:51:13.651421 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:13.651354 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e44b58a-1751-42f1-b0c1-8783e092ad34/config-reloader/0.log" Jun 06 20:51:13.851135 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:13.851109 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e44b58a-1751-42f1-b0c1-8783e092ad34/thanos-sidecar/0.log" Jun 06 20:51:14.050899 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:14.050874 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e44b58a-1751-42f1-b0c1-8783e092ad34/kube-rbac-proxy-web/0.log" Jun 06 20:51:14.251001 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:14.250970 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e44b58a-1751-42f1-b0c1-8783e092ad34/kube-rbac-proxy/0.log" Jun 06 20:51:14.451822 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:14.451796 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e44b58a-1751-42f1-b0c1-8783e092ad34/kube-rbac-proxy-thanos/0.log" Jun 06 20:51:15.851439 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:15.851412 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67787594d6-8bl9m_7e3f7895-7efb-4ff5-9353-80127a176b23/thanos-query/0.log" Jun 06 20:51:16.050502 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:16.050468 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67787594d6-8bl9m_7e3f7895-7efb-4ff5-9353-80127a176b23/kube-rbac-proxy-web/0.log" Jun 06 20:51:16.250331 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:16.250297 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67787594d6-8bl9m_7e3f7895-7efb-4ff5-9353-80127a176b23/kube-rbac-proxy/0.log" Jun 06 20:51:16.450085 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:16.450059 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67787594d6-8bl9m_7e3f7895-7efb-4ff5-9353-80127a176b23/prom-label-proxy/0.log" Jun 06 20:51:16.650680 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:16.650609 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67787594d6-8bl9m_7e3f7895-7efb-4ff5-9353-80127a176b23/kube-rbac-proxy-rules/0.log" Jun 06 20:51:16.850724 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:16.850696 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67787594d6-8bl9m_7e3f7895-7efb-4ff5-9353-80127a176b23/kube-rbac-proxy-metrics/0.log" Jun 06 20:51:17.431340 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:17.431309 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:17.450940 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:17.450918 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:18.431975 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:18.431943 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:19.250510 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:19.250477 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vsg97_a6dbc555-220e-4e15-aeb3-ed473af4bb35/dns/0.log" Jun 06 20:51:19.451092 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:19.451064 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vsg97_a6dbc555-220e-4e15-aeb3-ed473af4bb35/kube-rbac-proxy/0.log" Jun 06 20:51:19.850615 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:19.850590 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qf8k2_b68a212d-020d-4c2f-9597-800e58ac80ef/dns-node-resolver/0.log" Jun 06 20:51:20.651007 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:20.650977 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-225jx_4156b345-8f3e-4eed-a385-c1469420457d/node-ca/0.log" Jun 06 20:51:21.649976 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:21.649948 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p4n8h_a66425d1-33e6-4fe8-961b-79d20a4c5a36/serve-healthcheck-canary/0.log" Jun 06 20:51:22.402147 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:22.402122 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vsg97" Jun 06 20:51:25.386699 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:25.386676 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 06 20:51:35.429112 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:35.429072 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:51:35.432464 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:35.429468 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="prometheus" containerID="cri-o://aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3" gracePeriod=600 Jun 06 20:51:35.432464 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:35.429525 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc" gracePeriod=600 Jun 06 20:51:35.432464 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:35.429580 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="config-reloader" containerID="cri-o://2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1" gracePeriod=600 Jun 06 20:51:35.432464 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:35.429578 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="kube-rbac-proxy" containerID="cri-o://0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099" gracePeriod=600 Jun 06 20:51:35.432464 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:35.429619 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="thanos-sidecar" containerID="cri-o://d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576" gracePeriod=600 Jun 06 20:51:35.432464 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:35.429535 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="kube-rbac-proxy-web" containerID="cri-o://2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f" gracePeriod=600 Jun 06 20:51:36.494085 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.494058 2561 generic.go:356] "Generic (PLEG): container finished" podID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerID="ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc" exitCode=0 Jun 06 20:51:36.494085 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.494082 2561 generic.go:356] "Generic (PLEG): container finished" podID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerID="0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099" exitCode=0 Jun 06 20:51:36.494085 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.494088 2561 generic.go:356] "Generic (PLEG): container finished" podID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerID="d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576" exitCode=0 Jun 06 20:51:36.494423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.494094 2561 generic.go:356] "Generic (PLEG): container finished" podID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerID="2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1" exitCode=0 Jun 06 20:51:36.494423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.494099 2561 generic.go:356] "Generic (PLEG): container finished" podID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerID="aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3" exitCode=0 Jun 06 20:51:36.494423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.494126 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerDied","Data":"ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc"} Jun 06 20:51:36.494423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.494180 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerDied","Data":"0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099"} Jun 06 20:51:36.494423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.494208 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerDied","Data":"d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576"} Jun 06 20:51:36.494423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.494234 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerDied","Data":"2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1"} Jun 06 20:51:36.494423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.494256 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerDied","Data":"aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3"} Jun 06 20:51:36.682547 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.682522 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:36.842412 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842332 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842412 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842376 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-0\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842412 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842394 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-2\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842412 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842411 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-1\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842717 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842428 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-kube-rbac-proxy\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842717 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842447 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-metrics-client-certs\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842717 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842465 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-metrics-client-ca\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842717 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842502 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-web-config\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842717 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842527 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngtwt\" (UniqueName: \"kubernetes.io/projected/0e44b58a-1751-42f1-b0c1-8783e092ad34-kube-api-access-ngtwt\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842717 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842555 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842717 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842590 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-kubelet-serving-ca-bundle\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842717 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842625 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-db\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842717 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842649 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-serving-certs-ca-bundle\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.842717 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842677 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e44b58a-1751-42f1-b0c1-8783e092ad34-config-out\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.843234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842725 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-trusted-ca-bundle\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.843234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842754 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-grpc-tls\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.843234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842797 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e44b58a-1751-42f1-b0c1-8783e092ad34-tls-assets\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.843234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842800 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:36.843234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842854 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-tls\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.843234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842879 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-config\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.843234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842892 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:36.843234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842909 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-thanos-prometheus-http-client-file\") pod \"0e44b58a-1751-42f1-b0c1-8783e092ad34\" (UID: \"0e44b58a-1751-42f1-b0c1-8783e092ad34\") " Jun 06 20:51:36.843234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.842934 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:36.843234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.843114 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.843234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.843132 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.843234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.843148 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-metrics-client-ca\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.844067 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.844037 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:36.844421 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.844392 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:36.844674 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.844647 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:36.844947 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.844921 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:51:36.845109 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.845062 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:51:36.845623 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.845589 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:36.845789 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.845762 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:36.845952 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.845914 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e44b58a-1751-42f1-b0c1-8783e092ad34-kube-api-access-ngtwt" (OuterVolumeSpecName: "kube-api-access-ngtwt") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "kube-api-access-ngtwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:51:36.846459 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.846422 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:36.846940 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.846912 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:36.847338 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.847316 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e44b58a-1751-42f1-b0c1-8783e092ad34-config-out" (OuterVolumeSpecName: "config-out") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:51:36.847338 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.847324 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:36.847548 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.847530 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:36.847826 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.847800 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e44b58a-1751-42f1-b0c1-8783e092ad34-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:51:36.848455 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.848439 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-config" (OuterVolumeSpecName: "config") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:36.848659 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.848639 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:36.856557 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.856537 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-web-config" (OuterVolumeSpecName: "web-config") pod "0e44b58a-1751-42f1-b0c1-8783e092ad34" (UID: "0e44b58a-1751-42f1-b0c1-8783e092ad34"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:51:36.943662 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943637 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-db\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943662 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943660 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943670 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e44b58a-1751-42f1-b0c1-8783e092ad34-config-out\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943679 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943687 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-grpc-tls\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943696 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e44b58a-1751-42f1-b0c1-8783e092ad34-tls-assets\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943704 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943711 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-config\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943719 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943728 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943736 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943745 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-kube-rbac-proxy\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943753 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-metrics-client-certs\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943760 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-web-config\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.943767 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943768 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngtwt\" (UniqueName: \"kubernetes.io/projected/0e44b58a-1751-42f1-b0c1-8783e092ad34-kube-api-access-ngtwt\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.944199 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943778 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e44b58a-1751-42f1-b0c1-8783e092ad34-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:36.944199 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:36.943786 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e44b58a-1751-42f1-b0c1-8783e092ad34-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:51:37.499969 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.499943 2561 generic.go:356] "Generic (PLEG): container finished" podID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerID="2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f" exitCode=0 Jun 06 20:51:37.500248 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.499977 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerDied","Data":"2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f"} Jun 06 20:51:37.500248 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.500009 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.500248 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.500029 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e44b58a-1751-42f1-b0c1-8783e092ad34","Type":"ContainerDied","Data":"6e807e19e58fc7528fb50dd9875b3f3e38914dfb07a66b92ba87b4f201331886"} Jun 06 20:51:37.500248 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.500061 2561 scope.go:117] "RemoveContainer" containerID="ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc" Jun 06 20:51:37.509099 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.509076 2561 scope.go:117] "RemoveContainer" containerID="0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099" Jun 06 20:51:37.516514 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.516491 2561 scope.go:117] "RemoveContainer" containerID="2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f" Jun 06 20:51:37.522696 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.522676 2561 scope.go:117] "RemoveContainer" containerID="d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576" Jun 06 20:51:37.528109 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.528089 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:51:37.529641 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.529602 2561 scope.go:117] "RemoveContainer" containerID="2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1" Jun 06 20:51:37.532027 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.532010 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:51:37.536386 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.536369 2561 scope.go:117] "RemoveContainer" containerID="aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3" Jun 06 20:51:37.542973 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.542956 2561 scope.go:117] "RemoveContainer" containerID="fe4334dd78c50560a19b2f3a08132b8697ca6e172ea14b9817bd5b00b75e8d60" Jun 06 20:51:37.549450 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.549282 2561 scope.go:117] "RemoveContainer" containerID="ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc" Jun 06 20:51:37.549542 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:51:37.549523 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc\": container with ID starting with ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc not found: ID does not exist" containerID="ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc" Jun 06 20:51:37.549587 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.549554 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc"} err="failed to get container status \"ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc\": rpc error: code = NotFound desc = could not find container \"ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc\": container with ID starting with ca089e79f323413d899430014ed9eac5299e4b21fdb69a15013b4db1abb435dc not found: ID does not exist" Jun 06 20:51:37.549587 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.549571 2561 scope.go:117] "RemoveContainer" containerID="0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099" Jun 06 20:51:37.549817 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:51:37.549796 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099\": container with ID starting with 0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099 not found: ID does not exist" containerID="0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099" Jun 06 20:51:37.549910 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.549825 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099"} err="failed to get container status \"0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099\": rpc error: code = NotFound desc = could not find container \"0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099\": container with ID starting with 0d65cef8be34c68319f6e65d445b0c3ec9ded244d78327c283ffb03c939e5099 not found: ID does not exist" Jun 06 20:51:37.549910 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.549863 2561 scope.go:117] "RemoveContainer" containerID="2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f" Jun 06 20:51:37.550101 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:51:37.550084 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f\": container with ID starting with 2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f not found: ID does not exist" containerID="2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f" Jun 06 20:51:37.550162 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.550107 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f"} err="failed to get container status \"2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f\": rpc error: code = NotFound desc = could not find container \"2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f\": container with ID starting with 2e2a34f2d744b1666dd02b186de17c477d2683a21ccbd90bba59d93afb027a9f not found: ID does not exist" Jun 06 20:51:37.550162 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.550126 2561 scope.go:117] "RemoveContainer" containerID="d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576" Jun 06 20:51:37.550340 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:51:37.550324 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576\": container with ID starting with d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576 not found: ID does not exist" containerID="d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576" Jun 06 20:51:37.550399 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.550345 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576"} err="failed to get container status \"d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576\": rpc error: code = NotFound desc = could not find container \"d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576\": container with ID starting with d18e9a215c36c6902da530bf3b0e6fe010624e9f167557ba961c900ff403c576 not found: ID does not exist" Jun 06 20:51:37.550399 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.550362 2561 scope.go:117] "RemoveContainer" containerID="2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1" Jun 06 20:51:37.550565 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:51:37.550550 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1\": container with ID starting with 2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1 not found: ID does not exist" containerID="2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1" Jun 06 20:51:37.550624 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.550570 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1"} err="failed to get container status \"2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1\": rpc error: code = NotFound desc = could not find container \"2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1\": container with ID starting with 2c238808948054dc80ece397fc563e6c9206d0cd9dba563a4a8643eb2e101fc1 not found: ID does not exist" Jun 06 20:51:37.550624 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.550588 2561 scope.go:117] "RemoveContainer" containerID="aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3" Jun 06 20:51:37.550788 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:51:37.550772 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3\": container with ID starting with aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3 not found: ID does not exist" containerID="aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3" Jun 06 20:51:37.550869 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.550793 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3"} err="failed to get container status \"aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3\": rpc error: code = NotFound desc = could not find container \"aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3\": container with ID starting with aedd44c263e60e5ac79fa602720bd57c3f745a8db940182a04ba58f15155ebc3 not found: ID does not exist" Jun 06 20:51:37.550869 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.550810 2561 scope.go:117] "RemoveContainer" containerID="fe4334dd78c50560a19b2f3a08132b8697ca6e172ea14b9817bd5b00b75e8d60" Jun 06 20:51:37.551057 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:51:37.551041 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe4334dd78c50560a19b2f3a08132b8697ca6e172ea14b9817bd5b00b75e8d60\": container with ID starting with fe4334dd78c50560a19b2f3a08132b8697ca6e172ea14b9817bd5b00b75e8d60 not found: ID does not exist" containerID="fe4334dd78c50560a19b2f3a08132b8697ca6e172ea14b9817bd5b00b75e8d60" Jun 06 20:51:37.551092 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.551061 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe4334dd78c50560a19b2f3a08132b8697ca6e172ea14b9817bd5b00b75e8d60"} err="failed to get container status \"fe4334dd78c50560a19b2f3a08132b8697ca6e172ea14b9817bd5b00b75e8d60\": rpc error: code = NotFound desc = could not find container \"fe4334dd78c50560a19b2f3a08132b8697ca6e172ea14b9817bd5b00b75e8d60\": container with ID starting with fe4334dd78c50560a19b2f3a08132b8697ca6e172ea14b9817bd5b00b75e8d60 not found: ID does not exist" Jun 06 20:51:37.556065 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556047 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:51:37.556300 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556287 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953ced7b-fe2c-4647-9110-e15083ec748b" containerName="console" Jun 06 20:51:37.556340 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556302 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="953ced7b-fe2c-4647-9110-e15083ec748b" containerName="console" Jun 06 20:51:37.556340 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556316 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="prometheus" Jun 06 20:51:37.556340 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556322 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="prometheus" Jun 06 20:51:37.556340 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556328 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="kube-rbac-proxy-web" Jun 06 20:51:37.556340 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556334 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="kube-rbac-proxy-web" Jun 06 20:51:37.556340 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556341 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="thanos-sidecar" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556346 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="thanos-sidecar" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556351 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="config-reloader" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556357 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="config-reloader" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556366 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="kube-rbac-proxy" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556371 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="kube-rbac-proxy" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556378 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="init-config-reloader" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556383 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="init-config-reloader" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556388 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="kube-rbac-proxy-thanos" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556393 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="kube-rbac-proxy-thanos" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556434 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="config-reloader" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556440 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="thanos-sidecar" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556448 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="kube-rbac-proxy" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556453 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="kube-rbac-proxy-thanos" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556460 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="kube-rbac-proxy-web" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556466 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="953ced7b-fe2c-4647-9110-e15083ec748b" containerName="console" Jun 06 20:51:37.556508 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.556470 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" containerName="prometheus" Jun 06 20:51:37.561582 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.561567 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.564314 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.564296 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 06 20:51:37.564389 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.564304 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 06 20:51:37.564389 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.564319 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 06 20:51:37.564596 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.564580 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 06 20:51:37.564659 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.564600 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 06 20:51:37.564659 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.564640 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 06 20:51:37.564946 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.564926 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 20:51:37.565033 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.564926 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 06 20:51:37.565128 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.565113 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 06 20:51:37.565391 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.565359 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 06 20:51:37.565391 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.565375 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 06 20:51:37.565391 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.565379 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zcgfv\"" Jun 06 20:51:37.565565 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.565401 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 06 20:51:37.565565 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.565423 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 06 20:51:37.565565 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.565367 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3nlq43fts4cde\"" Jun 06 20:51:37.567875 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.567713 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 06 20:51:37.570172 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.570154 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 06 20:51:37.574329 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.574303 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:51:37.649521 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649613 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649524 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649613 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649613 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649613 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649765 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649765 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649765 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649765 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649705 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649765 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2bgs\" (UniqueName: \"kubernetes.io/projected/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-kube-api-access-j2bgs\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649765 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649749 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649976 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649976 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649786 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649976 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-config\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649976 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649976 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649976 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649906 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649976 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649921 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649976 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649941 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.649976 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.649957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.750819 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.750752 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.750819 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.750794 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.750819 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.750817 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751033 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.750848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751033 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751011 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751135 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751135 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751081 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751135 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751116 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751296 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751296 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2bgs\" (UniqueName: \"kubernetes.io/projected/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-kube-api-access-j2bgs\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751296 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751296 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751229 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751296 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751296 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-config\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751576 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751576 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751576 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751576 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751576 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751409 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751576 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751576 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751456 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.751944 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.752004 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.751959 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.753587 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.752498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.753587 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.753093 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.753587 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.753177 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.753926 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.753893 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.754039 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.753907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.754278 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.754254 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.754486 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.754454 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.755301 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.755242 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.755478 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.755455 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.755782 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.755740 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.757090 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.757059 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.757166 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.757061 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-config\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.757166 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.757103 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.757166 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.757114 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.757269 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.757247 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.757303 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.757281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.761302 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.761280 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2bgs\" (UniqueName: \"kubernetes.io/projected/6a5037e7-e1e0-44d0-b5b9-348f14bf09a1-kube-api-access-j2bgs\") pod \"prometheus-k8s-0\" (UID: \"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:37.870469 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:37.870440 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:51:38.003487 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:38.003464 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:51:38.005083 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:51:38.005056 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5037e7_e1e0_44d0_b5b9_348f14bf09a1.slice/crio-35ff1fec3d26e2627b4079c52ce740b00ea00d450fe342bbba0f1d9a32148b1c WatchSource:0}: Error finding container 35ff1fec3d26e2627b4079c52ce740b00ea00d450fe342bbba0f1d9a32148b1c: Status 404 returned error can't find the container with id 35ff1fec3d26e2627b4079c52ce740b00ea00d450fe342bbba0f1d9a32148b1c Jun 06 20:51:38.505827 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:38.505792 2561 generic.go:356] "Generic (PLEG): container finished" podID="6a5037e7-e1e0-44d0-b5b9-348f14bf09a1" containerID="c4c789a7d6c3f0f9664d242a93fb4d490040819f82e7e44ff41565ac304c9c0f" exitCode=0 Jun 06 20:51:38.506172 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:38.505868 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1","Type":"ContainerDied","Data":"c4c789a7d6c3f0f9664d242a93fb4d490040819f82e7e44ff41565ac304c9c0f"} Jun 06 20:51:38.506172 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:38.505929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1","Type":"ContainerStarted","Data":"35ff1fec3d26e2627b4079c52ce740b00ea00d450fe342bbba0f1d9a32148b1c"} Jun 06 20:51:39.437329 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:39.437295 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e44b58a-1751-42f1-b0c1-8783e092ad34" path="/var/lib/kubelet/pods/0e44b58a-1751-42f1-b0c1-8783e092ad34/volumes" Jun 06 20:51:39.512391 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:39.512361 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1","Type":"ContainerStarted","Data":"d66d4ac38f3e0cf9dda4fd1d49bc37de3266592d200b7f152b82c0049db12d1c"} Jun 06 20:51:39.512803 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:39.512418 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1","Type":"ContainerStarted","Data":"7c6929c02a09c6444d38e8900ac44746b5648dc94a71041c2fcafa181d6f2620"} Jun 06 20:51:39.512803 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:39.512443 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1","Type":"ContainerStarted","Data":"f36eedaded0b42eac4f9200e37ac302863bd3bf4f42446e8c5ffa48e81f51117"} Jun 06 20:51:39.512803 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:39.512467 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1","Type":"ContainerStarted","Data":"1cb509262767df30247729574f7301aeed9721143bb585ae9ab44b46fe85034a"} Jun 06 20:51:39.512803 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:39.512490 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1","Type":"ContainerStarted","Data":"824b94b8f21f8c366bce2000feb2aabd67b6f89f2f072f93f56e9d8054a2dd6c"} Jun 06 20:51:39.512803 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:39.512511 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a5037e7-e1e0-44d0-b5b9-348f14bf09a1","Type":"ContainerStarted","Data":"3b7d1dfd8e2a009f6798075cf988a30745bdadf3aa949f99f8e18d3ead370c2c"} Jun 06 20:51:39.541589 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:39.541548 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.51888043 podStartE2EDuration="2.541534616s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.654186ms" isStatefulPod=false podCreationTimestamp="2026-06-06 20:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:51:39.539560951 +0000 UTC m=+314.495101943" watchObservedRunningTime="2026-06-06 20:51:39.541534616 +0000 UTC m=+314.497075597" Jun 06 20:51:42.870819 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:51:42.870776 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:52:37.870947 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:52:37.870913 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:52:37.885934 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:52:37.885905 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:52:38.735338 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:52:38.735314 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:57:08.130546 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.130511 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw"] Jun 06 20:57:08.133560 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.133544 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.137124 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.137102 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 06 20:57:08.137124 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.137120 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-48mzl\"" Jun 06 20:57:08.137301 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.137194 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 06 20:57:08.137432 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.137420 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 06 20:57:08.137528 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.137509 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 06 20:57:08.150517 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.150495 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw"] Jun 06 20:57:08.246013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.245983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/911d69c4-edcc-4856-8aab-d174700bb502-tmp\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.246129 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.246025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/911d69c4-edcc-4856-8aab-d174700bb502-webhook-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.246129 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.246092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/911d69c4-edcc-4856-8aab-d174700bb502-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.246223 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.246162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/911d69c4-edcc-4856-8aab-d174700bb502-manifests\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.246223 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.246180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlh7z\" (UniqueName: \"kubernetes.io/projected/911d69c4-edcc-4856-8aab-d174700bb502-kube-api-access-hlh7z\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.347500 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.347476 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/911d69c4-edcc-4856-8aab-d174700bb502-manifests\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.347596 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.347504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlh7z\" (UniqueName: \"kubernetes.io/projected/911d69c4-edcc-4856-8aab-d174700bb502-kube-api-access-hlh7z\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.347596 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.347531 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/911d69c4-edcc-4856-8aab-d174700bb502-tmp\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.347596 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.347552 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/911d69c4-edcc-4856-8aab-d174700bb502-webhook-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.347596 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.347569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/911d69c4-edcc-4856-8aab-d174700bb502-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.347865 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.347824 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/911d69c4-edcc-4856-8aab-d174700bb502-manifests\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.349778 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.349751 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/911d69c4-edcc-4856-8aab-d174700bb502-tmp\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.350000 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.349981 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/911d69c4-edcc-4856-8aab-d174700bb502-webhook-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.350106 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.350088 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/911d69c4-edcc-4856-8aab-d174700bb502-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.355266 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.355244 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlh7z\" (UniqueName: \"kubernetes.io/projected/911d69c4-edcc-4856-8aab-d174700bb502-kube-api-access-hlh7z\") pod \"opendatahub-operator-controller-manager-d755ddb6c-qmxxw\" (UID: \"911d69c4-edcc-4856-8aab-d174700bb502\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.443757 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.443735 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:08.577056 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.577030 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw"] Jun 06 20:57:08.579898 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:57:08.579869 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911d69c4_edcc_4856_8aab_d174700bb502.slice/crio-00e6b9ea277aaa93aba17e80fa92d0a8bb9edfa254272c2691c3d2e2753595dc WatchSource:0}: Error finding container 00e6b9ea277aaa93aba17e80fa92d0a8bb9edfa254272c2691c3d2e2753595dc: Status 404 returned error can't find the container with id 00e6b9ea277aaa93aba17e80fa92d0a8bb9edfa254272c2691c3d2e2753595dc Jun 06 20:57:08.581703 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.581684 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 20:57:08.645382 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:08.645358 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" event={"ID":"911d69c4-edcc-4856-8aab-d174700bb502","Type":"ContainerStarted","Data":"00e6b9ea277aaa93aba17e80fa92d0a8bb9edfa254272c2691c3d2e2753595dc"} Jun 06 20:57:11.658239 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:11.658164 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" event={"ID":"911d69c4-edcc-4856-8aab-d174700bb502","Type":"ContainerStarted","Data":"062e3cf84fff4c3026dbb6db2ccf4811f8cf81ac46e2a19404fd459594a62b3b"} Jun 06 20:57:12.663234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:12.663159 2561 generic.go:356] "Generic (PLEG): container finished" podID="911d69c4-edcc-4856-8aab-d174700bb502" containerID="062e3cf84fff4c3026dbb6db2ccf4811f8cf81ac46e2a19404fd459594a62b3b" exitCode=0 Jun 06 20:57:12.663234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:12.663209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" event={"ID":"911d69c4-edcc-4856-8aab-d174700bb502","Type":"ContainerDied","Data":"062e3cf84fff4c3026dbb6db2ccf4811f8cf81ac46e2a19404fd459594a62b3b"} Jun 06 20:57:13.669011 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:13.668976 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" event={"ID":"911d69c4-edcc-4856-8aab-d174700bb502","Type":"ContainerStarted","Data":"a18816e2372806e101c7e44589c59512cee8439c1806e679241393530433a081"} Jun 06 20:57:13.669365 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:13.669107 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:13.698280 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:13.698233 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" podStartSLOduration=1.57756504 podStartE2EDuration="5.698218529s" totalImagesPullingTime="3.149875589s" totalInitContainerRuntime="970.7779ms" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:13.697682871 +0000 UTC m=+648.653223892" watchObservedRunningTime="2026-06-06 20:57:13.698218529 +0000 UTC m=+648.653759511" Jun 06 20:57:24.675434 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:24.675404 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-qmxxw" Jun 06 20:57:25.663586 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.663558 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd"] Jun 06 20:57:25.670749 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.670731 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.675213 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.675002 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 06 20:57:25.675213 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.675038 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd"] Jun 06 20:57:25.675213 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.675062 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 06 20:57:25.675213 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.675096 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xt4k6\"" Jun 06 20:57:25.675213 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.675100 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 06 20:57:25.675213 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.675165 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:57:25.675477 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.675287 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 06 20:57:25.781439 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.781412 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e9aef3e-28a5-42e8-9762-600150fae3c4-metrics-cert\") pod \"lws-controller-manager-68d9b98c67-6vpjd\" (UID: \"9e9aef3e-28a5-42e8-9762-600150fae3c4\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.781585 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.781447 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e9aef3e-28a5-42e8-9762-600150fae3c4-manager-config\") pod \"lws-controller-manager-68d9b98c67-6vpjd\" (UID: \"9e9aef3e-28a5-42e8-9762-600150fae3c4\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.781585 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.781467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e9aef3e-28a5-42e8-9762-600150fae3c4-cert\") pod \"lws-controller-manager-68d9b98c67-6vpjd\" (UID: \"9e9aef3e-28a5-42e8-9762-600150fae3c4\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.781585 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.781521 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcgp2\" (UniqueName: \"kubernetes.io/projected/9e9aef3e-28a5-42e8-9762-600150fae3c4-kube-api-access-mcgp2\") pod \"lws-controller-manager-68d9b98c67-6vpjd\" (UID: \"9e9aef3e-28a5-42e8-9762-600150fae3c4\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.882052 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.882026 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e9aef3e-28a5-42e8-9762-600150fae3c4-metrics-cert\") pod \"lws-controller-manager-68d9b98c67-6vpjd\" (UID: \"9e9aef3e-28a5-42e8-9762-600150fae3c4\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.882169 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.882060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e9aef3e-28a5-42e8-9762-600150fae3c4-manager-config\") pod \"lws-controller-manager-68d9b98c67-6vpjd\" (UID: \"9e9aef3e-28a5-42e8-9762-600150fae3c4\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.882169 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.882078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e9aef3e-28a5-42e8-9762-600150fae3c4-cert\") pod \"lws-controller-manager-68d9b98c67-6vpjd\" (UID: \"9e9aef3e-28a5-42e8-9762-600150fae3c4\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.882169 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.882098 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcgp2\" (UniqueName: \"kubernetes.io/projected/9e9aef3e-28a5-42e8-9762-600150fae3c4-kube-api-access-mcgp2\") pod \"lws-controller-manager-68d9b98c67-6vpjd\" (UID: \"9e9aef3e-28a5-42e8-9762-600150fae3c4\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.882674 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.882643 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e9aef3e-28a5-42e8-9762-600150fae3c4-manager-config\") pod \"lws-controller-manager-68d9b98c67-6vpjd\" (UID: \"9e9aef3e-28a5-42e8-9762-600150fae3c4\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.884564 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.884539 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e9aef3e-28a5-42e8-9762-600150fae3c4-cert\") pod \"lws-controller-manager-68d9b98c67-6vpjd\" (UID: \"9e9aef3e-28a5-42e8-9762-600150fae3c4\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.884640 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.884600 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e9aef3e-28a5-42e8-9762-600150fae3c4-metrics-cert\") pod \"lws-controller-manager-68d9b98c67-6vpjd\" (UID: \"9e9aef3e-28a5-42e8-9762-600150fae3c4\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.894602 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.894582 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcgp2\" (UniqueName: \"kubernetes.io/projected/9e9aef3e-28a5-42e8-9762-600150fae3c4-kube-api-access-mcgp2\") pod \"lws-controller-manager-68d9b98c67-6vpjd\" (UID: \"9e9aef3e-28a5-42e8-9762-600150fae3c4\") " pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:25.981643 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:25.981585 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:26.101714 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:26.101628 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd"] Jun 06 20:57:26.103816 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:57:26.103788 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e9aef3e_28a5_42e8_9762_600150fae3c4.slice/crio-ccda18450355ec62be38c7c8b09a9d954a1feb2a8cdc8607ab7d5e0cf2dd333b WatchSource:0}: Error finding container ccda18450355ec62be38c7c8b09a9d954a1feb2a8cdc8607ab7d5e0cf2dd333b: Status 404 returned error can't find the container with id ccda18450355ec62be38c7c8b09a9d954a1feb2a8cdc8607ab7d5e0cf2dd333b Jun 06 20:57:26.714948 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:26.714911 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" event={"ID":"9e9aef3e-28a5-42e8-9762-600150fae3c4","Type":"ContainerStarted","Data":"ccda18450355ec62be38c7c8b09a9d954a1feb2a8cdc8607ab7d5e0cf2dd333b"} Jun 06 20:57:29.729223 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:29.729180 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" event={"ID":"9e9aef3e-28a5-42e8-9762-600150fae3c4","Type":"ContainerStarted","Data":"458fda17c6919cc3473dfca6897ee8be60c8263be6f4cf1e666ae75e99647912"} Jun 06 20:57:29.729643 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:29.729284 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:57:29.746300 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:29.746241 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" podStartSLOduration=2.137235076 podStartE2EDuration="4.74622363s" totalImagesPullingTime="2.608988554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:29.744934759 +0000 UTC m=+664.700475753" watchObservedRunningTime="2026-06-06 20:57:29.74622363 +0000 UTC m=+664.701764610" Jun 06 20:57:40.736336 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:57:40.736302 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68d9b98c67-6vpjd" Jun 06 20:58:00.253714 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.253677 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw"] Jun 06 20:58:00.256973 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.256942 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.259659 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.259642 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 06 20:58:00.259754 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.259725 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4w9c5\"" Jun 06 20:58:00.259878 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.259861 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 06 20:58:00.260022 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.260005 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 06 20:58:00.269173 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.269155 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw"] Jun 06 20:58:00.315531 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.315496 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d"] Jun 06 20:58:00.318606 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.318586 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.329899 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.329877 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d"] Jun 06 20:58:00.358396 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.358368 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.358484 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.358399 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.358525 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.358502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.358563 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.358545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2xdn\" (UniqueName: \"kubernetes.io/projected/035b9b0a-e1a4-402c-a60a-7f75e084d40d-kube-api-access-j2xdn\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.358597 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.358566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.358597 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.358589 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.358668 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.358612 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.358668 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.358643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.358741 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.358672 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.459155 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459130 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.459271 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.459271 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.459271 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.459405 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459265 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.459405 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459293 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5zwt\" (UniqueName: \"kubernetes.io/projected/35aa3e51-bb50-4524-b2f7-37aa1e15712f-kube-api-access-j5zwt\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.459405 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459311 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.459405 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.459405 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.459643 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2xdn\" (UniqueName: \"kubernetes.io/projected/035b9b0a-e1a4-402c-a60a-7f75e084d40d-kube-api-access-j2xdn\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.459643 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459542 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.459643 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459576 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.459643 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459609 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.459643 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.459974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459657 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.459974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.459974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459756 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.459974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.459974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.459974 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.459903 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.460272 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.460053 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.460272 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.460130 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.460463 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.460445 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.461882 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.461859 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.462083 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.462068 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.470154 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.470128 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.470228 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.470196 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2xdn\" (UniqueName: \"kubernetes.io/projected/035b9b0a-e1a4-402c-a60a-7f75e084d40d-kube-api-access-j2xdn\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.561042 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.560956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.561042 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.560988 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.561042 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.561005 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5zwt\" (UniqueName: \"kubernetes.io/projected/35aa3e51-bb50-4524-b2f7-37aa1e15712f-kube-api-access-j5zwt\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.561042 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.561033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.561310 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.561077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.561310 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.561124 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.561310 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.561197 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.561310 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.561228 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.561310 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.561257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.561560 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.561424 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.561618 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.561581 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.561744 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.561722 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.561824 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.561788 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.562185 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.562161 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.563208 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.563186 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.563535 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.563519 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.566516 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.566497 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:00.572357 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.572333 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5zwt\" (UniqueName: \"kubernetes.io/projected/35aa3e51-bb50-4524-b2f7-37aa1e15712f-kube-api-access-j5zwt\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.572904 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.572883 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35aa3e51-bb50-4524-b2f7-37aa1e15712f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795mmp9d\" (UID: \"35aa3e51-bb50-4524-b2f7-37aa1e15712f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.628423 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.628323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:00.703263 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.703229 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw"] Jun 06 20:58:00.705958 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:58:00.705924 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035b9b0a_e1a4_402c_a60a_7f75e084d40d.slice/crio-98207d82721eadf0b6679a30b87d36af70d201e4678b9073863e5c16b84126b8 WatchSource:0}: Error finding container 98207d82721eadf0b6679a30b87d36af70d201e4678b9073863e5c16b84126b8: Status 404 returned error can't find the container with id 98207d82721eadf0b6679a30b87d36af70d201e4678b9073863e5c16b84126b8 Jun 06 20:58:00.767148 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.767126 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d"] Jun 06 20:58:00.769275 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:58:00.769249 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35aa3e51_bb50_4524_b2f7_37aa1e15712f.slice/crio-e1228c9fa92aeb174dd382666378ac61e4f6bb3e22bdaccbf773da06540fc4f2 WatchSource:0}: Error finding container e1228c9fa92aeb174dd382666378ac61e4f6bb3e22bdaccbf773da06540fc4f2: Status 404 returned error can't find the container with id e1228c9fa92aeb174dd382666378ac61e4f6bb3e22bdaccbf773da06540fc4f2 Jun 06 20:58:00.847643 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.847578 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" event={"ID":"035b9b0a-e1a4-402c-a60a-7f75e084d40d","Type":"ContainerStarted","Data":"98207d82721eadf0b6679a30b87d36af70d201e4678b9073863e5c16b84126b8"} Jun 06 20:58:00.848642 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:00.848622 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" event={"ID":"35aa3e51-bb50-4524-b2f7-37aa1e15712f","Type":"ContainerStarted","Data":"e1228c9fa92aeb174dd382666378ac61e4f6bb3e22bdaccbf773da06540fc4f2"} Jun 06 20:58:03.557601 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:03.557547 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 20:58:03.558005 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:03.557643 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 20:58:03.558005 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:03.557687 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 20:58:03.563776 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:03.563750 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 20:58:03.563884 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:03.563810 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 20:58:03.563884 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:03.563855 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 20:58:03.863764 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:03.863664 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" event={"ID":"35aa3e51-bb50-4524-b2f7-37aa1e15712f","Type":"ContainerStarted","Data":"f3813c973d9a477feca818b6415acefe74c15991798c094120c2ee31b15502d5"} Jun 06 20:58:03.865382 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:03.865351 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" event={"ID":"035b9b0a-e1a4-402c-a60a-7f75e084d40d","Type":"ContainerStarted","Data":"49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8"} Jun 06 20:58:03.886140 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:03.886090 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" podStartSLOduration=1.093782021 podStartE2EDuration="3.886073071s" totalImagesPullingTime="2.79229105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:58:03.884382538 +0000 UTC m=+698.839923519" watchObservedRunningTime="2026-06-06 20:58:03.886073071 +0000 UTC m=+698.841614050" Jun 06 20:58:03.906598 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:03.906549 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" podStartSLOduration=1.0572990899999999 podStartE2EDuration="3.906531479s" totalImagesPullingTime="2.849232389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:58:03.905447173 +0000 UTC m=+698.860988186" watchObservedRunningTime="2026-06-06 20:58:03.906531479 +0000 UTC m=+698.862072461" Jun 06 20:58:04.248726 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.248687 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-dcfc9684d-hmw7b"] Jun 06 20:58:04.252424 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.252404 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dcfc9684d-hmw7b" Jun 06 20:58:04.255045 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.255021 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 06 20:58:04.255180 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.255028 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bdqcj\"" Jun 06 20:58:04.261788 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.261765 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dcfc9684d-hmw7b"] Jun 06 20:58:04.398947 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.398914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p54hh\" (UniqueName: \"kubernetes.io/projected/4784f652-8089-406b-be56-623af83a8668-kube-api-access-p54hh\") pod \"dashboard-redirect-dcfc9684d-hmw7b\" (UID: \"4784f652-8089-406b-be56-623af83a8668\") " pod="opendatahub/dashboard-redirect-dcfc9684d-hmw7b" Jun 06 20:58:04.399118 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.398982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4784f652-8089-406b-be56-623af83a8668-redirect-config\") pod \"dashboard-redirect-dcfc9684d-hmw7b\" (UID: \"4784f652-8089-406b-be56-623af83a8668\") " pod="opendatahub/dashboard-redirect-dcfc9684d-hmw7b" Jun 06 20:58:04.500359 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.500292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p54hh\" (UniqueName: \"kubernetes.io/projected/4784f652-8089-406b-be56-623af83a8668-kube-api-access-p54hh\") pod \"dashboard-redirect-dcfc9684d-hmw7b\" (UID: \"4784f652-8089-406b-be56-623af83a8668\") " pod="opendatahub/dashboard-redirect-dcfc9684d-hmw7b" Jun 06 20:58:04.500359 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.500338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4784f652-8089-406b-be56-623af83a8668-redirect-config\") pod \"dashboard-redirect-dcfc9684d-hmw7b\" (UID: \"4784f652-8089-406b-be56-623af83a8668\") " pod="opendatahub/dashboard-redirect-dcfc9684d-hmw7b" Jun 06 20:58:04.500966 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.500950 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4784f652-8089-406b-be56-623af83a8668-redirect-config\") pod \"dashboard-redirect-dcfc9684d-hmw7b\" (UID: \"4784f652-8089-406b-be56-623af83a8668\") " pod="opendatahub/dashboard-redirect-dcfc9684d-hmw7b" Jun 06 20:58:04.509019 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.508987 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p54hh\" (UniqueName: \"kubernetes.io/projected/4784f652-8089-406b-be56-623af83a8668-kube-api-access-p54hh\") pod \"dashboard-redirect-dcfc9684d-hmw7b\" (UID: \"4784f652-8089-406b-be56-623af83a8668\") " pod="opendatahub/dashboard-redirect-dcfc9684d-hmw7b" Jun 06 20:58:04.563735 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.563706 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dcfc9684d-hmw7b" Jun 06 20:58:04.567695 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.567676 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:04.568954 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.568935 2561 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.18:15021/healthz/ready\": dial tcp 10.134.0.18:15021: connect: connection refused" start-of-body= Jun 06 20:58:04.569023 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.568977 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" podUID="035b9b0a-e1a4-402c-a60a-7f75e084d40d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.18:15021/healthz/ready\": dial tcp 10.134.0.18:15021: connect: connection refused" Jun 06 20:58:04.629174 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.628961 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:04.634260 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.634238 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:04.690663 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.690640 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dcfc9684d-hmw7b"] Jun 06 20:58:04.693022 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:58:04.692996 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4784f652_8089_406b_be56_623af83a8668.slice/crio-1e3aa4585a009822e788b6016cc5b467d208d788eb1dd1ce138645dc749295b8 WatchSource:0}: Error finding container 1e3aa4585a009822e788b6016cc5b467d208d788eb1dd1ce138645dc749295b8: Status 404 returned error can't find the container with id 1e3aa4585a009822e788b6016cc5b467d208d788eb1dd1ce138645dc749295b8 Jun 06 20:58:04.870957 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.870869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dcfc9684d-hmw7b" event={"ID":"4784f652-8089-406b-be56-623af83a8668","Type":"ContainerStarted","Data":"1e3aa4585a009822e788b6016cc5b467d208d788eb1dd1ce138645dc749295b8"} Jun 06 20:58:04.871109 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.871083 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:04.872059 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.872044 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795mmp9d" Jun 06 20:58:04.922282 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:04.922256 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw"] Jun 06 20:58:05.567413 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:05.567378 2561 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.18:15021/healthz/ready\": dial tcp 10.134.0.18:15021: connect: connection refused" start-of-body= Jun 06 20:58:05.567818 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:05.567441 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" podUID="035b9b0a-e1a4-402c-a60a-7f75e084d40d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.18:15021/healthz/ready\": dial tcp 10.134.0.18:15021: connect: connection refused" Jun 06 20:58:06.567045 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:06.567007 2561 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.18:15021/healthz/ready\": dial tcp 10.134.0.18:15021: connect: connection refused" start-of-body= Jun 06 20:58:06.567227 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:06.567077 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" podUID="035b9b0a-e1a4-402c-a60a-7f75e084d40d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.18:15021/healthz/ready\": dial tcp 10.134.0.18:15021: connect: connection refused" Jun 06 20:58:06.878490 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:06.878375 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" podUID="035b9b0a-e1a4-402c-a60a-7f75e084d40d" containerName="istio-proxy" containerID="cri-o://49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8" gracePeriod=30 Jun 06 20:58:07.883924 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:07.883892 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dcfc9684d-hmw7b" event={"ID":"4784f652-8089-406b-be56-623af83a8668","Type":"ContainerStarted","Data":"e718aa551f48ed99467cb88699da9a3589eb5008e268d337fbbb1baf21c03e16"} Jun 06 20:58:07.902596 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:07.902551 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-dcfc9684d-hmw7b" podStartSLOduration=1.652962107 podStartE2EDuration="3.902536829s" totalImagesPullingTime="2.249574722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:58:07.900371329 +0000 UTC m=+702.855912325" watchObservedRunningTime="2026-06-06 20:58:07.902536829 +0000 UTC m=+702.858077810" Jun 06 20:58:12.118130 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.118104 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:12.264743 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.264719 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2xdn\" (UniqueName: \"kubernetes.io/projected/035b9b0a-e1a4-402c-a60a-7f75e084d40d-kube-api-access-j2xdn\") pod \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " Jun 06 20:58:12.264900 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.264760 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-workload-certs\") pod \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " Jun 06 20:58:12.264900 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.264794 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-data\") pod \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " Jun 06 20:58:12.264900 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.264811 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istiod-ca-cert\") pod \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " Jun 06 20:58:12.264900 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.264860 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-credential-socket\") pod \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " Jun 06 20:58:12.264900 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.264886 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-envoy\") pod \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " Jun 06 20:58:12.265170 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.264955 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-workload-socket\") pod \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " Jun 06 20:58:12.265170 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.265000 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-podinfo\") pod \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " Jun 06 20:58:12.265170 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.265029 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-token\") pod \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\" (UID: \"035b9b0a-e1a4-402c-a60a-7f75e084d40d\") " Jun 06 20:58:12.265170 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.265148 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "035b9b0a-e1a4-402c-a60a-7f75e084d40d" (UID: "035b9b0a-e1a4-402c-a60a-7f75e084d40d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:58:12.265170 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.265146 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "035b9b0a-e1a4-402c-a60a-7f75e084d40d" (UID: "035b9b0a-e1a4-402c-a60a-7f75e084d40d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:58:12.265170 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.265159 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-data" (OuterVolumeSpecName: "istio-data") pod "035b9b0a-e1a4-402c-a60a-7f75e084d40d" (UID: "035b9b0a-e1a4-402c-a60a-7f75e084d40d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:58:12.265469 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.265261 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "035b9b0a-e1a4-402c-a60a-7f75e084d40d" (UID: "035b9b0a-e1a4-402c-a60a-7f75e084d40d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:58:12.265469 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.265297 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-data\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:58:12.265469 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.265341 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-credential-socket\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:58:12.265469 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.265348 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "035b9b0a-e1a4-402c-a60a-7f75e084d40d" (UID: "035b9b0a-e1a4-402c-a60a-7f75e084d40d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:58:12.265469 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.265355 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-workload-certs\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:58:12.267139 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.267109 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "035b9b0a-e1a4-402c-a60a-7f75e084d40d" (UID: "035b9b0a-e1a4-402c-a60a-7f75e084d40d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:58:12.267256 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.267230 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/035b9b0a-e1a4-402c-a60a-7f75e084d40d-kube-api-access-j2xdn" (OuterVolumeSpecName: "kube-api-access-j2xdn") pod "035b9b0a-e1a4-402c-a60a-7f75e084d40d" (UID: "035b9b0a-e1a4-402c-a60a-7f75e084d40d"). InnerVolumeSpecName "kube-api-access-j2xdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:58:12.267324 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.267255 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "035b9b0a-e1a4-402c-a60a-7f75e084d40d" (UID: "035b9b0a-e1a4-402c-a60a-7f75e084d40d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 06 20:58:12.267324 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.267270 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-token" (OuterVolumeSpecName: "istio-token") pod "035b9b0a-e1a4-402c-a60a-7f75e084d40d" (UID: "035b9b0a-e1a4-402c-a60a-7f75e084d40d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:58:12.367278 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.367068 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2xdn\" (UniqueName: \"kubernetes.io/projected/035b9b0a-e1a4-402c-a60a-7f75e084d40d-kube-api-access-j2xdn\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:58:12.367278 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.367096 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istiod-ca-cert\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:58:12.367278 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.367111 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-envoy\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:58:12.367278 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.367125 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/035b9b0a-e1a4-402c-a60a-7f75e084d40d-workload-socket\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:58:12.367278 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.367144 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-podinfo\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:58:12.367278 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.367158 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/035b9b0a-e1a4-402c-a60a-7f75e084d40d-istio-token\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:58:12.902583 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.902550 2561 generic.go:356] "Generic (PLEG): container finished" podID="035b9b0a-e1a4-402c-a60a-7f75e084d40d" containerID="49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8" exitCode=0 Jun 06 20:58:12.902748 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.902606 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" Jun 06 20:58:12.902748 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.902631 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" event={"ID":"035b9b0a-e1a4-402c-a60a-7f75e084d40d","Type":"ContainerDied","Data":"49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8"} Jun 06 20:58:12.902748 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.902684 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw" event={"ID":"035b9b0a-e1a4-402c-a60a-7f75e084d40d","Type":"ContainerDied","Data":"98207d82721eadf0b6679a30b87d36af70d201e4678b9073863e5c16b84126b8"} Jun 06 20:58:12.902748 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.902705 2561 scope.go:117] "RemoveContainer" containerID="49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8" Jun 06 20:58:12.912228 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.912212 2561 scope.go:117] "RemoveContainer" containerID="49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8" Jun 06 20:58:12.912493 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:58:12.912470 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8\": container with ID starting with 49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8 not found: ID does not exist" containerID="49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8" Jun 06 20:58:12.912572 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.912504 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8"} err="failed to get container status \"49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8\": rpc error: code = NotFound desc = could not find container \"49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8\": container with ID starting with 49d734f9e24e62347c05b494b815e780bc0e738ff7567c99ee69d5db049e65c8 not found: ID does not exist" Jun 06 20:58:12.924103 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.924078 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw"] Jun 06 20:58:12.930082 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:12.930060 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6ftcjcw"] Jun 06 20:58:13.437051 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:13.437020 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="035b9b0a-e1a4-402c-a60a-7f75e084d40d" path="/var/lib/kubelet/pods/035b9b0a-e1a4-402c-a60a-7f75e084d40d/volumes" Jun 06 20:58:28.882156 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:28.882121 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qkprg"] Jun 06 20:58:28.882529 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:28.882404 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="035b9b0a-e1a4-402c-a60a-7f75e084d40d" containerName="istio-proxy" Jun 06 20:58:28.882529 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:28.882414 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="035b9b0a-e1a4-402c-a60a-7f75e084d40d" containerName="istio-proxy" Jun 06 20:58:28.882529 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:28.882470 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="035b9b0a-e1a4-402c-a60a-7f75e084d40d" containerName="istio-proxy" Jun 06 20:58:28.886580 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:28.886553 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qkprg" Jun 06 20:58:28.889281 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:28.889255 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-7r674\"" Jun 06 20:58:28.889412 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:28.889291 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 20:58:28.890301 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:28.890281 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 20:58:28.899259 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:28.899226 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qkprg"] Jun 06 20:58:28.985773 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:28.985746 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4smgx\" (UniqueName: \"kubernetes.io/projected/372e1dd5-07a1-4dba-9909-905a1508f24d-kube-api-access-4smgx\") pod \"kuadrant-operator-catalog-qkprg\" (UID: \"372e1dd5-07a1-4dba-9909-905a1508f24d\") " pod="kuadrant-system/kuadrant-operator-catalog-qkprg" Jun 06 20:58:29.087127 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.087095 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4smgx\" (UniqueName: \"kubernetes.io/projected/372e1dd5-07a1-4dba-9909-905a1508f24d-kube-api-access-4smgx\") pod \"kuadrant-operator-catalog-qkprg\" (UID: \"372e1dd5-07a1-4dba-9909-905a1508f24d\") " pod="kuadrant-system/kuadrant-operator-catalog-qkprg" Jun 06 20:58:29.094828 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.094805 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4smgx\" (UniqueName: \"kubernetes.io/projected/372e1dd5-07a1-4dba-9909-905a1508f24d-kube-api-access-4smgx\") pod \"kuadrant-operator-catalog-qkprg\" (UID: \"372e1dd5-07a1-4dba-9909-905a1508f24d\") " pod="kuadrant-system/kuadrant-operator-catalog-qkprg" Jun 06 20:58:29.197605 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.197576 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qkprg" Jun 06 20:58:29.248375 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.248346 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qkprg"] Jun 06 20:58:29.323160 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.323128 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qkprg"] Jun 06 20:58:29.325765 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:58:29.325726 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod372e1dd5_07a1_4dba_9909_905a1508f24d.slice/crio-673a32e71bdb48bbeaa5a1215164fa84d31dd7843ed1b118bace00b7c3a4e3fc WatchSource:0}: Error finding container 673a32e71bdb48bbeaa5a1215164fa84d31dd7843ed1b118bace00b7c3a4e3fc: Status 404 returned error can't find the container with id 673a32e71bdb48bbeaa5a1215164fa84d31dd7843ed1b118bace00b7c3a4e3fc Jun 06 20:58:29.458986 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.458928 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-85qx6"] Jun 06 20:58:29.464336 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.464312 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-85qx6" Jun 06 20:58:29.468966 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.468945 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-85qx6"] Jun 06 20:58:29.489818 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.489794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nst6\" (UniqueName: \"kubernetes.io/projected/dc0434bd-096c-4bc0-adc2-0a0b102bd781-kube-api-access-4nst6\") pod \"kuadrant-operator-catalog-85qx6\" (UID: \"dc0434bd-096c-4bc0-adc2-0a0b102bd781\") " pod="kuadrant-system/kuadrant-operator-catalog-85qx6" Jun 06 20:58:29.591234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.591204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nst6\" (UniqueName: \"kubernetes.io/projected/dc0434bd-096c-4bc0-adc2-0a0b102bd781-kube-api-access-4nst6\") pod \"kuadrant-operator-catalog-85qx6\" (UID: \"dc0434bd-096c-4bc0-adc2-0a0b102bd781\") " pod="kuadrant-system/kuadrant-operator-catalog-85qx6" Jun 06 20:58:29.599752 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.599730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nst6\" (UniqueName: \"kubernetes.io/projected/dc0434bd-096c-4bc0-adc2-0a0b102bd781-kube-api-access-4nst6\") pod \"kuadrant-operator-catalog-85qx6\" (UID: \"dc0434bd-096c-4bc0-adc2-0a0b102bd781\") " pod="kuadrant-system/kuadrant-operator-catalog-85qx6" Jun 06 20:58:29.774617 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.774552 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-85qx6" Jun 06 20:58:29.897339 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.897266 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-85qx6"] Jun 06 20:58:29.899633 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:58:29.899609 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0434bd_096c_4bc0_adc2_0a0b102bd781.slice/crio-a3665cfb14b8f56dabbeeec0a8c90063a657a2cf35b792ed91d32fc845a62eab WatchSource:0}: Error finding container a3665cfb14b8f56dabbeeec0a8c90063a657a2cf35b792ed91d32fc845a62eab: Status 404 returned error can't find the container with id a3665cfb14b8f56dabbeeec0a8c90063a657a2cf35b792ed91d32fc845a62eab Jun 06 20:58:29.967013 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.966974 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qkprg" event={"ID":"372e1dd5-07a1-4dba-9909-905a1508f24d","Type":"ContainerStarted","Data":"673a32e71bdb48bbeaa5a1215164fa84d31dd7843ed1b118bace00b7c3a4e3fc"} Jun 06 20:58:29.968089 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:29.968059 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-85qx6" event={"ID":"dc0434bd-096c-4bc0-adc2-0a0b102bd781","Type":"ContainerStarted","Data":"a3665cfb14b8f56dabbeeec0a8c90063a657a2cf35b792ed91d32fc845a62eab"} Jun 06 20:58:31.978903 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:31.978869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qkprg" event={"ID":"372e1dd5-07a1-4dba-9909-905a1508f24d","Type":"ContainerStarted","Data":"65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8"} Jun 06 20:58:31.979358 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:31.978903 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qkprg" podUID="372e1dd5-07a1-4dba-9909-905a1508f24d" containerName="registry-server" containerID="cri-o://65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8" gracePeriod=2 Jun 06 20:58:31.980335 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:31.980315 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-85qx6" event={"ID":"dc0434bd-096c-4bc0-adc2-0a0b102bd781","Type":"ContainerStarted","Data":"5112d0c2511b7c4065ab0aaa4c0e22f90396525641d04fe25ace158bd75e3732"} Jun 06 20:58:31.995236 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:31.995199 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qkprg" podStartSLOduration=1.78313669 podStartE2EDuration="3.995185441s" totalImagesPullingTime="2.212048751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:58:31.99425754 +0000 UTC m=+726.949798532" watchObservedRunningTime="2026-06-06 20:58:31.995185441 +0000 UTC m=+726.950726424" Jun 06 20:58:32.013555 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:32.013520 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-85qx6" podStartSLOduration=1.371506484 podStartE2EDuration="3.013506071s" totalImagesPullingTime="1.641999587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:58:32.012058773 +0000 UTC m=+726.967599775" watchObservedRunningTime="2026-06-06 20:58:32.013506071 +0000 UTC m=+726.969047098" Jun 06 20:58:32.216338 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:32.216313 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qkprg" Jun 06 20:58:32.314262 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:32.314191 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4smgx\" (UniqueName: \"kubernetes.io/projected/372e1dd5-07a1-4dba-9909-905a1508f24d-kube-api-access-4smgx\") pod \"372e1dd5-07a1-4dba-9909-905a1508f24d\" (UID: \"372e1dd5-07a1-4dba-9909-905a1508f24d\") " Jun 06 20:58:32.316234 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:32.316207 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/372e1dd5-07a1-4dba-9909-905a1508f24d-kube-api-access-4smgx" (OuterVolumeSpecName: "kube-api-access-4smgx") pod "372e1dd5-07a1-4dba-9909-905a1508f24d" (UID: "372e1dd5-07a1-4dba-9909-905a1508f24d"). InnerVolumeSpecName "kube-api-access-4smgx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:58:32.415334 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:32.415308 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4smgx\" (UniqueName: \"kubernetes.io/projected/372e1dd5-07a1-4dba-9909-905a1508f24d-kube-api-access-4smgx\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:58:32.985566 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:32.985532 2561 generic.go:356] "Generic (PLEG): container finished" podID="372e1dd5-07a1-4dba-9909-905a1508f24d" containerID="65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8" exitCode=0 Jun 06 20:58:32.986037 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:32.985576 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qkprg" Jun 06 20:58:32.986037 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:32.985623 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qkprg" event={"ID":"372e1dd5-07a1-4dba-9909-905a1508f24d","Type":"ContainerDied","Data":"65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8"} Jun 06 20:58:32.986037 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:32.985686 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qkprg" event={"ID":"372e1dd5-07a1-4dba-9909-905a1508f24d","Type":"ContainerDied","Data":"673a32e71bdb48bbeaa5a1215164fa84d31dd7843ed1b118bace00b7c3a4e3fc"} Jun 06 20:58:32.986037 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:32.985718 2561 scope.go:117] "RemoveContainer" containerID="65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8" Jun 06 20:58:32.994183 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:32.994153 2561 scope.go:117] "RemoveContainer" containerID="65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8" Jun 06 20:58:32.994431 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:58:32.994410 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8\": container with ID starting with 65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8 not found: ID does not exist" containerID="65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8" Jun 06 20:58:32.994484 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:32.994439 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8"} err="failed to get container status \"65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8\": rpc error: code = NotFound desc = could not find container \"65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8\": container with ID starting with 65d10e99e4b28b1604d82f3fd88e61722b61efc17f83d971c8dab739fdddd8b8 not found: ID does not exist" Jun 06 20:58:33.005609 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:33.005588 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qkprg"] Jun 06 20:58:33.009607 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:33.009587 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qkprg"] Jun 06 20:58:33.436748 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:33.436714 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="372e1dd5-07a1-4dba-9909-905a1508f24d" path="/var/lib/kubelet/pods/372e1dd5-07a1-4dba-9909-905a1508f24d/volumes" Jun 06 20:58:39.774931 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:39.774897 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-85qx6" Jun 06 20:58:39.775317 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:39.774988 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-85qx6" Jun 06 20:58:39.796739 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:39.796716 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-85qx6" Jun 06 20:58:40.035164 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:58:40.035102 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-85qx6" Jun 06 20:59:01.207614 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:01.207579 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx"] Jun 06 20:59:01.208082 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:01.207883 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="372e1dd5-07a1-4dba-9909-905a1508f24d" containerName="registry-server" Jun 06 20:59:01.208082 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:01.207894 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="372e1dd5-07a1-4dba-9909-905a1508f24d" containerName="registry-server" Jun 06 20:59:01.208082 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:01.207951 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="372e1dd5-07a1-4dba-9909-905a1508f24d" containerName="registry-server" Jun 06 20:59:01.212151 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:01.212135 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx" Jun 06 20:59:01.215902 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:01.215882 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-q4ljd\"" Jun 06 20:59:01.228584 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:01.228562 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx"] Jun 06 20:59:01.341547 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:01.341516 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm6qt\" (UniqueName: \"kubernetes.io/projected/12f135e0-0b5a-46d0-96e6-f45baa55ca58-kube-api-access-bm6qt\") pod \"authorino-operator-75cc8d5cb7-2hbbx\" (UID: \"12f135e0-0b5a-46d0-96e6-f45baa55ca58\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx" Jun 06 20:59:01.442071 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:01.442041 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm6qt\" (UniqueName: \"kubernetes.io/projected/12f135e0-0b5a-46d0-96e6-f45baa55ca58-kube-api-access-bm6qt\") pod \"authorino-operator-75cc8d5cb7-2hbbx\" (UID: \"12f135e0-0b5a-46d0-96e6-f45baa55ca58\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx" Jun 06 20:59:01.451586 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:01.451565 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm6qt\" (UniqueName: \"kubernetes.io/projected/12f135e0-0b5a-46d0-96e6-f45baa55ca58-kube-api-access-bm6qt\") pod \"authorino-operator-75cc8d5cb7-2hbbx\" (UID: \"12f135e0-0b5a-46d0-96e6-f45baa55ca58\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx" Jun 06 20:59:01.521579 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:01.521511 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx" Jun 06 20:59:01.644320 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:01.644292 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx"] Jun 06 20:59:01.646957 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:59:01.646930 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f135e0_0b5a_46d0_96e6_f45baa55ca58.slice/crio-5a5187976f4afa5e7f3d7a8e385e7f571e638e15b0215a7088267e64ca7d602c WatchSource:0}: Error finding container 5a5187976f4afa5e7f3d7a8e385e7f571e638e15b0215a7088267e64ca7d602c: Status 404 returned error can't find the container with id 5a5187976f4afa5e7f3d7a8e385e7f571e638e15b0215a7088267e64ca7d602c Jun 06 20:59:02.103515 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:02.103483 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx" event={"ID":"12f135e0-0b5a-46d0-96e6-f45baa55ca58","Type":"ContainerStarted","Data":"5a5187976f4afa5e7f3d7a8e385e7f571e638e15b0215a7088267e64ca7d602c"} Jun 06 20:59:04.114258 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:04.114167 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx" event={"ID":"12f135e0-0b5a-46d0-96e6-f45baa55ca58","Type":"ContainerStarted","Data":"fd7779b8d5d8358c165f7d1aad40a00034ebcc07118a03370550bb70d8f8ed8f"} Jun 06 20:59:04.114615 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:04.114304 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx" Jun 06 20:59:04.129646 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:04.129602 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx" podStartSLOduration=0.989648896 podStartE2EDuration="3.129587106s" totalImagesPullingTime="2.13993821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:59:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:59:04.129199359 +0000 UTC m=+759.084740343" watchObservedRunningTime="2026-06-06 20:59:04.129587106 +0000 UTC m=+759.085128086" Jun 06 20:59:07.940087 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:07.940056 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2"] Jun 06 20:59:07.946260 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:07.946240 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:07.949733 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:07.949713 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-j5jr4\"" Jun 06 20:59:07.956737 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:07.956713 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2"] Jun 06 20:59:08.093434 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:08.093405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-897hx\" (UniqueName: \"kubernetes.io/projected/34de999b-a9f9-4206-b546-117ddd9d40b5-kube-api-access-897hx\") pod \"limitador-operator-controller-manager-859d7b78bd-sb5l2\" (UID: \"34de999b-a9f9-4206-b546-117ddd9d40b5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:08.194003 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:08.193936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-897hx\" (UniqueName: \"kubernetes.io/projected/34de999b-a9f9-4206-b546-117ddd9d40b5-kube-api-access-897hx\") pod \"limitador-operator-controller-manager-859d7b78bd-sb5l2\" (UID: \"34de999b-a9f9-4206-b546-117ddd9d40b5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:08.205065 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:08.205040 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-897hx\" (UniqueName: \"kubernetes.io/projected/34de999b-a9f9-4206-b546-117ddd9d40b5-kube-api-access-897hx\") pod \"limitador-operator-controller-manager-859d7b78bd-sb5l2\" (UID: \"34de999b-a9f9-4206-b546-117ddd9d40b5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:08.257740 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:08.257719 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:08.382170 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:08.382094 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2"] Jun 06 20:59:08.384315 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:59:08.384289 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34de999b_a9f9_4206_b546_117ddd9d40b5.slice/crio-e1c3d2cdb82ef523d781e0b64cdea94c586e64254296524db48e215f2cf1d3c4 WatchSource:0}: Error finding container e1c3d2cdb82ef523d781e0b64cdea94c586e64254296524db48e215f2cf1d3c4: Status 404 returned error can't find the container with id e1c3d2cdb82ef523d781e0b64cdea94c586e64254296524db48e215f2cf1d3c4 Jun 06 20:59:09.139620 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:09.139569 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" event={"ID":"34de999b-a9f9-4206-b546-117ddd9d40b5","Type":"ContainerStarted","Data":"e1c3d2cdb82ef523d781e0b64cdea94c586e64254296524db48e215f2cf1d3c4"} Jun 06 20:59:10.144653 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:10.144621 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" event={"ID":"34de999b-a9f9-4206-b546-117ddd9d40b5","Type":"ContainerStarted","Data":"bbb01da34e5054cde356198965296ffbb118546feb3ae3d63eead06d3a420876"} Jun 06 20:59:10.145023 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:10.144737 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:10.166637 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:10.166597 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" podStartSLOduration=1.541670814 podStartE2EDuration="3.166584618s" totalImagesPullingTime="1.624913804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:59:10.165270907 +0000 UTC m=+765.120811890" watchObservedRunningTime="2026-06-06 20:59:10.166584618 +0000 UTC m=+765.122125600" Jun 06 20:59:15.121103 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:15.121064 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2hbbx" Jun 06 20:59:21.151209 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:21.151178 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:30.876030 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:30.875995 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2"] Jun 06 20:59:30.876510 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:30.876189 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" podUID="34de999b-a9f9-4206-b546-117ddd9d40b5" containerName="manager" containerID="cri-o://bbb01da34e5054cde356198965296ffbb118546feb3ae3d63eead06d3a420876" gracePeriod=2 Jun 06 20:59:30.892368 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:30.892345 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2"] Jun 06 20:59:30.895274 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:59:30.895242 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34de999b-a9f9-4206-b546-117ddd9d40b5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-sb5l2\": pods \"limitador-operator-controller-manager-859d7b78bd-sb5l2\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:30.901366 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:30.901345 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf"] Jun 06 20:59:30.901668 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:30.901657 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34de999b-a9f9-4206-b546-117ddd9d40b5" containerName="manager" Jun 06 20:59:30.901715 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:30.901670 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="34de999b-a9f9-4206-b546-117ddd9d40b5" containerName="manager" Jun 06 20:59:30.901750 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:30.901724 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="34de999b-a9f9-4206-b546-117ddd9d40b5" containerName="manager" Jun 06 20:59:30.904569 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:30.904554 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf" Jun 06 20:59:30.919302 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:30.919278 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf"] Jun 06 20:59:30.941779 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:59:30.941741 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sb5l2\" is forbidden: User \"system:node:ip-10-0-132-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-80.ec2.internal' and this object" podUID="34de999b-a9f9-4206-b546-117ddd9d40b5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:31.069465 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.069422 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjgqk\" (UniqueName: \"kubernetes.io/projected/412a8ca8-f8b7-4eb8-a935-b3f6f77f9658-kube-api-access-bjgqk\") pod \"limitador-operator-controller-manager-859d7b78bd-wp2vf\" (UID: \"412a8ca8-f8b7-4eb8-a935-b3f6f77f9658\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf" Jun 06 20:59:31.112309 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.112288 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:31.116717 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:59:31.116695 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sb5l2\" is forbidden: User \"system:node:ip-10-0-132-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-80.ec2.internal' and this object" podUID="34de999b-a9f9-4206-b546-117ddd9d40b5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:31.169961 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.169939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjgqk\" (UniqueName: \"kubernetes.io/projected/412a8ca8-f8b7-4eb8-a935-b3f6f77f9658-kube-api-access-bjgqk\") pod \"limitador-operator-controller-manager-859d7b78bd-wp2vf\" (UID: \"412a8ca8-f8b7-4eb8-a935-b3f6f77f9658\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf" Jun 06 20:59:31.181488 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.181469 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjgqk\" (UniqueName: \"kubernetes.io/projected/412a8ca8-f8b7-4eb8-a935-b3f6f77f9658-kube-api-access-bjgqk\") pod \"limitador-operator-controller-manager-859d7b78bd-wp2vf\" (UID: \"412a8ca8-f8b7-4eb8-a935-b3f6f77f9658\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf" Jun 06 20:59:31.238982 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.238958 2561 generic.go:356] "Generic (PLEG): container finished" podID="34de999b-a9f9-4206-b546-117ddd9d40b5" containerID="bbb01da34e5054cde356198965296ffbb118546feb3ae3d63eead06d3a420876" exitCode=0 Jun 06 20:59:31.239118 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.239002 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:31.239118 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.239012 2561 scope.go:117] "RemoveContainer" containerID="bbb01da34e5054cde356198965296ffbb118546feb3ae3d63eead06d3a420876" Jun 06 20:59:31.241588 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:59:31.241564 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sb5l2\" is forbidden: User \"system:node:ip-10-0-132-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-80.ec2.internal' and this object" podUID="34de999b-a9f9-4206-b546-117ddd9d40b5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sb5l2" Jun 06 20:59:31.246940 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.246924 2561 scope.go:117] "RemoveContainer" containerID="bbb01da34e5054cde356198965296ffbb118546feb3ae3d63eead06d3a420876" Jun 06 20:59:31.247211 ip-10-0-132-80 kubenswrapper[2561]: E0606 20:59:31.247195 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbb01da34e5054cde356198965296ffbb118546feb3ae3d63eead06d3a420876\": container with ID starting with bbb01da34e5054cde356198965296ffbb118546feb3ae3d63eead06d3a420876 not found: ID does not exist" containerID="bbb01da34e5054cde356198965296ffbb118546feb3ae3d63eead06d3a420876" Jun 06 20:59:31.247275 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.247219 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbb01da34e5054cde356198965296ffbb118546feb3ae3d63eead06d3a420876"} err="failed to get container status \"bbb01da34e5054cde356198965296ffbb118546feb3ae3d63eead06d3a420876\": rpc error: code = NotFound desc = could not find container \"bbb01da34e5054cde356198965296ffbb118546feb3ae3d63eead06d3a420876\": container with ID starting with bbb01da34e5054cde356198965296ffbb118546feb3ae3d63eead06d3a420876 not found: ID does not exist" Jun 06 20:59:31.259370 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.259351 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf" Jun 06 20:59:31.270203 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.270180 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-897hx\" (UniqueName: \"kubernetes.io/projected/34de999b-a9f9-4206-b546-117ddd9d40b5-kube-api-access-897hx\") pod \"34de999b-a9f9-4206-b546-117ddd9d40b5\" (UID: \"34de999b-a9f9-4206-b546-117ddd9d40b5\") " Jun 06 20:59:31.272117 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.272089 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34de999b-a9f9-4206-b546-117ddd9d40b5-kube-api-access-897hx" (OuterVolumeSpecName: "kube-api-access-897hx") pod "34de999b-a9f9-4206-b546-117ddd9d40b5" (UID: "34de999b-a9f9-4206-b546-117ddd9d40b5"). InnerVolumeSpecName "kube-api-access-897hx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:59:31.371606 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.371577 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-897hx\" (UniqueName: \"kubernetes.io/projected/34de999b-a9f9-4206-b546-117ddd9d40b5-kube-api-access-897hx\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 20:59:31.391511 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.391379 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf"] Jun 06 20:59:31.394235 ip-10-0-132-80 kubenswrapper[2561]: W0606 20:59:31.394210 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod412a8ca8_f8b7_4eb8_a935_b3f6f77f9658.slice/crio-cc4fdee157d5c9a08b4f757b5ab243dd503b9a86cca1bf008d41e62c1e398f9a WatchSource:0}: Error finding container cc4fdee157d5c9a08b4f757b5ab243dd503b9a86cca1bf008d41e62c1e398f9a: Status 404 returned error can't find the container with id cc4fdee157d5c9a08b4f757b5ab243dd503b9a86cca1bf008d41e62c1e398f9a Jun 06 20:59:31.437312 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:31.437287 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34de999b-a9f9-4206-b546-117ddd9d40b5" path="/var/lib/kubelet/pods/34de999b-a9f9-4206-b546-117ddd9d40b5/volumes" Jun 06 20:59:32.245307 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:32.245275 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf" event={"ID":"412a8ca8-f8b7-4eb8-a935-b3f6f77f9658","Type":"ContainerStarted","Data":"2fd7836d736a2d320bc1b119f70b7dbdcb3f47b34b5ead9040ad783478b21715"} Jun 06 20:59:32.245723 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:32.245323 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf" event={"ID":"412a8ca8-f8b7-4eb8-a935-b3f6f77f9658","Type":"ContainerStarted","Data":"cc4fdee157d5c9a08b4f757b5ab243dd503b9a86cca1bf008d41e62c1e398f9a"} Jun 06 20:59:32.245723 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:32.245417 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf" Jun 06 20:59:32.266804 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:32.266748 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf" podStartSLOduration=2.266731578 podStartE2EDuration="2.266731578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:59:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:59:32.26650115 +0000 UTC m=+787.222042131" watchObservedRunningTime="2026-06-06 20:59:32.266731578 +0000 UTC m=+787.222272560" Jun 06 20:59:43.251471 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:43.251436 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wp2vf" Jun 06 20:59:59.552451 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.552338 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6"] Jun 06 20:59:59.556070 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.556047 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.558677 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.558652 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-s9f27\"" Jun 06 20:59:59.567723 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.567699 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6"] Jun 06 20:59:59.679171 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.679142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.679314 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.679177 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.679314 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.679273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb4kx\" (UniqueName: \"kubernetes.io/projected/691e05fb-9a9b-4ee7-973a-c89a7e07971c-kube-api-access-jb4kx\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.679314 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.679302 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.679442 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.679321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.679442 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.679364 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.679442 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.679407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.679546 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.679447 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.679546 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.679474 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.780577 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.780552 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.780708 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.780585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.780708 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.780608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.780708 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.780630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.780708 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.780668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.780708 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.780694 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.780972 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.780748 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb4kx\" (UniqueName: \"kubernetes.io/projected/691e05fb-9a9b-4ee7-973a-c89a7e07971c-kube-api-access-jb4kx\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.780972 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.780769 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.780972 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.780791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.781111 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.781021 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.781177 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.781154 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.781245 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.781225 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.781339 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.781322 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.781561 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.781539 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.783203 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.783182 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.783308 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.783184 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.788515 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.788497 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb4kx\" (UniqueName: \"kubernetes.io/projected/691e05fb-9a9b-4ee7-973a-c89a7e07971c-kube-api-access-jb4kx\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.788615 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.788523 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/691e05fb-9a9b-4ee7-973a-c89a7e07971c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-47mm6\" (UID: \"691e05fb-9a9b-4ee7-973a-c89a7e07971c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.867053 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.866997 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 20:59:59.999738 ip-10-0-132-80 kubenswrapper[2561]: I0606 20:59:59.999705 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6"] Jun 06 21:00:00.003597 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:00:00.003571 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691e05fb_9a9b_4ee7_973a_c89a7e07971c.slice/crio-ed4e00aa3eef352ac983d2f6d21685d6ce264a58acb48fa8c9c1063408609edd WatchSource:0}: Error finding container ed4e00aa3eef352ac983d2f6d21685d6ce264a58acb48fa8c9c1063408609edd: Status 404 returned error can't find the container with id ed4e00aa3eef352ac983d2f6d21685d6ce264a58acb48fa8c9c1063408609edd Jun 06 21:00:00.006052 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:00.006012 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 21:00:00.006143 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:00.006091 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 21:00:00.006143 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:00.006131 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 21:00:00.366503 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:00.366468 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" event={"ID":"691e05fb-9a9b-4ee7-973a-c89a7e07971c","Type":"ContainerStarted","Data":"5a026e68d53e29181c11c3a84b31aa871e942342225fdcd96f98a4112052832f"} Jun 06 21:00:00.366684 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:00.366526 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" event={"ID":"691e05fb-9a9b-4ee7-973a-c89a7e07971c","Type":"ContainerStarted","Data":"ed4e00aa3eef352ac983d2f6d21685d6ce264a58acb48fa8c9c1063408609edd"} Jun 06 21:00:00.387002 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:00.386921 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" podStartSLOduration=1.386902587 podStartE2EDuration="1.386902587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:59:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:00:00.385779586 +0000 UTC m=+815.341320580" watchObservedRunningTime="2026-06-06 21:00:00.386902587 +0000 UTC m=+815.342443568" Jun 06 21:00:00.867952 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:00.867924 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 21:00:01.872617 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:01.872577 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 21:00:02.374811 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:02.374781 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 21:00:02.375663 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:02.375647 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 21:00:16.969449 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:16.969419 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xvsm6"] Jun 06 21:00:16.973942 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:16.973922 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xvsm6" Jun 06 21:00:16.976473 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:16.976452 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8tf5s\"" Jun 06 21:00:16.991284 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:16.991254 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xvsm6"] Jun 06 21:00:17.120263 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:17.120231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq4c4\" (UniqueName: \"kubernetes.io/projected/88cbd8f4-7cbd-429f-86de-d124d064ce1e-kube-api-access-gq4c4\") pod \"authorino-75d556bd77-xvsm6\" (UID: \"88cbd8f4-7cbd-429f-86de-d124d064ce1e\") " pod="kuadrant-system/authorino-75d556bd77-xvsm6" Jun 06 21:00:17.220625 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:17.220559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq4c4\" (UniqueName: \"kubernetes.io/projected/88cbd8f4-7cbd-429f-86de-d124d064ce1e-kube-api-access-gq4c4\") pod \"authorino-75d556bd77-xvsm6\" (UID: \"88cbd8f4-7cbd-429f-86de-d124d064ce1e\") " pod="kuadrant-system/authorino-75d556bd77-xvsm6" Jun 06 21:00:17.235976 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:17.235952 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq4c4\" (UniqueName: \"kubernetes.io/projected/88cbd8f4-7cbd-429f-86de-d124d064ce1e-kube-api-access-gq4c4\") pod \"authorino-75d556bd77-xvsm6\" (UID: \"88cbd8f4-7cbd-429f-86de-d124d064ce1e\") " pod="kuadrant-system/authorino-75d556bd77-xvsm6" Jun 06 21:00:17.283991 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:17.283967 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xvsm6" Jun 06 21:00:17.423677 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:17.423657 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xvsm6"] Jun 06 21:00:17.425848 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:00:17.425808 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88cbd8f4_7cbd_429f_86de_d124d064ce1e.slice/crio-ebb9caedfaaad8117ba4ed8494c7f5bfaff2a02d1799a718740430dbd10d9d49 WatchSource:0}: Error finding container ebb9caedfaaad8117ba4ed8494c7f5bfaff2a02d1799a718740430dbd10d9d49: Status 404 returned error can't find the container with id ebb9caedfaaad8117ba4ed8494c7f5bfaff2a02d1799a718740430dbd10d9d49 Jun 06 21:00:17.440235 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:17.440201 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xvsm6" event={"ID":"88cbd8f4-7cbd-429f-86de-d124d064ce1e","Type":"ContainerStarted","Data":"ebb9caedfaaad8117ba4ed8494c7f5bfaff2a02d1799a718740430dbd10d9d49"} Jun 06 21:00:20.459959 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:20.459877 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xvsm6" event={"ID":"88cbd8f4-7cbd-429f-86de-d124d064ce1e","Type":"ContainerStarted","Data":"2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31"} Jun 06 21:00:20.475256 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:00:20.475207 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xvsm6" podStartSLOduration=1.7273579 podStartE2EDuration="4.475193322s" totalImagesPullingTime="2.747835422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:00:20.473472956 +0000 UTC m=+835.429013949" watchObservedRunningTime="2026-06-06 21:00:20.475193322 +0000 UTC m=+835.430734304" Jun 06 21:01:09.476986 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:09.476956 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 21:01:09.480482 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:09.480467 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 21:01:09.483341 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:09.483319 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 06 21:01:09.483341 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:09.483329 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-8wktq\"" Jun 06 21:01:09.484490 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:09.484469 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 06 21:01:09.484590 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:09.484530 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 06 21:01:09.488095 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:09.488076 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 21:01:09.517651 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:09.517624 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s8wc\" (UniqueName: \"kubernetes.io/projected/3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870-kube-api-access-6s8wc\") pod \"maas-keycloak-0\" (UID: \"3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870\") " pod="keycloak-system/maas-keycloak-0" Jun 06 21:01:09.618067 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:09.618042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8wc\" (UniqueName: \"kubernetes.io/projected/3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870-kube-api-access-6s8wc\") pod \"maas-keycloak-0\" (UID: \"3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870\") " pod="keycloak-system/maas-keycloak-0" Jun 06 21:01:09.625601 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:09.625576 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s8wc\" (UniqueName: \"kubernetes.io/projected/3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870-kube-api-access-6s8wc\") pod \"maas-keycloak-0\" (UID: \"3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870\") " pod="keycloak-system/maas-keycloak-0" Jun 06 21:01:09.815041 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:09.814970 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 21:01:09.940009 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:09.939986 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 21:01:09.941999 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:01:09.941972 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6c25b3_6b4b_488e_ba41_ff6c8dbd7870.slice/crio-2ac3a454ce7431ea44dc6335eacb153bbea4a241b6122ceaa7d6f5a9225aa3d8 WatchSource:0}: Error finding container 2ac3a454ce7431ea44dc6335eacb153bbea4a241b6122ceaa7d6f5a9225aa3d8: Status 404 returned error can't find the container with id 2ac3a454ce7431ea44dc6335eacb153bbea4a241b6122ceaa7d6f5a9225aa3d8 Jun 06 21:01:10.678910 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:10.678867 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870","Type":"ContainerStarted","Data":"2ac3a454ce7431ea44dc6335eacb153bbea4a241b6122ceaa7d6f5a9225aa3d8"} Jun 06 21:01:14.702732 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:14.702691 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870","Type":"ContainerStarted","Data":"68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca"} Jun 06 21:01:14.720086 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:14.720013 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.173726204 podStartE2EDuration="5.719990991s" totalImagesPullingTime="4.546264787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:01:14.717763206 +0000 UTC m=+889.673304186" watchObservedRunningTime="2026-06-06 21:01:14.719990991 +0000 UTC m=+889.675531973" Jun 06 21:01:14.816007 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:14.815916 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 06 21:01:14.817476 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:14.817447 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:15.816076 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:15.816024 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:16.816383 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:16.816324 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:17.816433 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:17.816378 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:18.816015 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:18.815583 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:19.815618 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:19.815588 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 06 21:01:19.817484 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:19.817449 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:20.816226 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:20.816175 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:21.815629 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:21.815570 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:22.816277 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:22.816226 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:23.815390 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:23.815346 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:24.816200 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:24.816147 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:25.816016 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:25.815972 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:26.816240 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:26.816190 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 06 21:01:27.935645 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:27.935605 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 06 21:01:27.955965 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:27.955907 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 21:01:37.942205 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:37.942172 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 06 21:01:41.171509 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.171476 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xvsm6"] Jun 06 21:01:41.171933 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.171704 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xvsm6" podUID="88cbd8f4-7cbd-429f-86de-d124d064ce1e" containerName="authorino" containerID="cri-o://2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31" gracePeriod=30 Jun 06 21:01:41.411096 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.411073 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xvsm6" Jun 06 21:01:41.525174 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.525114 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq4c4\" (UniqueName: \"kubernetes.io/projected/88cbd8f4-7cbd-429f-86de-d124d064ce1e-kube-api-access-gq4c4\") pod \"88cbd8f4-7cbd-429f-86de-d124d064ce1e\" (UID: \"88cbd8f4-7cbd-429f-86de-d124d064ce1e\") " Jun 06 21:01:41.527160 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.527133 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88cbd8f4-7cbd-429f-86de-d124d064ce1e-kube-api-access-gq4c4" (OuterVolumeSpecName: "kube-api-access-gq4c4") pod "88cbd8f4-7cbd-429f-86de-d124d064ce1e" (UID: "88cbd8f4-7cbd-429f-86de-d124d064ce1e"). InnerVolumeSpecName "kube-api-access-gq4c4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:01:41.625996 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.625967 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq4c4\" (UniqueName: \"kubernetes.io/projected/88cbd8f4-7cbd-429f-86de-d124d064ce1e-kube-api-access-gq4c4\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:01:41.851165 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.851080 2561 generic.go:356] "Generic (PLEG): container finished" podID="88cbd8f4-7cbd-429f-86de-d124d064ce1e" containerID="2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31" exitCode=0 Jun 06 21:01:41.851165 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.851120 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xvsm6" Jun 06 21:01:41.851386 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.851170 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xvsm6" event={"ID":"88cbd8f4-7cbd-429f-86de-d124d064ce1e","Type":"ContainerDied","Data":"2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31"} Jun 06 21:01:41.851386 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.851213 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xvsm6" event={"ID":"88cbd8f4-7cbd-429f-86de-d124d064ce1e","Type":"ContainerDied","Data":"ebb9caedfaaad8117ba4ed8494c7f5bfaff2a02d1799a718740430dbd10d9d49"} Jun 06 21:01:41.851386 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.851237 2561 scope.go:117] "RemoveContainer" containerID="2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31" Jun 06 21:01:41.859913 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.859895 2561 scope.go:117] "RemoveContainer" containerID="2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31" Jun 06 21:01:41.860156 ip-10-0-132-80 kubenswrapper[2561]: E0606 21:01:41.860139 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31\": container with ID starting with 2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31 not found: ID does not exist" containerID="2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31" Jun 06 21:01:41.860202 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.860166 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31"} err="failed to get container status \"2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31\": rpc error: code = NotFound desc = could not find container \"2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31\": container with ID starting with 2f0cae2b1ee200b9f737e6552eadfe681f3553a2d51d41c4e84236d136af1d31 not found: ID does not exist" Jun 06 21:01:41.877512 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.877481 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xvsm6"] Jun 06 21:01:41.881215 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:41.881185 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xvsm6"] Jun 06 21:01:43.437150 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:43.437119 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88cbd8f4-7cbd-429f-86de-d124d064ce1e" path="/var/lib/kubelet/pods/88cbd8f4-7cbd-429f-86de-d124d064ce1e/volumes" Jun 06 21:01:44.673947 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.673903 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c984c879d-wb249"] Jun 06 21:01:44.674766 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.674741 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88cbd8f4-7cbd-429f-86de-d124d064ce1e" containerName="authorino" Jun 06 21:01:44.674940 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.674927 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="88cbd8f4-7cbd-429f-86de-d124d064ce1e" containerName="authorino" Jun 06 21:01:44.675241 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.675227 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="88cbd8f4-7cbd-429f-86de-d124d064ce1e" containerName="authorino" Jun 06 21:01:44.678522 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.678498 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:01:44.681216 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.681194 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 06 21:01:44.681216 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.681210 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hqmwk\"" Jun 06 21:01:44.682352 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.682327 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 06 21:01:44.684270 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.684247 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c984c879d-wb249"] Jun 06 21:01:44.752673 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.752645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c642a25-5403-484f-9934-09225dcdf023-webhook-cert\") pod \"maas-controller-c984c879d-wb249\" (UID: \"9c642a25-5403-484f-9934-09225dcdf023\") " pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:01:44.752802 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.752759 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr4f9\" (UniqueName: \"kubernetes.io/projected/9c642a25-5403-484f-9934-09225dcdf023-kube-api-access-sr4f9\") pod \"maas-controller-c984c879d-wb249\" (UID: \"9c642a25-5403-484f-9934-09225dcdf023\") " pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:01:44.843996 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.843964 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c4db5fc79-5nm5j"] Jun 06 21:01:44.846246 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.846228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" Jun 06 21:01:44.854048 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.854031 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr4f9\" (UniqueName: \"kubernetes.io/projected/9c642a25-5403-484f-9934-09225dcdf023-kube-api-access-sr4f9\") pod \"maas-controller-c984c879d-wb249\" (UID: \"9c642a25-5403-484f-9934-09225dcdf023\") " pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:01:44.854148 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.854064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c642a25-5403-484f-9934-09225dcdf023-webhook-cert\") pod \"maas-controller-c984c879d-wb249\" (UID: \"9c642a25-5403-484f-9934-09225dcdf023\") " pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:01:44.854283 ip-10-0-132-80 kubenswrapper[2561]: E0606 21:01:44.854195 2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 06 21:01:44.854283 ip-10-0-132-80 kubenswrapper[2561]: E0606 21:01:44.854244 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c642a25-5403-484f-9934-09225dcdf023-webhook-cert podName:9c642a25-5403-484f-9934-09225dcdf023 nodeName:}" failed. No retries permitted until 2026-06-06 21:01:45.354227619 +0000 UTC m=+920.309768580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/9c642a25-5403-484f-9934-09225dcdf023-webhook-cert") pod "maas-controller-c984c879d-wb249" (UID: "9c642a25-5403-484f-9934-09225dcdf023") : secret "maas-controller-webhook-cert" not found Jun 06 21:01:44.860190 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.860170 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c4db5fc79-5nm5j"] Jun 06 21:01:44.864882 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.864824 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr4f9\" (UniqueName: \"kubernetes.io/projected/9c642a25-5403-484f-9934-09225dcdf023-kube-api-access-sr4f9\") pod \"maas-controller-c984c879d-wb249\" (UID: \"9c642a25-5403-484f-9934-09225dcdf023\") " pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:01:44.954458 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.954392 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlqcd\" (UniqueName: \"kubernetes.io/projected/e671e1cb-36a9-49ac-8b41-5267f499f182-kube-api-access-dlqcd\") pod \"maas-controller-6c4db5fc79-5nm5j\" (UID: \"e671e1cb-36a9-49ac-8b41-5267f499f182\") " pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" Jun 06 21:01:44.954458 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:44.954423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e671e1cb-36a9-49ac-8b41-5267f499f182-webhook-cert\") pod \"maas-controller-6c4db5fc79-5nm5j\" (UID: \"e671e1cb-36a9-49ac-8b41-5267f499f182\") " pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" Jun 06 21:01:45.054906 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:45.054875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlqcd\" (UniqueName: \"kubernetes.io/projected/e671e1cb-36a9-49ac-8b41-5267f499f182-kube-api-access-dlqcd\") pod \"maas-controller-6c4db5fc79-5nm5j\" (UID: \"e671e1cb-36a9-49ac-8b41-5267f499f182\") " pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" Jun 06 21:01:45.055048 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:45.054913 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e671e1cb-36a9-49ac-8b41-5267f499f182-webhook-cert\") pod \"maas-controller-6c4db5fc79-5nm5j\" (UID: \"e671e1cb-36a9-49ac-8b41-5267f499f182\") " pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" Jun 06 21:01:45.057315 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:45.057288 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e671e1cb-36a9-49ac-8b41-5267f499f182-webhook-cert\") pod \"maas-controller-6c4db5fc79-5nm5j\" (UID: \"e671e1cb-36a9-49ac-8b41-5267f499f182\") " pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" Jun 06 21:01:45.063584 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:45.063560 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlqcd\" (UniqueName: \"kubernetes.io/projected/e671e1cb-36a9-49ac-8b41-5267f499f182-kube-api-access-dlqcd\") pod \"maas-controller-6c4db5fc79-5nm5j\" (UID: \"e671e1cb-36a9-49ac-8b41-5267f499f182\") " pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" Jun 06 21:01:45.156147 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:45.156127 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" Jun 06 21:01:45.282802 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:45.282776 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c4db5fc79-5nm5j"] Jun 06 21:01:45.285148 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:01:45.285123 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode671e1cb_36a9_49ac_8b41_5267f499f182.slice/crio-9f8fa23979969935b5e0dad397562cc0df7ebfd709d2131d23355441f261064d WatchSource:0}: Error finding container 9f8fa23979969935b5e0dad397562cc0df7ebfd709d2131d23355441f261064d: Status 404 returned error can't find the container with id 9f8fa23979969935b5e0dad397562cc0df7ebfd709d2131d23355441f261064d Jun 06 21:01:45.358404 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:45.358379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c642a25-5403-484f-9934-09225dcdf023-webhook-cert\") pod \"maas-controller-c984c879d-wb249\" (UID: \"9c642a25-5403-484f-9934-09225dcdf023\") " pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:01:45.360609 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:45.360585 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c642a25-5403-484f-9934-09225dcdf023-webhook-cert\") pod \"maas-controller-c984c879d-wb249\" (UID: \"9c642a25-5403-484f-9934-09225dcdf023\") " pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:01:45.589545 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:45.589479 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:01:45.717294 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:45.717272 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c984c879d-wb249"] Jun 06 21:01:45.719463 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:01:45.719433 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c642a25_5403_484f_9934_09225dcdf023.slice/crio-2eaac74ce6b59aae420e0cacba38ffe0ece29c752a6f2ed4bdcf9295eb57981f WatchSource:0}: Error finding container 2eaac74ce6b59aae420e0cacba38ffe0ece29c752a6f2ed4bdcf9295eb57981f: Status 404 returned error can't find the container with id 2eaac74ce6b59aae420e0cacba38ffe0ece29c752a6f2ed4bdcf9295eb57981f Jun 06 21:01:45.874885 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:45.874098 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c984c879d-wb249" event={"ID":"9c642a25-5403-484f-9934-09225dcdf023","Type":"ContainerStarted","Data":"2eaac74ce6b59aae420e0cacba38ffe0ece29c752a6f2ed4bdcf9295eb57981f"} Jun 06 21:01:45.875612 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:45.875579 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" event={"ID":"e671e1cb-36a9-49ac-8b41-5267f499f182","Type":"ContainerStarted","Data":"9f8fa23979969935b5e0dad397562cc0df7ebfd709d2131d23355441f261064d"} Jun 06 21:01:48.893523 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:48.893478 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" event={"ID":"e671e1cb-36a9-49ac-8b41-5267f499f182","Type":"ContainerStarted","Data":"c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a"} Jun 06 21:01:48.893984 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:48.893571 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" Jun 06 21:01:48.894956 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:48.894930 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c984c879d-wb249" event={"ID":"9c642a25-5403-484f-9934-09225dcdf023","Type":"ContainerStarted","Data":"8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb"} Jun 06 21:01:48.895051 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:48.894983 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:01:48.920799 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:48.920743 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" podStartSLOduration=2.317273605 podStartE2EDuration="4.92072414s" totalImagesPullingTime="2.603450535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:01:48.918123604 +0000 UTC m=+923.873664584" watchObservedRunningTime="2026-06-06 21:01:48.92072414 +0000 UTC m=+923.876265122" Jun 06 21:01:48.936583 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:48.936545 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c984c879d-wb249" podStartSLOduration=2.77738234 podStartE2EDuration="4.936532528s" totalImagesPullingTime="2.159150188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:01:48.934727403 +0000 UTC m=+923.890268385" watchObservedRunningTime="2026-06-06 21:01:48.936532528 +0000 UTC m=+923.892073509" Jun 06 21:01:59.904304 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:59.904278 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" Jun 06 21:01:59.904652 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:59.904342 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:01:59.962799 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:59.962770 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c984c879d-wb249"] Jun 06 21:01:59.963025 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:01:59.963003 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-c984c879d-wb249" podUID="9c642a25-5403-484f-9934-09225dcdf023" containerName="manager" containerID="cri-o://8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb" gracePeriod=30 Jun 06 21:02:00.200532 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.200511 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:02:00.285387 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.285364 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c642a25-5403-484f-9934-09225dcdf023-webhook-cert\") pod \"9c642a25-5403-484f-9934-09225dcdf023\" (UID: \"9c642a25-5403-484f-9934-09225dcdf023\") " Jun 06 21:02:00.285387 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.285395 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr4f9\" (UniqueName: \"kubernetes.io/projected/9c642a25-5403-484f-9934-09225dcdf023-kube-api-access-sr4f9\") pod \"9c642a25-5403-484f-9934-09225dcdf023\" (UID: \"9c642a25-5403-484f-9934-09225dcdf023\") " Jun 06 21:02:00.287518 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.287491 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c642a25-5403-484f-9934-09225dcdf023-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9c642a25-5403-484f-9934-09225dcdf023" (UID: "9c642a25-5403-484f-9934-09225dcdf023"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 21:02:00.287628 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.287560 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c642a25-5403-484f-9934-09225dcdf023-kube-api-access-sr4f9" (OuterVolumeSpecName: "kube-api-access-sr4f9") pod "9c642a25-5403-484f-9934-09225dcdf023" (UID: "9c642a25-5403-484f-9934-09225dcdf023"). InnerVolumeSpecName "kube-api-access-sr4f9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:02:00.386525 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.386501 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c642a25-5403-484f-9934-09225dcdf023-webhook-cert\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:02:00.386525 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.386523 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr4f9\" (UniqueName: \"kubernetes.io/projected/9c642a25-5403-484f-9934-09225dcdf023-kube-api-access-sr4f9\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:02:00.955538 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.955500 2561 generic.go:356] "Generic (PLEG): container finished" podID="9c642a25-5403-484f-9934-09225dcdf023" containerID="8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb" exitCode=0 Jun 06 21:02:00.956020 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.955568 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c984c879d-wb249" Jun 06 21:02:00.956020 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.955582 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c984c879d-wb249" event={"ID":"9c642a25-5403-484f-9934-09225dcdf023","Type":"ContainerDied","Data":"8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb"} Jun 06 21:02:00.956020 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.955658 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c984c879d-wb249" event={"ID":"9c642a25-5403-484f-9934-09225dcdf023","Type":"ContainerDied","Data":"2eaac74ce6b59aae420e0cacba38ffe0ece29c752a6f2ed4bdcf9295eb57981f"} Jun 06 21:02:00.956020 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.955679 2561 scope.go:117] "RemoveContainer" containerID="8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb" Jun 06 21:02:00.968164 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.967973 2561 scope.go:117] "RemoveContainer" containerID="8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb" Jun 06 21:02:00.968219 ip-10-0-132-80 kubenswrapper[2561]: E0606 21:02:00.968201 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb\": container with ID starting with 8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb not found: ID does not exist" containerID="8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb" Jun 06 21:02:00.968254 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.968221 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb"} err="failed to get container status \"8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb\": rpc error: code = NotFound desc = could not find container \"8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb\": container with ID starting with 8e7ec95f78921bb28e797f654546506784793cba56b1436331331dadf7cb2afb not found: ID does not exist" Jun 06 21:02:00.976333 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.976311 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c984c879d-wb249"] Jun 06 21:02:00.980363 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:00.980343 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c984c879d-wb249"] Jun 06 21:02:01.437600 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:01.437570 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c642a25-5403-484f-9934-09225dcdf023" path="/var/lib/kubelet/pods/9c642a25-5403-484f-9934-09225dcdf023/volumes" Jun 06 21:02:19.859728 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:19.859694 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6897b7b5db-qhc7l"] Jun 06 21:02:19.865926 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:19.860689 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c642a25-5403-484f-9934-09225dcdf023" containerName="manager" Jun 06 21:02:19.865926 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:19.860718 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c642a25-5403-484f-9934-09225dcdf023" containerName="manager" Jun 06 21:02:19.865926 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:19.860908 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c642a25-5403-484f-9934-09225dcdf023" containerName="manager" Jun 06 21:02:19.865926 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:19.863718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6897b7b5db-qhc7l" Jun 06 21:02:19.866816 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:19.866781 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 06 21:02:19.866978 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:19.866894 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-75spc\"" Jun 06 21:02:19.877260 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:19.877237 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6897b7b5db-qhc7l"] Jun 06 21:02:19.931889 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:19.931863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a75970c-a151-4841-8d1c-64f65e6b8fbb-maas-api-tls\") pod \"maas-api-6897b7b5db-qhc7l\" (UID: \"4a75970c-a151-4841-8d1c-64f65e6b8fbb\") " pod="opendatahub/maas-api-6897b7b5db-qhc7l" Jun 06 21:02:19.932001 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:19.931915 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdmbn\" (UniqueName: \"kubernetes.io/projected/4a75970c-a151-4841-8d1c-64f65e6b8fbb-kube-api-access-wdmbn\") pod \"maas-api-6897b7b5db-qhc7l\" (UID: \"4a75970c-a151-4841-8d1c-64f65e6b8fbb\") " pod="opendatahub/maas-api-6897b7b5db-qhc7l" Jun 06 21:02:20.032880 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.032849 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdmbn\" (UniqueName: \"kubernetes.io/projected/4a75970c-a151-4841-8d1c-64f65e6b8fbb-kube-api-access-wdmbn\") pod \"maas-api-6897b7b5db-qhc7l\" (UID: \"4a75970c-a151-4841-8d1c-64f65e6b8fbb\") " pod="opendatahub/maas-api-6897b7b5db-qhc7l" Jun 06 21:02:20.033040 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.032942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a75970c-a151-4841-8d1c-64f65e6b8fbb-maas-api-tls\") pod \"maas-api-6897b7b5db-qhc7l\" (UID: \"4a75970c-a151-4841-8d1c-64f65e6b8fbb\") " pod="opendatahub/maas-api-6897b7b5db-qhc7l" Jun 06 21:02:20.035544 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.035518 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a75970c-a151-4841-8d1c-64f65e6b8fbb-maas-api-tls\") pod \"maas-api-6897b7b5db-qhc7l\" (UID: \"4a75970c-a151-4841-8d1c-64f65e6b8fbb\") " pod="opendatahub/maas-api-6897b7b5db-qhc7l" Jun 06 21:02:20.040482 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.040457 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdmbn\" (UniqueName: \"kubernetes.io/projected/4a75970c-a151-4841-8d1c-64f65e6b8fbb-kube-api-access-wdmbn\") pod \"maas-api-6897b7b5db-qhc7l\" (UID: \"4a75970c-a151-4841-8d1c-64f65e6b8fbb\") " pod="opendatahub/maas-api-6897b7b5db-qhc7l" Jun 06 21:02:20.176966 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.176937 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6897b7b5db-qhc7l" Jun 06 21:02:20.307720 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.307656 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6897b7b5db-qhc7l"] Jun 06 21:02:20.312105 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:02:20.312064 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a75970c_a151_4841_8d1c_64f65e6b8fbb.slice/crio-378d684330e22140d2b55db31dc36ce529d4d2b8f52d509bc78c17fad1aa2043 WatchSource:0}: Error finding container 378d684330e22140d2b55db31dc36ce529d4d2b8f52d509bc78c17fad1aa2043: Status 404 returned error can't find the container with id 378d684330e22140d2b55db31dc36ce529d4d2b8f52d509bc78c17fad1aa2043 Jun 06 21:02:20.313596 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.313576 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 21:02:20.338063 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.338031 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-vjmrh"] Jun 06 21:02:20.340921 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.340902 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-vjmrh" Jun 06 21:02:20.343527 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.343501 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 06 21:02:20.343635 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.343505 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-f4rmf\"" Jun 06 21:02:20.349863 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.349811 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-vjmrh"] Jun 06 21:02:20.357007 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.356987 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-h5r8c"] Jun 06 21:02:20.359172 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.359159 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-h5r8c" Jun 06 21:02:20.373445 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.373424 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-h5r8c"] Jun 06 21:02:20.436275 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.436201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltw5p\" (UniqueName: \"kubernetes.io/projected/401c20a4-3b88-4007-af35-0fe75593856e-kube-api-access-ltw5p\") pod \"payload-processing-7c6c859784-h5r8c\" (UID: \"401c20a4-3b88-4007-af35-0fe75593856e\") " pod="openshift-ingress/payload-processing-7c6c859784-h5r8c" Jun 06 21:02:20.537465 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.537433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltw5p\" (UniqueName: \"kubernetes.io/projected/401c20a4-3b88-4007-af35-0fe75593856e-kube-api-access-ltw5p\") pod \"payload-processing-7c6c859784-h5r8c\" (UID: \"401c20a4-3b88-4007-af35-0fe75593856e\") " pod="openshift-ingress/payload-processing-7c6c859784-h5r8c" Jun 06 21:02:20.537644 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.537477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzqvb\" (UniqueName: \"kubernetes.io/projected/7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb-kube-api-access-kzqvb\") pod \"payload-pre-processing-67d7689b65-vjmrh\" (UID: \"7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-vjmrh" Jun 06 21:02:20.545625 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.545597 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltw5p\" (UniqueName: \"kubernetes.io/projected/401c20a4-3b88-4007-af35-0fe75593856e-kube-api-access-ltw5p\") pod \"payload-processing-7c6c859784-h5r8c\" (UID: \"401c20a4-3b88-4007-af35-0fe75593856e\") " pod="openshift-ingress/payload-processing-7c6c859784-h5r8c" Jun 06 21:02:20.637966 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.637939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzqvb\" (UniqueName: \"kubernetes.io/projected/7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb-kube-api-access-kzqvb\") pod \"payload-pre-processing-67d7689b65-vjmrh\" (UID: \"7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-vjmrh" Jun 06 21:02:20.645747 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.645724 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzqvb\" (UniqueName: \"kubernetes.io/projected/7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb-kube-api-access-kzqvb\") pod \"payload-pre-processing-67d7689b65-vjmrh\" (UID: \"7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-vjmrh" Jun 06 21:02:20.652521 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.652500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-vjmrh" Jun 06 21:02:20.667822 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.667804 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-h5r8c" Jun 06 21:02:20.787993 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.787948 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-vjmrh"] Jun 06 21:02:20.791558 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:02:20.791526 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1eab73_b0a8_4a1a_b6c9_b4bdb699fddb.slice/crio-15a875c10030e0996c059d9628d2ecf56e14228f254623f25fd5854971647eac WatchSource:0}: Error finding container 15a875c10030e0996c059d9628d2ecf56e14228f254623f25fd5854971647eac: Status 404 returned error can't find the container with id 15a875c10030e0996c059d9628d2ecf56e14228f254623f25fd5854971647eac Jun 06 21:02:20.815731 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:20.815708 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-h5r8c"] Jun 06 21:02:20.817910 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:02:20.817884 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401c20a4_3b88_4007_af35_0fe75593856e.slice/crio-62ca5a98f7852f9f6a2acd67d58c4f9437694baf200d25fe10733745782ebe85 WatchSource:0}: Error finding container 62ca5a98f7852f9f6a2acd67d58c4f9437694baf200d25fe10733745782ebe85: Status 404 returned error can't find the container with id 62ca5a98f7852f9f6a2acd67d58c4f9437694baf200d25fe10733745782ebe85 Jun 06 21:02:21.047176 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:21.047048 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-h5r8c" event={"ID":"401c20a4-3b88-4007-af35-0fe75593856e","Type":"ContainerStarted","Data":"62ca5a98f7852f9f6a2acd67d58c4f9437694baf200d25fe10733745782ebe85"} Jun 06 21:02:21.048698 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:21.048642 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-vjmrh" event={"ID":"7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb","Type":"ContainerStarted","Data":"15a875c10030e0996c059d9628d2ecf56e14228f254623f25fd5854971647eac"} Jun 06 21:02:21.050011 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:21.049959 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6897b7b5db-qhc7l" event={"ID":"4a75970c-a151-4841-8d1c-64f65e6b8fbb","Type":"ContainerStarted","Data":"378d684330e22140d2b55db31dc36ce529d4d2b8f52d509bc78c17fad1aa2043"} Jun 06 21:02:22.058918 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:22.058885 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6897b7b5db-qhc7l" event={"ID":"4a75970c-a151-4841-8d1c-64f65e6b8fbb","Type":"ContainerStarted","Data":"cc34f61254752258ca598dc97013c1c31258ea8bfbec146a7e2c84dbb3592bf5"} Jun 06 21:02:22.059303 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:22.058991 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6897b7b5db-qhc7l" Jun 06 21:02:22.075323 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:22.075282 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6897b7b5db-qhc7l" podStartSLOduration=1.444688658 podStartE2EDuration="3.075268562s" totalImagesPullingTime="1.630579904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:02:22.073313504 +0000 UTC m=+957.028854496" watchObservedRunningTime="2026-06-06 21:02:22.075268562 +0000 UTC m=+957.030809543" Jun 06 21:02:23.065161 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:23.065127 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-h5r8c" event={"ID":"401c20a4-3b88-4007-af35-0fe75593856e","Type":"ContainerStarted","Data":"12dcd50e09c3b5ef0f5ae6703fd8890f47cf93981f772ba74448bccaf8ad6f68"} Jun 06 21:02:23.065600 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:23.065255 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-h5r8c" Jun 06 21:02:23.066897 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:23.066864 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-vjmrh" event={"ID":"7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb","Type":"ContainerStarted","Data":"85078b15548611b7520e83d0b76d874e508ee9804bca3815afa03da451b91136"} Jun 06 21:02:23.067059 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:23.067042 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-vjmrh" Jun 06 21:02:23.081204 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:23.081156 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-h5r8c" podStartSLOduration=1.4603261 podStartE2EDuration="3.081140074s" totalImagesPullingTime="1.620813974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:02:23.080017758 +0000 UTC m=+958.035558741" watchObservedRunningTime="2026-06-06 21:02:23.081140074 +0000 UTC m=+958.036681056" Jun 06 21:02:23.095409 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:23.095372 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-vjmrh" podStartSLOduration=1.452476551 podStartE2EDuration="3.095360055s" totalImagesPullingTime="1.642883504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:02:23.094432612 +0000 UTC m=+958.049973593" watchObservedRunningTime="2026-06-06 21:02:23.095360055 +0000 UTC m=+958.050901081" Jun 06 21:02:28.072895 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:28.072793 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6897b7b5db-qhc7l" Jun 06 21:02:28.093529 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:28.093496 2561 generic.go:356] "Generic (PLEG): container finished" podID="691e05fb-9a9b-4ee7-973a-c89a7e07971c" containerID="5a026e68d53e29181c11c3a84b31aa871e942342225fdcd96f98a4112052832f" exitCode=0 Jun 06 21:02:28.093661 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:28.093564 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" event={"ID":"691e05fb-9a9b-4ee7-973a-c89a7e07971c","Type":"ContainerDied","Data":"5a026e68d53e29181c11c3a84b31aa871e942342225fdcd96f98a4112052832f"} Jun 06 21:02:28.093944 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:28.093914 2561 scope.go:117] "RemoveContainer" containerID="5a026e68d53e29181c11c3a84b31aa871e942342225fdcd96f98a4112052832f" Jun 06 21:02:28.095011 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:28.094980 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 21:02:28.095113 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:28.095057 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 21:02:28.095113 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:28.095103 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 21:02:29.100201 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:29.100160 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" event={"ID":"691e05fb-9a9b-4ee7-973a-c89a7e07971c","Type":"ContainerStarted","Data":"cdf7eeec54ab6b88993bb8c973b2a8379de64f1fef6b25800d87c68a91662eb8"} Jun 06 21:02:29.849880 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:29.849828 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 21:02:29.850061 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:29.850034 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" containerID="cri-o://68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca" gracePeriod=30 Jun 06 21:02:29.867727 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:29.867691 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 21:02:29.868887 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:29.868862 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-47mm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jun 06 21:02:29.868973 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:29.868922 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" podUID="691e05fb-9a9b-4ee7-973a-c89a7e07971c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jun 06 21:02:30.867519 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:30.867484 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-47mm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jun 06 21:02:30.867918 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:30.867555 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" podUID="691e05fb-9a9b-4ee7-973a-c89a7e07971c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jun 06 21:02:31.536583 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:31.536558 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:31.640085 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:31.640006 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s8wc\" (UniqueName: \"kubernetes.io/projected/3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870-kube-api-access-6s8wc\") pod \"3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870\" (UID: \"3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870\") " Jun 06 21:02:31.642158 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:31.642118 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870-kube-api-access-6s8wc" (OuterVolumeSpecName: "kube-api-access-6s8wc") pod "3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" (UID: "3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870"). InnerVolumeSpecName "kube-api-access-6s8wc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:02:31.741491 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:31.741460 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s8wc\" (UniqueName: \"kubernetes.io/projected/3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870-kube-api-access-6s8wc\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:02:31.868284 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:31.868249 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-47mm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Jun 06 21:02:31.868635 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:31.868304 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" podUID="691e05fb-9a9b-4ee7-973a-c89a7e07971c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Jun 06 21:02:32.119089 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.119009 2561 generic.go:356] "Generic (PLEG): container finished" podID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerID="68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca" exitCode=143 Jun 06 21:02:32.119279 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.119092 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870","Type":"ContainerDied","Data":"68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca"} Jun 06 21:02:32.119279 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.119171 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870","Type":"ContainerDied","Data":"2ac3a454ce7431ea44dc6335eacb153bbea4a241b6122ceaa7d6f5a9225aa3d8"} Jun 06 21:02:32.119279 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.119200 2561 scope.go:117] "RemoveContainer" containerID="68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca" Jun 06 21:02:32.119441 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.119337 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:32.136031 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.136009 2561 scope.go:117] "RemoveContainer" containerID="68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca" Jun 06 21:02:32.136330 ip-10-0-132-80 kubenswrapper[2561]: E0606 21:02:32.136311 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca\": container with ID starting with 68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca not found: ID does not exist" containerID="68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca" Jun 06 21:02:32.136411 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.136339 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca"} err="failed to get container status \"68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca\": rpc error: code = NotFound desc = could not find container \"68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca\": container with ID starting with 68e456ad8c2c7f2ac220ab12bd55ff3c11af5357f2c91ddb00770305ce415dca not found: ID does not exist" Jun 06 21:02:32.147910 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.147889 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 21:02:32.151396 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.151373 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 21:02:32.175809 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.175781 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 21:02:32.176176 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.176159 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" Jun 06 21:02:32.176254 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.176180 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" Jun 06 21:02:32.176307 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.176275 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" containerName="keycloak" Jun 06 21:02:32.178896 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.178876 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:32.181335 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.181264 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 06 21:02:32.181335 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.181320 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 06 21:02:32.181335 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.181329 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 06 21:02:32.181548 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.181317 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 06 21:02:32.181548 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.181419 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-8wktq\"" Jun 06 21:02:32.186930 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.186910 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 21:02:32.246342 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.246309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttc77\" (UniqueName: \"kubernetes.io/projected/2d6fa69f-85e2-4670-b7bc-6e8726134c21-kube-api-access-ttc77\") pod \"maas-keycloak-0\" (UID: \"2d6fa69f-85e2-4670-b7bc-6e8726134c21\") " pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:32.246509 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.246371 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/2d6fa69f-85e2-4670-b7bc-6e8726134c21-test-realms\") pod \"maas-keycloak-0\" (UID: \"2d6fa69f-85e2-4670-b7bc-6e8726134c21\") " pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:32.347527 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.347491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttc77\" (UniqueName: \"kubernetes.io/projected/2d6fa69f-85e2-4670-b7bc-6e8726134c21-kube-api-access-ttc77\") pod \"maas-keycloak-0\" (UID: \"2d6fa69f-85e2-4670-b7bc-6e8726134c21\") " pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:32.347649 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.347568 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/2d6fa69f-85e2-4670-b7bc-6e8726134c21-test-realms\") pod \"maas-keycloak-0\" (UID: \"2d6fa69f-85e2-4670-b7bc-6e8726134c21\") " pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:32.348288 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.348269 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/2d6fa69f-85e2-4670-b7bc-6e8726134c21-test-realms\") pod \"maas-keycloak-0\" (UID: \"2d6fa69f-85e2-4670-b7bc-6e8726134c21\") " pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:32.355746 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.355724 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttc77\" (UniqueName: \"kubernetes.io/projected/2d6fa69f-85e2-4670-b7bc-6e8726134c21-kube-api-access-ttc77\") pod \"maas-keycloak-0\" (UID: \"2d6fa69f-85e2-4670-b7bc-6e8726134c21\") " pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:32.375580 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.375528 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 21:02:32.488809 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.488781 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:32.667626 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.667603 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 21:02:32.669872 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:02:32.669844 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6fa69f_85e2_4670_b7bc_6e8726134c21.slice/crio-5b107c21acfce70b93556d9ad0264f9634fe8fb2e2232a7e4f3193a7a2383df9 WatchSource:0}: Error finding container 5b107c21acfce70b93556d9ad0264f9634fe8fb2e2232a7e4f3193a7a2383df9: Status 404 returned error can't find the container with id 5b107c21acfce70b93556d9ad0264f9634fe8fb2e2232a7e4f3193a7a2383df9 Jun 06 21:02:32.878424 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:32.878392 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 21:02:33.126717 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:33.126682 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2d6fa69f-85e2-4670-b7bc-6e8726134c21","Type":"ContainerStarted","Data":"98c7f5d154f6b59aa5daf9b6ce4ae56f898bf9346409574a85efe74179c2d69a"} Jun 06 21:02:33.126927 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:33.126737 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2d6fa69f-85e2-4670-b7bc-6e8726134c21","Type":"ContainerStarted","Data":"5b107c21acfce70b93556d9ad0264f9634fe8fb2e2232a7e4f3193a7a2383df9"} Jun 06 21:02:33.127978 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:33.127949 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-47mm6" Jun 06 21:02:33.147060 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:33.147008 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.871935356 podStartE2EDuration="1.146989152s" totalImagesPullingTime="275.053796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:02:33.144127258 +0000 UTC m=+968.099668240" watchObservedRunningTime="2026-06-06 21:02:33.146989152 +0000 UTC m=+968.102530137" Jun 06 21:02:33.440318 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:33.440278 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870" path="/var/lib/kubelet/pods/3d6c25b3-6b4b-488e-ba41-ff6c8dbd7870/volumes" Jun 06 21:02:33.489848 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:33.489749 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:33.491601 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:33.491568 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:34.074039 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:34.074003 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-h5r8c" Jun 06 21:02:34.074717 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:34.074696 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-vjmrh" Jun 06 21:02:34.489934 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:34.489873 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:35.489770 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:35.489719 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:36.489601 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:36.489553 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:37.489488 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:37.489430 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:38.489673 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:38.489613 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:39.490017 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:39.489966 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:40.490177 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:40.490115 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:41.490051 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:41.490003 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:42.489183 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:42.489132 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:42.489664 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:42.489375 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:43.489716 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:43.489663 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:44.489682 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:44.489637 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:45.490337 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:45.490239 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 21:02:46.613586 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:46.613556 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 06 21:02:46.631022 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:46.630976 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2d6fa69f-85e2-4670-b7bc-6e8726134c21" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 21:02:56.620164 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:02:56.620118 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 06 21:03:30.276683 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.276650 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb"] Jun 06 21:03:30.281719 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.281696 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.284581 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.284559 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 06 21:03:30.285610 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.285582 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 06 21:03:30.286170 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.285879 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 06 21:03:30.286170 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.285886 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2zx5s\"" Jun 06 21:03:30.288255 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.288231 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb"] Jun 06 21:03:30.357438 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.357408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb8b6e6-e3fa-4656-8d37-303c2259341d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.357438 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.357441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb8b6e6-e3fa-4656-8d37-303c2259341d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.357633 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.357459 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb8b6e6-e3fa-4656-8d37-303c2259341d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.357633 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.357478 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4p9n\" (UniqueName: \"kubernetes.io/projected/deb8b6e6-e3fa-4656-8d37-303c2259341d-kube-api-access-r4p9n\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.357704 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.357621 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/deb8b6e6-e3fa-4656-8d37-303c2259341d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.357704 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.357658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb8b6e6-e3fa-4656-8d37-303c2259341d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.458889 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.458856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb8b6e6-e3fa-4656-8d37-303c2259341d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.458889 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.458888 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb8b6e6-e3fa-4656-8d37-303c2259341d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.459141 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.458910 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4p9n\" (UniqueName: \"kubernetes.io/projected/deb8b6e6-e3fa-4656-8d37-303c2259341d-kube-api-access-r4p9n\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.459141 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.458989 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/deb8b6e6-e3fa-4656-8d37-303c2259341d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.459141 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.459013 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb8b6e6-e3fa-4656-8d37-303c2259341d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.459141 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.459063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb8b6e6-e3fa-4656-8d37-303c2259341d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.459344 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.459321 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb8b6e6-e3fa-4656-8d37-303c2259341d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.459393 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.459352 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/deb8b6e6-e3fa-4656-8d37-303c2259341d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.459439 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.459419 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb8b6e6-e3fa-4656-8d37-303c2259341d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.461256 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.461229 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb8b6e6-e3fa-4656-8d37-303c2259341d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.461419 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.461403 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb8b6e6-e3fa-4656-8d37-303c2259341d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.466639 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.466620 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4p9n\" (UniqueName: \"kubernetes.io/projected/deb8b6e6-e3fa-4656-8d37-303c2259341d-kube-api-access-r4p9n\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fwlwb\" (UID: \"deb8b6e6-e3fa-4656-8d37-303c2259341d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.594322 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.594234 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:03:30.729021 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:30.728991 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb"] Jun 06 21:03:30.731678 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:03:30.731647 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb8b6e6_e3fa_4656_8d37_303c2259341d.slice/crio-91528f4e7a721608d765af39983b99a9699c4f06d620a61ed829481f02646966 WatchSource:0}: Error finding container 91528f4e7a721608d765af39983b99a9699c4f06d620a61ed829481f02646966: Status 404 returned error can't find the container with id 91528f4e7a721608d765af39983b99a9699c4f06d620a61ed829481f02646966 Jun 06 21:03:31.420532 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:31.420488 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" event={"ID":"deb8b6e6-e3fa-4656-8d37-303c2259341d","Type":"ContainerStarted","Data":"91528f4e7a721608d765af39983b99a9699c4f06d620a61ed829481f02646966"} Jun 06 21:03:34.436942 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:03:34.436908 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" event={"ID":"deb8b6e6-e3fa-4656-8d37-303c2259341d","Type":"ContainerStarted","Data":"abebf77a85847a9452a554d4ceb76b7fdb962dcfbb009c5c3639151c638425ca"} Jun 06 21:04:18.891247 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:18.891175 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9"] Jun 06 21:04:18.911129 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:18.911105 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9"] Jun 06 21:04:18.911261 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:18.911197 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:18.914093 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:18.914072 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 06 21:04:18.948383 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:18.948359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98de4bcb-86a3-4098-b2e9-1a7dc4240996-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:18.948481 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:18.948398 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98de4bcb-86a3-4098-b2e9-1a7dc4240996-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:18.948481 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:18.948446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98de4bcb-86a3-4098-b2e9-1a7dc4240996-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:18.948553 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:18.948502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz75r\" (UniqueName: \"kubernetes.io/projected/98de4bcb-86a3-4098-b2e9-1a7dc4240996-kube-api-access-nz75r\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:18.948553 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:18.948530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98de4bcb-86a3-4098-b2e9-1a7dc4240996-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:18.948553 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:18.948546 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/98de4bcb-86a3-4098-b2e9-1a7dc4240996-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.049840 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.049798 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98de4bcb-86a3-4098-b2e9-1a7dc4240996-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.049972 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.049906 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz75r\" (UniqueName: \"kubernetes.io/projected/98de4bcb-86a3-4098-b2e9-1a7dc4240996-kube-api-access-nz75r\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.049972 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.049958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98de4bcb-86a3-4098-b2e9-1a7dc4240996-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.050099 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.049983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/98de4bcb-86a3-4098-b2e9-1a7dc4240996-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.050099 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.050044 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98de4bcb-86a3-4098-b2e9-1a7dc4240996-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.050099 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.050085 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98de4bcb-86a3-4098-b2e9-1a7dc4240996-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.050543 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.050518 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98de4bcb-86a3-4098-b2e9-1a7dc4240996-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.050543 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.050554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/98de4bcb-86a3-4098-b2e9-1a7dc4240996-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.050755 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.050595 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98de4bcb-86a3-4098-b2e9-1a7dc4240996-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.053024 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.052998 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98de4bcb-86a3-4098-b2e9-1a7dc4240996-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.053154 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.053133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98de4bcb-86a3-4098-b2e9-1a7dc4240996-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.057853 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.057818 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz75r\" (UniqueName: \"kubernetes.io/projected/98de4bcb-86a3-4098-b2e9-1a7dc4240996-kube-api-access-nz75r\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9\" (UID: \"98de4bcb-86a3-4098-b2e9-1a7dc4240996\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.221874 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.221824 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:19.351260 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.351233 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9"] Jun 06 21:04:19.353198 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:04:19.353174 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98de4bcb_86a3_4098_b2e9_1a7dc4240996.slice/crio-22dcb9fcfe9f31a3316cc36515c60047d158e53e7b8f3b2bf903acc1c54b2e04 WatchSource:0}: Error finding container 22dcb9fcfe9f31a3316cc36515c60047d158e53e7b8f3b2bf903acc1c54b2e04: Status 404 returned error can't find the container with id 22dcb9fcfe9f31a3316cc36515c60047d158e53e7b8f3b2bf903acc1c54b2e04 Jun 06 21:04:19.647536 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.647457 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" event={"ID":"98de4bcb-86a3-4098-b2e9-1a7dc4240996","Type":"ContainerStarted","Data":"1606d18acfc6152ce048018484293faf25ff39face75ba1a3d095f3b840e22df"} Jun 06 21:04:19.647536 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:19.647508 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" event={"ID":"98de4bcb-86a3-4098-b2e9-1a7dc4240996","Type":"ContainerStarted","Data":"22dcb9fcfe9f31a3316cc36515c60047d158e53e7b8f3b2bf903acc1c54b2e04"} Jun 06 21:04:21.658211 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:21.658176 2561 generic.go:356] "Generic (PLEG): container finished" podID="98de4bcb-86a3-4098-b2e9-1a7dc4240996" containerID="1606d18acfc6152ce048018484293faf25ff39face75ba1a3d095f3b840e22df" exitCode=0 Jun 06 21:04:21.658542 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:21.658237 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" event={"ID":"98de4bcb-86a3-4098-b2e9-1a7dc4240996","Type":"ContainerDied","Data":"1606d18acfc6152ce048018484293faf25ff39face75ba1a3d095f3b840e22df"} Jun 06 21:04:23.670495 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:23.670461 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" event={"ID":"98de4bcb-86a3-4098-b2e9-1a7dc4240996","Type":"ContainerStarted","Data":"d9106267d2bf9364d55209b8fba5b85c04e8df9599c0f7ffd8795eed8603745c"} Jun 06 21:04:23.690229 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:23.690182 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" podStartSLOduration=3.261356412 podStartE2EDuration="5.690168455s" totalImagesPullingTime="1.00582524s" totalInitContainerRuntime="1.422986803s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:04:23.687375789 +0000 UTC m=+1078.642916783" watchObservedRunningTime="2026-06-06 21:04:23.690168455 +0000 UTC m=+1078.645709436" Jun 06 21:04:29.222036 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:29.222003 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:29.222401 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:29.222069 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:29.234274 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:29.234251 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:29.709710 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:29.709685 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9" Jun 06 21:04:31.485610 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.485582 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk"] Jun 06 21:04:31.491751 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.491728 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.494332 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.494313 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 06 21:04:31.500746 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.500725 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk"] Jun 06 21:04:31.550181 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.550151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6lnh\" (UniqueName: \"kubernetes.io/projected/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-kube-api-access-j6lnh\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.550319 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.550199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.550392 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.550351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.550485 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.550385 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.550485 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.550420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.550485 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.550444 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.650863 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.650819 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6lnh\" (UniqueName: \"kubernetes.io/projected/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-kube-api-access-j6lnh\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.650998 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.650880 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.650998 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.650973 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.651107 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.651000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.651107 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.651026 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.651107 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.651049 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.651541 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.651519 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.651627 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.651532 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.651686 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.651638 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.653754 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.653721 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.653754 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.653742 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.659460 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.659416 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6lnh\" (UniqueName: \"kubernetes.io/projected/60e47612-8ef1-4d6c-a8bf-d56dcfc9943d-kube-api-access-j6lnh\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-tmxbk\" (UID: \"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.804191 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.804001 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:31.932986 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:31.932959 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk"] Jun 06 21:04:31.933933 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:04:31.933906 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e47612_8ef1_4d6c_a8bf_d56dcfc9943d.slice/crio-4d176d543b7dc51deff083e84801276ea114cd16479ab73296dee78a35db49bf WatchSource:0}: Error finding container 4d176d543b7dc51deff083e84801276ea114cd16479ab73296dee78a35db49bf: Status 404 returned error can't find the container with id 4d176d543b7dc51deff083e84801276ea114cd16479ab73296dee78a35db49bf Jun 06 21:04:32.714471 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:32.714434 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" event={"ID":"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d","Type":"ContainerStarted","Data":"c68ceaa0f4d79ce539545efeec1d23a70340a7c6f0057610b866e8362a1c9060"} Jun 06 21:04:32.714862 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:32.714482 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" event={"ID":"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d","Type":"ContainerStarted","Data":"4d176d543b7dc51deff083e84801276ea114cd16479ab73296dee78a35db49bf"} Jun 06 21:04:33.720632 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:33.720581 2561 generic.go:356] "Generic (PLEG): container finished" podID="60e47612-8ef1-4d6c-a8bf-d56dcfc9943d" containerID="c68ceaa0f4d79ce539545efeec1d23a70340a7c6f0057610b866e8362a1c9060" exitCode=0 Jun 06 21:04:33.721073 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:33.720715 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" event={"ID":"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d","Type":"ContainerDied","Data":"c68ceaa0f4d79ce539545efeec1d23a70340a7c6f0057610b866e8362a1c9060"} Jun 06 21:04:34.727233 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:34.727199 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" event={"ID":"60e47612-8ef1-4d6c-a8bf-d56dcfc9943d","Type":"ContainerStarted","Data":"1ac8cd6d16e9a98b74623cdc9dd993c5b88528c59427c0a3db387ca526e6a68e"} Jun 06 21:04:34.752029 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:34.751974 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" podStartSLOduration=2.221633961 podStartE2EDuration="3.7519597s" totalImagesPullingTime="178.010923ms" totalInitContainerRuntime="1.352314816s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:04:34.751062509 +0000 UTC m=+1089.706603489" watchObservedRunningTime="2026-06-06 21:04:34.7519597 +0000 UTC m=+1089.707500691" Jun 06 21:04:41.805105 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:41.805057 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:41.805476 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:41.805115 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:41.817591 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:41.817568 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:42.777062 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:42.777037 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-tmxbk" Jun 06 21:04:47.792746 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:47.792667 2561 generic.go:356] "Generic (PLEG): container finished" podID="deb8b6e6-e3fa-4656-8d37-303c2259341d" containerID="abebf77a85847a9452a554d4ceb76b7fdb962dcfbb009c5c3639151c638425ca" exitCode=0 Jun 06 21:04:47.792746 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:47.792716 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" event={"ID":"deb8b6e6-e3fa-4656-8d37-303c2259341d","Type":"ContainerDied","Data":"abebf77a85847a9452a554d4ceb76b7fdb962dcfbb009c5c3639151c638425ca"} Jun 06 21:04:48.799495 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:48.799459 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" event={"ID":"deb8b6e6-e3fa-4656-8d37-303c2259341d","Type":"ContainerStarted","Data":"9f5bf68cb2499784a0962f97971ee58b86517e136982d9481d20c2075d4e431d"} Jun 06 21:04:48.826194 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:48.826149 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" podStartSLOduration=1.977643917 podStartE2EDuration="1m18.8261342s" totalImagesPullingTime="3.543353611s" totalInitContainerRuntime="1m13.305136672s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:03:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:04:48.825476835 +0000 UTC m=+1103.781017816" watchObservedRunningTime="2026-06-06 21:04:48.8261342 +0000 UTC m=+1103.781675181" Jun 06 21:04:50.594405 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:50.594372 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:04:50.594811 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:50.594424 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:04:50.606858 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:50.606825 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:04:50.819858 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:04:50.819817 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fwlwb" Jun 06 21:07:02.112875 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.112827 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c4db5fc79-5nm5j"] Jun 06 21:07:02.113381 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.113029 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" podUID="e671e1cb-36a9-49ac-8b41-5267f499f182" containerName="manager" containerID="cri-o://c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a" gracePeriod=30 Jun 06 21:07:02.368261 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.368211 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" Jun 06 21:07:02.391964 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.391936 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e671e1cb-36a9-49ac-8b41-5267f499f182-webhook-cert\") pod \"e671e1cb-36a9-49ac-8b41-5267f499f182\" (UID: \"e671e1cb-36a9-49ac-8b41-5267f499f182\") " Jun 06 21:07:02.392100 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.391986 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlqcd\" (UniqueName: \"kubernetes.io/projected/e671e1cb-36a9-49ac-8b41-5267f499f182-kube-api-access-dlqcd\") pod \"e671e1cb-36a9-49ac-8b41-5267f499f182\" (UID: \"e671e1cb-36a9-49ac-8b41-5267f499f182\") " Jun 06 21:07:02.394132 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.394102 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e671e1cb-36a9-49ac-8b41-5267f499f182-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e671e1cb-36a9-49ac-8b41-5267f499f182" (UID: "e671e1cb-36a9-49ac-8b41-5267f499f182"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 21:07:02.394232 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.394134 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e671e1cb-36a9-49ac-8b41-5267f499f182-kube-api-access-dlqcd" (OuterVolumeSpecName: "kube-api-access-dlqcd") pod "e671e1cb-36a9-49ac-8b41-5267f499f182" (UID: "e671e1cb-36a9-49ac-8b41-5267f499f182"). InnerVolumeSpecName "kube-api-access-dlqcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:07:02.420431 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.420404 2561 generic.go:356] "Generic (PLEG): container finished" podID="e671e1cb-36a9-49ac-8b41-5267f499f182" containerID="c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a" exitCode=0 Jun 06 21:07:02.420538 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.420459 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" Jun 06 21:07:02.420538 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.420486 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" event={"ID":"e671e1cb-36a9-49ac-8b41-5267f499f182","Type":"ContainerDied","Data":"c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a"} Jun 06 21:07:02.420538 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.420538 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db5fc79-5nm5j" event={"ID":"e671e1cb-36a9-49ac-8b41-5267f499f182","Type":"ContainerDied","Data":"9f8fa23979969935b5e0dad397562cc0df7ebfd709d2131d23355441f261064d"} Jun 06 21:07:02.420651 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.420559 2561 scope.go:117] "RemoveContainer" containerID="c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a" Jun 06 21:07:02.436124 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.436099 2561 scope.go:117] "RemoveContainer" containerID="c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a" Jun 06 21:07:02.436456 ip-10-0-132-80 kubenswrapper[2561]: E0606 21:07:02.436430 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a\": container with ID starting with c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a not found: ID does not exist" containerID="c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a" Jun 06 21:07:02.436516 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.436467 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a"} err="failed to get container status \"c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a\": rpc error: code = NotFound desc = could not find container \"c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a\": container with ID starting with c65be7f7e07e109d233341c298a532de5c60d3eb05820634b40702bc1f8a200a not found: ID does not exist" Jun 06 21:07:02.449588 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.449562 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c4db5fc79-5nm5j"] Jun 06 21:07:02.451177 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.451158 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c4db5fc79-5nm5j"] Jun 06 21:07:02.493374 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.493352 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e671e1cb-36a9-49ac-8b41-5267f499f182-webhook-cert\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:07:02.493463 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:02.493375 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlqcd\" (UniqueName: \"kubernetes.io/projected/e671e1cb-36a9-49ac-8b41-5267f499f182-kube-api-access-dlqcd\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:07:03.200329 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.200300 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c4db5fc79-rv6vq"] Jun 06 21:07:03.200699 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.200656 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e671e1cb-36a9-49ac-8b41-5267f499f182" containerName="manager" Jun 06 21:07:03.200699 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.200665 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e671e1cb-36a9-49ac-8b41-5267f499f182" containerName="manager" Jun 06 21:07:03.200770 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.200743 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e671e1cb-36a9-49ac-8b41-5267f499f182" containerName="manager" Jun 06 21:07:03.205116 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.205097 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" Jun 06 21:07:03.207618 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.207592 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 06 21:07:03.208655 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.208639 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 06 21:07:03.208728 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.208675 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hqmwk\"" Jun 06 21:07:03.213231 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.213204 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c4db5fc79-rv6vq"] Jun 06 21:07:03.300882 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.300855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7847k\" (UniqueName: \"kubernetes.io/projected/e644a7fe-ce5a-426c-a18f-1caf33fbb529-kube-api-access-7847k\") pod \"maas-controller-6c4db5fc79-rv6vq\" (UID: \"e644a7fe-ce5a-426c-a18f-1caf33fbb529\") " pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" Jun 06 21:07:03.301003 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.300931 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e644a7fe-ce5a-426c-a18f-1caf33fbb529-webhook-cert\") pod \"maas-controller-6c4db5fc79-rv6vq\" (UID: \"e644a7fe-ce5a-426c-a18f-1caf33fbb529\") " pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" Jun 06 21:07:03.401548 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.401516 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e644a7fe-ce5a-426c-a18f-1caf33fbb529-webhook-cert\") pod \"maas-controller-6c4db5fc79-rv6vq\" (UID: \"e644a7fe-ce5a-426c-a18f-1caf33fbb529\") " pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" Jun 06 21:07:03.401692 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.401567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7847k\" (UniqueName: \"kubernetes.io/projected/e644a7fe-ce5a-426c-a18f-1caf33fbb529-kube-api-access-7847k\") pod \"maas-controller-6c4db5fc79-rv6vq\" (UID: \"e644a7fe-ce5a-426c-a18f-1caf33fbb529\") " pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" Jun 06 21:07:03.403875 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.403827 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e644a7fe-ce5a-426c-a18f-1caf33fbb529-webhook-cert\") pod \"maas-controller-6c4db5fc79-rv6vq\" (UID: \"e644a7fe-ce5a-426c-a18f-1caf33fbb529\") " pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" Jun 06 21:07:03.409866 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.409815 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7847k\" (UniqueName: \"kubernetes.io/projected/e644a7fe-ce5a-426c-a18f-1caf33fbb529-kube-api-access-7847k\") pod \"maas-controller-6c4db5fc79-rv6vq\" (UID: \"e644a7fe-ce5a-426c-a18f-1caf33fbb529\") " pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" Jun 06 21:07:03.436960 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.436930 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e671e1cb-36a9-49ac-8b41-5267f499f182" path="/var/lib/kubelet/pods/e671e1cb-36a9-49ac-8b41-5267f499f182/volumes" Jun 06 21:07:03.515762 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.515696 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" Jun 06 21:07:03.642663 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:03.642642 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c4db5fc79-rv6vq"] Jun 06 21:07:03.644798 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:07:03.644762 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode644a7fe_ce5a_426c_a18f_1caf33fbb529.slice/crio-47dc4fdd417c51dedebc437c026d2cf1e207d71e9bc72da748743d0ad09781fd WatchSource:0}: Error finding container 47dc4fdd417c51dedebc437c026d2cf1e207d71e9bc72da748743d0ad09781fd: Status 404 returned error can't find the container with id 47dc4fdd417c51dedebc437c026d2cf1e207d71e9bc72da748743d0ad09781fd Jun 06 21:07:04.432021 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:04.431931 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" event={"ID":"e644a7fe-ce5a-426c-a18f-1caf33fbb529","Type":"ContainerStarted","Data":"1e8efaf6be50af6e2615fd11542cbf3e05c36ab2b475d28480dcd0a7a2eb6359"} Jun 06 21:07:04.432021 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:04.431981 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" event={"ID":"e644a7fe-ce5a-426c-a18f-1caf33fbb529","Type":"ContainerStarted","Data":"47dc4fdd417c51dedebc437c026d2cf1e207d71e9bc72da748743d0ad09781fd"} Jun 06 21:07:04.432021 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:04.432011 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" Jun 06 21:07:04.448090 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:04.448045 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" podStartSLOduration=0.924574203 podStartE2EDuration="1.448030668s" totalImagesPullingTime="523.456465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:07:04.447165334 +0000 UTC m=+1239.402706315" watchObservedRunningTime="2026-06-06 21:07:04.448030668 +0000 UTC m=+1239.403571673" Jun 06 21:07:15.442171 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:07:15.442084 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c4db5fc79-rv6vq" Jun 06 21:28:08.973603 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:08.973569 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw"] Jun 06 21:28:08.975663 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:08.975646 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:08.978409 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:08.978387 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7dfacf4e-openshift-default-dockercfg-5rwz8\"" Jun 06 21:28:08.995222 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:08.995199 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw"] Jun 06 21:28:09.080920 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.080869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-envoy\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.080920 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.080912 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istiod-ca-cert\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.081191 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.080945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-credential-socket\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.081191 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.081054 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-podinfo\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.081191 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.081124 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-workload-socket\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.081191 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.081156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-data\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.081191 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.081172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmxww\" (UniqueName: \"kubernetes.io/projected/3c7b4ec7-a843-41dc-be23-39343b2d2c56-kube-api-access-qmxww\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.081445 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.081199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-workload-certs\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.081445 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.081237 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-token\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.182178 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.182145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-podinfo\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.182349 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.182218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-workload-socket\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.182349 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.182247 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-data\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.182349 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.182271 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmxww\" (UniqueName: \"kubernetes.io/projected/3c7b4ec7-a843-41dc-be23-39343b2d2c56-kube-api-access-qmxww\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.182349 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.182309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-workload-certs\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.182349 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.182351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-token\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.182828 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.182422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-envoy\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.182828 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.182449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istiod-ca-cert\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.182828 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.182478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-credential-socket\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.182828 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.182724 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-data\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.182828 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.182759 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-workload-socket\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.183128 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.183101 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-credential-socket\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.183262 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.183238 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-workload-certs\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.183513 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.183490 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istiod-ca-cert\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.185110 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.185088 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-envoy\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.185250 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.185232 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-podinfo\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.203767 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.203746 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-token\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.204709 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.204686 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmxww\" (UniqueName: \"kubernetes.io/projected/3c7b4ec7-a843-41dc-be23-39343b2d2c56-kube-api-access-qmxww\") pod \"e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.286999 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.286928 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:09.421285 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.421197 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw"] Jun 06 21:28:09.423570 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:28:09.423543 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7b4ec7_a843_41dc_be23_39343b2d2c56.slice/crio-7b602e5f11b0a69a4c2efce790ac2b9053bef0fd23579e9ad8fc7a7d42ac3ac0 WatchSource:0}: Error finding container 7b602e5f11b0a69a4c2efce790ac2b9053bef0fd23579e9ad8fc7a7d42ac3ac0: Status 404 returned error can't find the container with id 7b602e5f11b0a69a4c2efce790ac2b9053bef0fd23579e9ad8fc7a7d42ac3ac0 Jun 06 21:28:09.425668 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.425641 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 21:28:09.425733 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.425708 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 21:28:09.425769 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:09.425737 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 21:28:10.321944 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:10.321908 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" event={"ID":"3c7b4ec7-a843-41dc-be23-39343b2d2c56","Type":"ContainerStarted","Data":"225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b"} Jun 06 21:28:10.322310 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:10.321958 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" event={"ID":"3c7b4ec7-a843-41dc-be23-39343b2d2c56","Type":"ContainerStarted","Data":"7b602e5f11b0a69a4c2efce790ac2b9053bef0fd23579e9ad8fc7a7d42ac3ac0"} Jun 06 21:28:10.352054 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:10.352006 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" podStartSLOduration=2.351990272 podStartE2EDuration="2.351990272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:28:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:28:10.350306474 +0000 UTC m=+2505.305847467" watchObservedRunningTime="2026-06-06 21:28:10.351990272 +0000 UTC m=+2505.307531252" Jun 06 21:28:11.287521 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:11.287483 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:11.292539 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:11.292517 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:11.333625 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:11.333601 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:11.334537 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:11.334517 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:15.394824 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:15.394744 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw"] Jun 06 21:28:15.395322 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:15.394931 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" podUID="3c7b4ec7-a843-41dc-be23-39343b2d2c56" containerName="istio-proxy" containerID="cri-o://225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b" gracePeriod=30 Jun 06 21:28:20.643457 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.643431 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:20.788239 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788156 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-data\") pod \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " Jun 06 21:28:20.788239 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788216 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-credential-socket\") pod \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " Jun 06 21:28:20.788435 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788261 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-token\") pod \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " Jun 06 21:28:20.788435 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788304 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-podinfo\") pod \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " Jun 06 21:28:20.788435 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788329 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmxww\" (UniqueName: \"kubernetes.io/projected/3c7b4ec7-a843-41dc-be23-39343b2d2c56-kube-api-access-qmxww\") pod \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " Jun 06 21:28:20.788435 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788382 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-workload-socket\") pod \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " Jun 06 21:28:20.788435 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788421 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-envoy\") pod \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " Jun 06 21:28:20.788680 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788445 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istiod-ca-cert\") pod \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " Jun 06 21:28:20.788680 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788477 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-workload-certs\") pod \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\" (UID: \"3c7b4ec7-a843-41dc-be23-39343b2d2c56\") " Jun 06 21:28:20.788680 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788520 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c7b4ec7-a843-41dc-be23-39343b2d2c56" (UID: "3c7b4ec7-a843-41dc-be23-39343b2d2c56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 21:28:20.788680 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788647 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c7b4ec7-a843-41dc-be23-39343b2d2c56" (UID: "3c7b4ec7-a843-41dc-be23-39343b2d2c56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 21:28:20.788914 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788434 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c7b4ec7-a843-41dc-be23-39343b2d2c56" (UID: "3c7b4ec7-a843-41dc-be23-39343b2d2c56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 21:28:20.788914 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788784 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-workload-socket\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:20.788914 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788803 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-credential-socket\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:20.788914 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788889 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c7b4ec7-a843-41dc-be23-39343b2d2c56" (UID: "3c7b4ec7-a843-41dc-be23-39343b2d2c56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 21:28:20.789082 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.788933 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c7b4ec7-a843-41dc-be23-39343b2d2c56" (UID: "3c7b4ec7-a843-41dc-be23-39343b2d2c56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 21:28:20.790588 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.790563 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7b4ec7-a843-41dc-be23-39343b2d2c56-kube-api-access-qmxww" (OuterVolumeSpecName: "kube-api-access-qmxww") pod "3c7b4ec7-a843-41dc-be23-39343b2d2c56" (UID: "3c7b4ec7-a843-41dc-be23-39343b2d2c56"). InnerVolumeSpecName "kube-api-access-qmxww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:28:20.790688 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.790571 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c7b4ec7-a843-41dc-be23-39343b2d2c56" (UID: "3c7b4ec7-a843-41dc-be23-39343b2d2c56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:28:20.790855 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.790821 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c7b4ec7-a843-41dc-be23-39343b2d2c56" (UID: "3c7b4ec7-a843-41dc-be23-39343b2d2c56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 06 21:28:20.790924 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.790854 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c7b4ec7-a843-41dc-be23-39343b2d2c56" (UID: "3c7b4ec7-a843-41dc-be23-39343b2d2c56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 21:28:20.889383 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.889350 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-envoy\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:20.889383 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.889384 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istiod-ca-cert\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:20.889383 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.889394 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-workload-certs\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:20.889554 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.889402 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-data\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:20.889554 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.889410 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-token\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:20.889554 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.889418 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7b4ec7-a843-41dc-be23-39343b2d2c56-istio-podinfo\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:20.889554 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:20.889426 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmxww\" (UniqueName: \"kubernetes.io/projected/3c7b4ec7-a843-41dc-be23-39343b2d2c56-kube-api-access-qmxww\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:21.384517 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.384484 2561 generic.go:356] "Generic (PLEG): container finished" podID="3c7b4ec7-a843-41dc-be23-39343b2d2c56" containerID="225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b" exitCode=0 Jun 06 21:28:21.384668 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.384529 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" Jun 06 21:28:21.384668 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.384560 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" event={"ID":"3c7b4ec7-a843-41dc-be23-39343b2d2c56","Type":"ContainerDied","Data":"225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b"} Jun 06 21:28:21.384668 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.384610 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw" event={"ID":"3c7b4ec7-a843-41dc-be23-39343b2d2c56","Type":"ContainerDied","Data":"7b602e5f11b0a69a4c2efce790ac2b9053bef0fd23579e9ad8fc7a7d42ac3ac0"} Jun 06 21:28:21.384668 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.384634 2561 scope.go:117] "RemoveContainer" containerID="225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b" Jun 06 21:28:21.394620 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.394603 2561 scope.go:117] "RemoveContainer" containerID="225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b" Jun 06 21:28:21.394923 ip-10-0-132-80 kubenswrapper[2561]: E0606 21:28:21.394902 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b\": container with ID starting with 225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b not found: ID does not exist" containerID="225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b" Jun 06 21:28:21.394982 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.394929 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b"} err="failed to get container status \"225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b\": rpc error: code = NotFound desc = could not find container \"225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b\": container with ID starting with 225ea63ad981234247d1b3e2698e488dbf505203026374ec9fd9fd4834ebf50b not found: ID does not exist" Jun 06 21:28:21.407688 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.407662 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw"] Jun 06 21:28:21.412207 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.412187 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7dfacf4e-openshift-default-7469dffdc8-qpwrw"] Jun 06 21:28:21.438167 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.438137 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c7b4ec7-a843-41dc-be23-39343b2d2c56" path="/var/lib/kubelet/pods/3c7b4ec7-a843-41dc-be23-39343b2d2c56/volumes" Jun 06 21:28:21.572012 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.571984 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc"] Jun 06 21:28:21.572403 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.572388 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7b4ec7-a843-41dc-be23-39343b2d2c56" containerName="istio-proxy" Jun 06 21:28:21.572472 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.572407 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7b4ec7-a843-41dc-be23-39343b2d2c56" containerName="istio-proxy" Jun 06 21:28:21.572509 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.572501 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7b4ec7-a843-41dc-be23-39343b2d2c56" containerName="istio-proxy" Jun 06 21:28:21.575240 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.575219 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.578084 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.578065 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-174d172d-openshift-default-dockercfg-8zpzn\"" Jun 06 21:28:21.589341 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.589316 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc"] Jun 06 21:28:21.697166 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.697137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-data\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.697613 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.697187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-workload-certs\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.697613 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.697210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss8sz\" (UniqueName: \"kubernetes.io/projected/f4577f92-bbb4-4059-87fb-d5af9e862e75-kube-api-access-ss8sz\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.697613 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.697302 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-credential-socket\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.697613 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.697349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-podinfo\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.697613 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.697378 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-workload-socket\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.697613 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.697402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-token\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.697613 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.697464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4577f92-bbb4-4059-87fb-d5af9e862e75-istiod-ca-cert\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.697613 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.697504 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-envoy\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798091 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-data\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798302 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-workload-certs\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798302 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798133 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss8sz\" (UniqueName: \"kubernetes.io/projected/f4577f92-bbb4-4059-87fb-d5af9e862e75-kube-api-access-ss8sz\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798302 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798167 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-credential-socket\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798302 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798184 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-podinfo\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798302 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798201 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-workload-socket\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798302 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-token\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798302 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798240 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4577f92-bbb4-4059-87fb-d5af9e862e75-istiod-ca-cert\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798625 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-envoy\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798625 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798541 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-workload-certs\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798744 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798724 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-credential-socket\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798817 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798792 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-workload-socket\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.798905 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.798815 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-data\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.799146 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.799128 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4577f92-bbb4-4059-87fb-d5af9e862e75-istiod-ca-cert\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.800487 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.800467 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-envoy\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.800812 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.800791 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-podinfo\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.806647 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.806628 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-token\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.806861 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.806822 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss8sz\" (UniqueName: \"kubernetes.io/projected/f4577f92-bbb4-4059-87fb-d5af9e862e75-kube-api-access-ss8sz\") pod \"e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:21.886493 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:21.886462 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:22.021169 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:22.021142 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc"] Jun 06 21:28:22.023303 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:28:22.023270 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4577f92_bbb4_4059_87fb_d5af9e862e75.slice/crio-bb678c348f91b7f8248e993e237bba17a3571ae6fb90fcf069c033df17249e5d WatchSource:0}: Error finding container bb678c348f91b7f8248e993e237bba17a3571ae6fb90fcf069c033df17249e5d: Status 404 returned error can't find the container with id bb678c348f91b7f8248e993e237bba17a3571ae6fb90fcf069c033df17249e5d Jun 06 21:28:22.025443 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:22.025414 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 21:28:22.025530 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:22.025492 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 21:28:22.025530 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:22.025519 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 06 21:28:22.390701 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:22.390601 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" event={"ID":"f4577f92-bbb4-4059-87fb-d5af9e862e75","Type":"ContainerStarted","Data":"982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018"} Jun 06 21:28:22.390701 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:22.390662 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" event={"ID":"f4577f92-bbb4-4059-87fb-d5af9e862e75","Type":"ContainerStarted","Data":"bb678c348f91b7f8248e993e237bba17a3571ae6fb90fcf069c033df17249e5d"} Jun 06 21:28:22.413287 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:22.413241 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" podStartSLOduration=1.413226032 podStartE2EDuration="1.413226032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:28:22.411260994 +0000 UTC m=+2517.366802009" watchObservedRunningTime="2026-06-06 21:28:22.413226032 +0000 UTC m=+2517.368767013" Jun 06 21:28:22.887156 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:22.887126 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:23.891416 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:23.891389 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:24.400795 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:24.400760 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:24.401623 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:24.401606 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:29.032525 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:29.032482 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc"] Jun 06 21:28:29.033002 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:29.032724 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" podUID="f4577f92-bbb4-4059-87fb-d5af9e862e75" containerName="istio-proxy" containerID="cri-o://982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018" gracePeriod=30 Jun 06 21:28:34.286911 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.286889 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:34.408363 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408296 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-token\") pod \"f4577f92-bbb4-4059-87fb-d5af9e862e75\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " Jun 06 21:28:34.408363 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408339 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-workload-socket\") pod \"f4577f92-bbb4-4059-87fb-d5af9e862e75\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " Jun 06 21:28:34.408363 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408359 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4577f92-bbb4-4059-87fb-d5af9e862e75-istiod-ca-cert\") pod \"f4577f92-bbb4-4059-87fb-d5af9e862e75\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " Jun 06 21:28:34.408629 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408394 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-envoy\") pod \"f4577f92-bbb4-4059-87fb-d5af9e862e75\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " Jun 06 21:28:34.408629 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408432 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-data\") pod \"f4577f92-bbb4-4059-87fb-d5af9e862e75\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " Jun 06 21:28:34.408629 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408460 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-credential-socket\") pod \"f4577f92-bbb4-4059-87fb-d5af9e862e75\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " Jun 06 21:28:34.408629 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408509 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-podinfo\") pod \"f4577f92-bbb4-4059-87fb-d5af9e862e75\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " Jun 06 21:28:34.408629 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408543 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss8sz\" (UniqueName: \"kubernetes.io/projected/f4577f92-bbb4-4059-87fb-d5af9e862e75-kube-api-access-ss8sz\") pod \"f4577f92-bbb4-4059-87fb-d5af9e862e75\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " Jun 06 21:28:34.408629 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408571 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-workload-certs\") pod \"f4577f92-bbb4-4059-87fb-d5af9e862e75\" (UID: \"f4577f92-bbb4-4059-87fb-d5af9e862e75\") " Jun 06 21:28:34.408982 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408650 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4577f92-bbb4-4059-87fb-d5af9e862e75" (UID: "f4577f92-bbb4-4059-87fb-d5af9e862e75"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 21:28:34.408982 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408747 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4577f92-bbb4-4059-87fb-d5af9e862e75" (UID: "f4577f92-bbb4-4059-87fb-d5af9e862e75"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 21:28:34.408982 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408757 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4577f92-bbb4-4059-87fb-d5af9e862e75-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4577f92-bbb4-4059-87fb-d5af9e862e75" (UID: "f4577f92-bbb4-4059-87fb-d5af9e862e75"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 21:28:34.408982 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408765 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4577f92-bbb4-4059-87fb-d5af9e862e75" (UID: "f4577f92-bbb4-4059-87fb-d5af9e862e75"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 21:28:34.408982 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408946 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-data\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:34.408982 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408966 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-credential-socket\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:34.408982 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408976 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-workload-socket\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:34.408982 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408985 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4577f92-bbb4-4059-87fb-d5af9e862e75-istiod-ca-cert\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:34.409349 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.408984 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4577f92-bbb4-4059-87fb-d5af9e862e75" (UID: "f4577f92-bbb4-4059-87fb-d5af9e862e75"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 21:28:34.410767 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.410720 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4577f92-bbb4-4059-87fb-d5af9e862e75" (UID: "f4577f92-bbb4-4059-87fb-d5af9e862e75"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 06 21:28:34.410878 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.410799 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4577f92-bbb4-4059-87fb-d5af9e862e75-kube-api-access-ss8sz" (OuterVolumeSpecName: "kube-api-access-ss8sz") pod "f4577f92-bbb4-4059-87fb-d5af9e862e75" (UID: "f4577f92-bbb4-4059-87fb-d5af9e862e75"). InnerVolumeSpecName "kube-api-access-ss8sz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:28:34.411060 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.411036 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4577f92-bbb4-4059-87fb-d5af9e862e75" (UID: "f4577f92-bbb4-4059-87fb-d5af9e862e75"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 21:28:34.411060 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.411041 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4577f92-bbb4-4059-87fb-d5af9e862e75" (UID: "f4577f92-bbb4-4059-87fb-d5af9e862e75"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 21:28:34.445899 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.445877 2561 generic.go:356] "Generic (PLEG): container finished" podID="f4577f92-bbb4-4059-87fb-d5af9e862e75" containerID="982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018" exitCode=0 Jun 06 21:28:34.446013 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.445940 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" Jun 06 21:28:34.446078 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.445942 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" event={"ID":"f4577f92-bbb4-4059-87fb-d5af9e862e75","Type":"ContainerDied","Data":"982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018"} Jun 06 21:28:34.446078 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.446065 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc" event={"ID":"f4577f92-bbb4-4059-87fb-d5af9e862e75","Type":"ContainerDied","Data":"bb678c348f91b7f8248e993e237bba17a3571ae6fb90fcf069c033df17249e5d"} Jun 06 21:28:34.446181 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.446093 2561 scope.go:117] "RemoveContainer" containerID="982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018" Jun 06 21:28:34.455211 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.455196 2561 scope.go:117] "RemoveContainer" containerID="982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018" Jun 06 21:28:34.455454 ip-10-0-132-80 kubenswrapper[2561]: E0606 21:28:34.455436 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018\": container with ID starting with 982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018 not found: ID does not exist" containerID="982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018" Jun 06 21:28:34.455505 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.455462 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018"} err="failed to get container status \"982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018\": rpc error: code = NotFound desc = could not find container \"982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018\": container with ID starting with 982520237cbea2c583c21459f287e4d7a3f6cae69f0202ea7c3d115509b33018 not found: ID does not exist" Jun 06 21:28:34.467825 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.467805 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc"] Jun 06 21:28:34.471070 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.471050 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-174d172d-openshift-default-7df5985f5d-gnqzc"] Jun 06 21:28:34.509802 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.509784 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-token\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:34.509802 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.509801 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-envoy\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:34.509942 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.509810 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4577f92-bbb4-4059-87fb-d5af9e862e75-istio-podinfo\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:34.509942 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.509818 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss8sz\" (UniqueName: \"kubernetes.io/projected/f4577f92-bbb4-4059-87fb-d5af9e862e75-kube-api-access-ss8sz\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:34.509942 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:34.509856 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4577f92-bbb4-4059-87fb-d5af9e862e75-workload-certs\") on node \"ip-10-0-132-80.ec2.internal\" DevicePath \"\"" Jun 06 21:28:35.437743 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:35.437702 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4577f92-bbb4-4059-87fb-d5af9e862e75" path="/var/lib/kubelet/pods/f4577f92-bbb4-4059-87fb-d5af9e862e75/volumes" Jun 06 21:28:48.101372 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:48.101342 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dcfc9684d-hmw7b_4784f652-8089-406b-be56-623af83a8668/nginx/0.log" Jun 06 21:28:48.436425 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:48.436392 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6897b7b5db-qhc7l_4a75970c-a151-4841-8d1c-64f65e6b8fbb/maas-api/0.log" Jun 06 21:28:48.664634 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:48.664604 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6c4db5fc79-rv6vq_e644a7fe-ce5a-426c-a18f-1caf33fbb529/manager/0.log" Jun 06 21:28:49.130932 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:49.130904 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d755ddb6c-qmxxw_911d69c4-edcc-4856-8aab-d174700bb502/copy-manifests/0.log" Jun 06 21:28:49.142928 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:49.142901 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d755ddb6c-qmxxw_911d69c4-edcc-4856-8aab-d174700bb502/manager/0.log" Jun 06 21:28:50.766151 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:50.766121 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2hbbx_12f135e0-0b5a-46d0-96e6-f45baa55ca58/manager/0.log" Jun 06 21:28:51.116323 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:51.116247 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-85qx6_dc0434bd-096c-4bc0-adc2-0a0b102bd781/registry-server/0.log" Jun 06 21:28:51.460897 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:51.460868 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wp2vf_412a8ca8-f8b7-4eb8-a935-b3f6f77f9658/manager/0.log" Jun 06 21:28:51.831339 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:51.831251 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mmp9d_35aa3e51-bb50-4524-b2f7-37aa1e15712f/istio-proxy/0.log" Jun 06 21:28:52.347482 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:52.347449 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-47mm6_691e05fb-9a9b-4ee7-973a-c89a7e07971c/istio-proxy/1.log" Jun 06 21:28:52.475966 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:52.475936 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vjmrh_7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb/payload-pre-processing/0.log" Jun 06 21:28:52.586683 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:52.586656 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-h5r8c_401c20a4-3b88-4007-af35-0fe75593856e/payload-processing/0.log" Jun 06 21:28:53.200305 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:53.200266 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-fwlwb_deb8b6e6-e3fa-4656-8d37-303c2259341d/storage-initializer/0.log" Jun 06 21:28:53.206712 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:53.206689 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-fwlwb_deb8b6e6-e3fa-4656-8d37-303c2259341d/main/0.log" Jun 06 21:28:53.741673 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:53.741651 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9_98de4bcb-86a3-4098-b2e9-1a7dc4240996/main/0.log" Jun 06 21:28:53.747624 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:53.747596 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-nzsm9_98de4bcb-86a3-4098-b2e9-1a7dc4240996/storage-initializer/0.log" Jun 06 21:28:53.861133 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:53.861108 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-tmxbk_60e47612-8ef1-4d6c-a8bf-d56dcfc9943d/storage-initializer/0.log" Jun 06 21:28:53.867101 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:28:53.867085 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-tmxbk_60e47612-8ef1-4d6c-a8bf-d56dcfc9943d/main/0.log" Jun 06 21:29:01.846869 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:01.846823 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wkssg_2beb3bb9-4934-4da1-9472-289193555adb/global-pull-secret-syncer/0.log" Jun 06 21:29:01.940365 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:01.940338 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v22ns_dcb68591-97bc-4e9b-960a-f6ed0aecd0da/konnectivity-agent/0.log" Jun 06 21:29:01.977617 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:01.977595 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-80.ec2.internal_05e793a3013e7e8f3e625c9bad9e9e51/haproxy/0.log" Jun 06 21:29:06.601763 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:06.601733 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2hbbx_12f135e0-0b5a-46d0-96e6-f45baa55ca58/manager/0.log" Jun 06 21:29:06.678681 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:06.678654 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-85qx6_dc0434bd-096c-4bc0-adc2-0a0b102bd781/registry-server/0.log" Jun 06 21:29:06.834907 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:06.834877 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wp2vf_412a8ca8-f8b7-4eb8-a935-b3f6f77f9658/manager/0.log" Jun 06 21:29:08.788983 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:08.788959 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-9ksx2_39e23856-fc66-4fec-9037-70ee379e0097/monitoring-plugin/0.log" Jun 06 21:29:08.956362 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:08.956338 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kp9b7_9c08aab4-6d11-465c-b3d7-f13e963723f7/node-exporter/0.log" Jun 06 21:29:08.972498 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:08.972477 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kp9b7_9c08aab4-6d11-465c-b3d7-f13e963723f7/kube-rbac-proxy/0.log" Jun 06 21:29:08.989164 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:08.989144 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kp9b7_9c08aab4-6d11-465c-b3d7-f13e963723f7/init-textfile/0.log" Jun 06 21:29:09.097395 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.097372 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a5037e7-e1e0-44d0-b5b9-348f14bf09a1/prometheus/0.log" Jun 06 21:29:09.114724 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.114702 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a5037e7-e1e0-44d0-b5b9-348f14bf09a1/config-reloader/0.log" Jun 06 21:29:09.131689 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.131671 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a5037e7-e1e0-44d0-b5b9-348f14bf09a1/thanos-sidecar/0.log" Jun 06 21:29:09.149003 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.148984 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a5037e7-e1e0-44d0-b5b9-348f14bf09a1/kube-rbac-proxy-web/0.log" Jun 06 21:29:09.166129 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.166098 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a5037e7-e1e0-44d0-b5b9-348f14bf09a1/kube-rbac-proxy/0.log" Jun 06 21:29:09.182226 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.182211 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a5037e7-e1e0-44d0-b5b9-348f14bf09a1/kube-rbac-proxy-thanos/0.log" Jun 06 21:29:09.202147 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.202133 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a5037e7-e1e0-44d0-b5b9-348f14bf09a1/init-config-reloader/0.log" Jun 06 21:29:09.372866 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.372845 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67787594d6-8bl9m_7e3f7895-7efb-4ff5-9353-80127a176b23/thanos-query/0.log" Jun 06 21:29:09.392281 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.392259 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67787594d6-8bl9m_7e3f7895-7efb-4ff5-9353-80127a176b23/kube-rbac-proxy-web/0.log" Jun 06 21:29:09.408880 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.408858 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67787594d6-8bl9m_7e3f7895-7efb-4ff5-9353-80127a176b23/kube-rbac-proxy/0.log" Jun 06 21:29:09.426563 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.426513 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67787594d6-8bl9m_7e3f7895-7efb-4ff5-9353-80127a176b23/prom-label-proxy/0.log" Jun 06 21:29:09.442459 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.442441 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67787594d6-8bl9m_7e3f7895-7efb-4ff5-9353-80127a176b23/kube-rbac-proxy-rules/0.log" Jun 06 21:29:09.458708 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:09.458692 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67787594d6-8bl9m_7e3f7895-7efb-4ff5-9353-80127a176b23/kube-rbac-proxy-metrics/0.log" Jun 06 21:29:14.198502 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.198462 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh"] Jun 06 21:29:14.199040 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.199021 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4577f92-bbb4-4059-87fb-d5af9e862e75" containerName="istio-proxy" Jun 06 21:29:14.199118 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.199042 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4577f92-bbb4-4059-87fb-d5af9e862e75" containerName="istio-proxy" Jun 06 21:29:14.199175 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.199133 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4577f92-bbb4-4059-87fb-d5af9e862e75" containerName="istio-proxy" Jun 06 21:29:14.201176 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.201153 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.203812 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.203788 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jnh9t\"/\"kube-root-ca.crt\"" Jun 06 21:29:14.205082 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.205055 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jnh9t\"/\"openshift-service-ca.crt\"" Jun 06 21:29:14.205168 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.205081 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jnh9t\"/\"default-dockercfg-6728j\"" Jun 06 21:29:14.210846 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.210808 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh"] Jun 06 21:29:14.352100 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.352052 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7bc9d493-ff16-4741-ab47-6056e47340f2-lib-modules\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.352100 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.352098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7bc9d493-ff16-4741-ab47-6056e47340f2-podres\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.352313 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.352134 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bc9d493-ff16-4741-ab47-6056e47340f2-sys\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.352313 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.352172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75jft\" (UniqueName: \"kubernetes.io/projected/7bc9d493-ff16-4741-ab47-6056e47340f2-kube-api-access-75jft\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.352313 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.352201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7bc9d493-ff16-4741-ab47-6056e47340f2-proc\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.452800 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.452706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7bc9d493-ff16-4741-ab47-6056e47340f2-lib-modules\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.452800 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.452745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7bc9d493-ff16-4741-ab47-6056e47340f2-podres\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.452800 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.452771 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bc9d493-ff16-4741-ab47-6056e47340f2-sys\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.453085 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.452881 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75jft\" (UniqueName: \"kubernetes.io/projected/7bc9d493-ff16-4741-ab47-6056e47340f2-kube-api-access-75jft\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.453085 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.452896 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7bc9d493-ff16-4741-ab47-6056e47340f2-podres\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.453085 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.452904 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7bc9d493-ff16-4741-ab47-6056e47340f2-lib-modules\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.453085 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.452908 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bc9d493-ff16-4741-ab47-6056e47340f2-sys\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.453085 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.452915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7bc9d493-ff16-4741-ab47-6056e47340f2-proc\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.453085 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.452950 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7bc9d493-ff16-4741-ab47-6056e47340f2-proc\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.460487 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.460464 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75jft\" (UniqueName: \"kubernetes.io/projected/7bc9d493-ff16-4741-ab47-6056e47340f2-kube-api-access-75jft\") pod \"perf-node-gather-daemonset-qhwvh\" (UID: \"7bc9d493-ff16-4741-ab47-6056e47340f2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.511695 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.511671 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:14.641821 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.641779 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh"] Jun 06 21:29:14.644251 ip-10-0-132-80 kubenswrapper[2561]: W0606 21:29:14.644226 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7bc9d493_ff16_4741_ab47_6056e47340f2.slice/crio-23114b6836461c3cf4e6e8f66b84a0cf8698cb4f6987c046b3ffe42ccf060687 WatchSource:0}: Error finding container 23114b6836461c3cf4e6e8f66b84a0cf8698cb4f6987c046b3ffe42ccf060687: Status 404 returned error can't find the container with id 23114b6836461c3cf4e6e8f66b84a0cf8698cb4f6987c046b3ffe42ccf060687 Jun 06 21:29:14.744251 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.744231 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vsg97_a6dbc555-220e-4e15-aeb3-ed473af4bb35/dns/0.log" Jun 06 21:29:14.766576 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.761360 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vsg97_a6dbc555-220e-4e15-aeb3-ed473af4bb35/kube-rbac-proxy/0.log" Jun 06 21:29:14.803625 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:14.803603 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qf8k2_b68a212d-020d-4c2f-9597-800e58ac80ef/dns-node-resolver/0.log" Jun 06 21:29:15.351417 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:15.351391 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-225jx_4156b345-8f3e-4eed-a385-c1469420457d/node-ca/0.log" Jun 06 21:29:15.644135 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:15.644038 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" event={"ID":"7bc9d493-ff16-4741-ab47-6056e47340f2","Type":"ContainerStarted","Data":"6af56d3618a42c09561289ad0f7dc0025539933413dac14ae424f95d6ddaf767"} Jun 06 21:29:15.644135 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:15.644092 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" event={"ID":"7bc9d493-ff16-4741-ab47-6056e47340f2","Type":"ContainerStarted","Data":"23114b6836461c3cf4e6e8f66b84a0cf8698cb4f6987c046b3ffe42ccf060687"} Jun 06 21:29:15.644355 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:15.644230 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:15.660620 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:15.660567 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" podStartSLOduration=1.6605506239999999 podStartE2EDuration="1.660550624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 21:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:29:15.65900232 +0000 UTC m=+2570.614543306" watchObservedRunningTime="2026-06-06 21:29:15.660550624 +0000 UTC m=+2570.616091605" Jun 06 21:29:16.316105 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:16.316062 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mmp9d_35aa3e51-bb50-4524-b2f7-37aa1e15712f/istio-proxy/0.log" Jun 06 21:29:16.458018 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:16.457987 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-47mm6_691e05fb-9a9b-4ee7-973a-c89a7e07971c/istio-proxy/0.log" Jun 06 21:29:16.487719 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:16.487691 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-47mm6_691e05fb-9a9b-4ee7-973a-c89a7e07971c/istio-proxy/1.log" Jun 06 21:29:16.512266 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:16.512241 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vjmrh_7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb/payload-pre-processing/0.log" Jun 06 21:29:16.567110 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:16.567054 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-h5r8c_401c20a4-3b88-4007-af35-0fe75593856e/payload-processing/0.log" Jun 06 21:29:17.207855 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:17.207813 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p4n8h_a66425d1-33e6-4fe8-961b-79d20a4c5a36/serve-healthcheck-canary/0.log" Jun 06 21:29:17.769910 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:17.769878 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pjqd6_896f7aa6-292b-4e51-9f2d-87912760f946/kube-rbac-proxy/0.log" Jun 06 21:29:17.784890 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:17.784870 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pjqd6_896f7aa6-292b-4e51-9f2d-87912760f946/exporter/0.log" Jun 06 21:29:17.803014 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:17.802996 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pjqd6_896f7aa6-292b-4e51-9f2d-87912760f946/extractor/0.log" Jun 06 21:29:19.978112 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:19.978085 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dcfc9684d-hmw7b_4784f652-8089-406b-be56-623af83a8668/nginx/0.log" Jun 06 21:29:20.110996 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:20.110966 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6897b7b5db-qhc7l_4a75970c-a151-4841-8d1c-64f65e6b8fbb/maas-api/0.log" Jun 06 21:29:20.193248 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:20.193218 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6c4db5fc79-rv6vq_e644a7fe-ce5a-426c-a18f-1caf33fbb529/manager/0.log" Jun 06 21:29:20.383785 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:20.383704 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d755ddb6c-qmxxw_911d69c4-edcc-4856-8aab-d174700bb502/manager/0.log" Jun 06 21:29:20.397144 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:20.397123 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d755ddb6c-qmxxw_911d69c4-edcc-4856-8aab-d174700bb502/copy-manifests/0.log" Jun 06 21:29:21.658894 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:21.658867 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-qhwvh" Jun 06 21:29:21.908136 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:21.908105 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68d9b98c67-6vpjd_9e9aef3e-28a5-42e8-9762-600150fae3c4/manager/0.log" Jun 06 21:29:26.754356 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:26.754329 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mmp9d_35aa3e51-bb50-4524-b2f7-37aa1e15712f/istio-proxy/0.log" Jun 06 21:29:26.861099 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:26.861008 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-47mm6_691e05fb-9a9b-4ee7-973a-c89a7e07971c/istio-proxy/0.log" Jun 06 21:29:26.890493 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:26.890470 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-47mm6_691e05fb-9a9b-4ee7-973a-c89a7e07971c/istio-proxy/1.log" Jun 06 21:29:26.907999 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:26.907981 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vjmrh_7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb/payload-pre-processing/0.log" Jun 06 21:29:26.955764 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:26.955743 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-h5r8c_401c20a4-3b88-4007-af35-0fe75593856e/payload-processing/0.log" Jun 06 21:29:28.062538 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:28.062503 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mmp9d_35aa3e51-bb50-4524-b2f7-37aa1e15712f/istio-proxy/0.log" Jun 06 21:29:28.165641 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:28.165606 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-47mm6_691e05fb-9a9b-4ee7-973a-c89a7e07971c/istio-proxy/0.log" Jun 06 21:29:28.197012 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:28.196988 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-47mm6_691e05fb-9a9b-4ee7-973a-c89a7e07971c/istio-proxy/1.log" Jun 06 21:29:28.219062 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:28.219039 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vjmrh_7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb/payload-pre-processing/0.log" Jun 06 21:29:28.267987 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:28.267960 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-h5r8c_401c20a4-3b88-4007-af35-0fe75593856e/payload-processing/0.log" Jun 06 21:29:29.288124 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.288096 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtkz9_9a48bfbc-be4a-4dba-bea8-a6c00d72d275/kube-multus-additional-cni-plugins/0.log" Jun 06 21:29:29.304640 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.304615 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtkz9_9a48bfbc-be4a-4dba-bea8-a6c00d72d275/egress-router-binary-copy/0.log" Jun 06 21:29:29.324199 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.324184 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtkz9_9a48bfbc-be4a-4dba-bea8-a6c00d72d275/cni-plugins/0.log" Jun 06 21:29:29.350702 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.350683 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtkz9_9a48bfbc-be4a-4dba-bea8-a6c00d72d275/bond-cni-plugin/0.log" Jun 06 21:29:29.366957 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.366937 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtkz9_9a48bfbc-be4a-4dba-bea8-a6c00d72d275/routeoverride-cni/0.log" Jun 06 21:29:29.384380 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.384359 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtkz9_9a48bfbc-be4a-4dba-bea8-a6c00d72d275/whereabouts-cni-bincopy/0.log" Jun 06 21:29:29.401585 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.401561 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtkz9_9a48bfbc-be4a-4dba-bea8-a6c00d72d275/whereabouts-cni/0.log" Jun 06 21:29:29.464144 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.464120 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-m8jvk_ab0e8860-58f5-4601-afad-1ff7f00de91e/kube-multus/0.log" Jun 06 21:29:29.736146 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.736118 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xtdmx_a38f8798-b100-40c5-be25-f6828d3db580/network-metrics-daemon/0.log" Jun 06 21:29:29.755728 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.755705 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xtdmx_a38f8798-b100-40c5-be25-f6828d3db580/kube-rbac-proxy/0.log" Jun 06 21:29:29.857926 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.857899 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mmp9d_35aa3e51-bb50-4524-b2f7-37aa1e15712f/istio-proxy/0.log" Jun 06 21:29:29.955121 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.955092 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-47mm6_691e05fb-9a9b-4ee7-973a-c89a7e07971c/istio-proxy/0.log" Jun 06 21:29:29.986668 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:29.986598 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-47mm6_691e05fb-9a9b-4ee7-973a-c89a7e07971c/istio-proxy/1.log" Jun 06 21:29:30.003905 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:30.003886 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vjmrh_7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb/payload-pre-processing/0.log" Jun 06 21:29:30.054483 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:30.054463 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-h5r8c_401c20a4-3b88-4007-af35-0fe75593856e/payload-processing/0.log" Jun 06 21:29:30.727127 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:30.727095 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ftq4_f444c70e-29cd-4a6a-8c48-e7a814a4fff8/ovn-controller/0.log" Jun 06 21:29:30.740413 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:30.740390 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ftq4_f444c70e-29cd-4a6a-8c48-e7a814a4fff8/ovn-acl-logging/0.log" Jun 06 21:29:30.759529 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:30.759504 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ftq4_f444c70e-29cd-4a6a-8c48-e7a814a4fff8/kube-rbac-proxy-node/0.log" Jun 06 21:29:30.776238 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:30.776215 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ftq4_f444c70e-29cd-4a6a-8c48-e7a814a4fff8/kube-rbac-proxy-ovn-metrics/0.log" Jun 06 21:29:30.792537 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:30.792522 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ftq4_f444c70e-29cd-4a6a-8c48-e7a814a4fff8/northd/0.log" Jun 06 21:29:30.807665 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:30.807648 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ftq4_f444c70e-29cd-4a6a-8c48-e7a814a4fff8/nbdb/0.log" Jun 06 21:29:30.824125 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:30.824104 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ftq4_f444c70e-29cd-4a6a-8c48-e7a814a4fff8/sbdb/0.log" Jun 06 21:29:30.862219 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:30.862162 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ftq4_f444c70e-29cd-4a6a-8c48-e7a814a4fff8/ovnkube-controller/0.log" Jun 06 21:29:32.094624 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:32.094595 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795mmp9d_35aa3e51-bb50-4524-b2f7-37aa1e15712f/istio-proxy/0.log" Jun 06 21:29:32.196771 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:32.196726 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-47mm6_691e05fb-9a9b-4ee7-973a-c89a7e07971c/istio-proxy/0.log" Jun 06 21:29:32.227028 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:32.227004 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-47mm6_691e05fb-9a9b-4ee7-973a-c89a7e07971c/istio-proxy/1.log" Jun 06 21:29:32.245043 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:32.245007 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vjmrh_7b1eab73-b0a8-4a1a-b6c9-b4bdb699fddb/payload-pre-processing/0.log" Jun 06 21:29:32.299797 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:32.299774 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-h5r8c_401c20a4-3b88-4007-af35-0fe75593856e/payload-processing/0.log" Jun 06 21:29:32.385229 ip-10-0-132-80 kubenswrapper[2561]: I0606 21:29:32.385174 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ggpw7_0d08e1c7-bbab-4ef4-ac10-bfe7e93ba582/network-check-target-container/0.log"