Jul 13 14:45:48.553212 ip-10-0-133-95 systemd[1]: Starting Kubernetes Kubelet... Jul 13 14:45:49.014424 ip-10-0-133-95 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 14:45:49.014424 ip-10-0-133-95 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 14:45:49.014424 ip-10-0-133-95 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 14:45:49.014424 ip-10-0-133-95 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 14:45:49.014424 ip-10-0-133-95 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 14:45:49.016623 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.016504 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 14:45:49.020260 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020246 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:45:49.020260 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020260 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020266 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020271 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020275 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020278 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020281 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020284 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020287 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020290 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020292 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020295 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020298 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020300 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020303 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020307 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020310 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020313 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020316 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020319 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:45:49.020314 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020322 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020329 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020332 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020335 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020337 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020340 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020342 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020345 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020347 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020349 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020352 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020354 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020357 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020359 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020362 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020364 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020366 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020369 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020371 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020375 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:45:49.020768 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020377 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020380 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020383 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020385 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020388 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020390 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020392 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020395 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020397 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020400 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020403 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020405 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020407 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020410 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020413 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020416 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020418 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020421 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020423 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:45:49.021278 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020426 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020428 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020431 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020433 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020435 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020438 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020440 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020442 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020445 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020447 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020450 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020452 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020455 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020458 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020460 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020463 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020466 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020469 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020471 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:45:49.021729 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020475 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020479 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020483 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020486 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020489 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020491 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020494 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020496 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020499 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020502 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020505 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020508 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020510 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020513 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020515 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020518 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020520 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020523 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020525 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:45:49.022179 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020528 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.020531 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021223 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021230 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021233 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021235 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021238 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021241 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021244 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021247 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021251 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021255 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021258 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021261 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021264 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021266 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021269 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021272 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021274 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021277 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:45:49.022648 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021280 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021283 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021285 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021289 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021291 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021294 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021297 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021301 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021304 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021308 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021311 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021313 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021316 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021319 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021321 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021324 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021327 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021329 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021332 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:45:49.023175 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021335 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021337 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021340 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021342 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021345 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021347 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021350 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021352 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021355 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021357 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021360 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021363 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021365 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021368 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021370 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021373 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021375 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021378 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021381 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021383 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:45:49.023630 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021386 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021389 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021393 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021395 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021398 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021401 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021403 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021406 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021409 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021411 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021414 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021417 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021419 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021422 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021424 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021427 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021429 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021432 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021434 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:45:49.024119 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021436 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021439 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021441 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021444 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021447 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021449 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021451 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021458 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021460 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021463 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021466 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021469 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021472 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021474 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021477 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021480 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021482 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021485 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021487 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021490 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:45:49.024570 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021492 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021494 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021497 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021855 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021860 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021863 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021866 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021868 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021871 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021874 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021893 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021897 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021902 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021905 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021908 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021910 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021913 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021916 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021918 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021923 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:45:49.025072 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021925 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021928 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021931 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021934 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021937 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021940 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021943 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021945 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021948 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021950 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021953 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021956 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021958 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021960 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021963 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021967 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021971 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021974 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021977 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:45:49.025539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021980 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021983 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021986 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021989 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021991 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021994 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021997 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.021999 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022002 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022004 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022007 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022009 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022013 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022015 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022018 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022021 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022023 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022026 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022029 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022031 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:45:49.026002 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022034 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022036 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022039 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022042 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022045 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022047 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022049 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022052 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022054 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022057 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022059 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022062 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022065 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022067 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022070 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022072 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022075 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022077 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022080 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022084 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:45:49.026488 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022087 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022090 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022093 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022096 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022100 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022102 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022106 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022111 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022113 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022116 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022119 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022122 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022124 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022126 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022129 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022132 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022134 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022136 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022139 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022142 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:45:49.026973 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022146 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022148 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022151 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022224 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022234 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022251 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022258 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022263 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022267 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022271 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022275 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022278 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022281 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022284 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022287 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022290 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022295 2579 flags.go:64] FLAG: --cgroup-root="" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022298 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022302 2579 flags.go:64] FLAG: --client-ca-file="" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022305 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022308 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022311 2579 flags.go:64] FLAG: --cluster-domain="" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022314 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022318 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 14:45:49.027453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022321 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022324 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022328 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022331 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022334 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022337 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022340 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022343 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022346 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022349 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022352 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022356 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022359 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022362 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022365 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022368 2579 flags.go:64] FLAG: --enable-server="true" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022370 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022375 2579 flags.go:64] FLAG: --event-burst="100" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022378 2579 flags.go:64] FLAG: --event-qps="50" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022380 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022383 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022387 2579 flags.go:64] FLAG: --eviction-hard="" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022391 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022394 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022398 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 14:45:49.028063 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022401 2579 flags.go:64] FLAG: --eviction-soft="" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022405 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022408 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022411 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022414 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022417 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022420 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022423 2579 flags.go:64] FLAG: --feature-gates="" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022427 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022430 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022433 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022436 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022439 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022442 2579 flags.go:64] FLAG: --help="false" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022445 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022448 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022451 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022454 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022458 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022462 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022464 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022467 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022470 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 14:45:49.028646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022472 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022475 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022478 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022481 2579 flags.go:64] FLAG: --kube-reserved="" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022484 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022486 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022489 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022492 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022496 2579 flags.go:64] FLAG: --lock-file="" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022499 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022505 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022508 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022514 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022517 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022519 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022522 2579 flags.go:64] FLAG: --logging-format="text" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022525 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022529 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022532 2579 flags.go:64] FLAG: --manifest-url="" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022535 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022539 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022542 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022546 2579 flags.go:64] FLAG: --max-pods="110" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022549 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022552 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 14:45:49.029243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022555 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022558 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022560 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022563 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022566 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022572 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022575 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022578 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022581 2579 flags.go:64] FLAG: --pod-cidr="" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022584 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022593 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022596 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022599 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022602 2579 flags.go:64] FLAG: --port="10250" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022605 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022607 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06fa5d9656fc58b18" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022612 2579 flags.go:64] FLAG: --qos-reserved="" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022616 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022619 2579 flags.go:64] FLAG: --register-node="true" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022622 2579 flags.go:64] FLAG: --register-with-taints="" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022625 2579 flags.go:64] FLAG: --registry-burst="10" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022628 2579 flags.go:64] FLAG: --registry-qps="5" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022632 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022634 2579 flags.go:64] FLAG: --reserved-memory="" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022638 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 14:45:49.030012 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022642 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022645 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022648 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022651 2579 flags.go:64] FLAG: --runonce="false" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022654 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022657 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022660 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022663 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022665 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022668 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022671 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022674 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022677 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022679 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022682 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022685 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022688 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022691 2579 flags.go:64] FLAG: --system-cgroups="" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022693 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022699 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022702 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022704 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022708 2579 flags.go:64] FLAG: --tls-min-version="" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022711 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022715 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 14:45:49.030969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022718 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022721 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022724 2579 flags.go:64] FLAG: --v="2" Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022728 2579 flags.go:64] FLAG: --version="false" Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022732 2579 flags.go:64] FLAG: --vmodule="" Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022735 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.022738 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022899 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022905 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022909 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022911 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022914 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022916 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022919 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022922 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022924 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022927 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022929 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022932 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022934 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022937 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:45:49.031576 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022939 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022942 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022944 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022947 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022950 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022952 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022955 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022957 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022960 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022963 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022967 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022969 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022972 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022976 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022979 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022982 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022985 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022987 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022990 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:45:49.032136 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.022993 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023002 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023005 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023008 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023010 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023013 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023016 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023019 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023021 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023024 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023028 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023031 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023034 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023037 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023040 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023043 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023046 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023049 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023051 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:45:49.032592 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023054 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023056 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023059 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023061 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023066 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023068 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023071 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023074 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023076 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023078 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023081 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023083 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023086 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023088 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023091 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023099 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023101 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023104 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023107 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023109 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:45:49.033053 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023111 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023114 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023117 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023119 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023122 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023124 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023127 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023129 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023132 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023134 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023138 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023141 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023144 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023147 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023150 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023153 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023157 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023160 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023162 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023165 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:45:49.033532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023168 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023170 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023172 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023175 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023177 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023180 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.023183 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.023861 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.032802 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.032820 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.033898 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.033907 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.033973 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.033978 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.033981 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:45:49.034009 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.033984 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.033988 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.033990 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.033993 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.033997 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.033999 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034003 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034005 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034008 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034011 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034014 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034016 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034020 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034022 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034025 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034028 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034030 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034033 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034035 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034038 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:45:49.034386 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034041 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034043 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034046 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034049 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034052 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034055 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034058 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034061 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034063 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034066 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034069 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034071 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034074 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034077 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034080 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034083 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034085 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034088 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034091 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034094 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:45:49.034866 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034096 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034099 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034102 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034110 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034113 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034116 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034118 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034121 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034123 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034126 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034128 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034131 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034133 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034135 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034138 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034141 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034143 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034146 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034148 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:45:49.035421 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034151 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034153 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034156 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034158 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034161 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034164 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034167 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034170 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034173 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034176 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034178 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034181 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034184 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034186 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034189 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034191 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034195 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034204 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034208 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:45:49.035873 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034211 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034214 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034216 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034219 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034223 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034227 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034230 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034233 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034235 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034238 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034241 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034252 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034255 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034257 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034261 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034266 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034270 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:45:49.036424 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034276 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.034281 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034406 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034412 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034415 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034418 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034421 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034424 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034427 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034430 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034433 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034436 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034438 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034441 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034449 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:45:49.036831 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034452 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034455 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034458 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034460 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034463 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034465 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034468 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034470 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034473 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034475 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034478 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034481 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034485 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034489 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034492 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034495 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034498 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034501 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034503 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:45:49.037203 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034506 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034509 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034512 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034515 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034518 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034521 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034524 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034526 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034529 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034531 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034534 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034536 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034539 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034542 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034545 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034548 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034550 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034553 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034556 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034558 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:45:49.037649 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034561 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034563 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034566 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034568 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034571 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034574 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034576 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034579 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034581 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034584 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034586 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034589 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034591 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034594 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034596 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034599 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034601 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034604 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034606 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034608 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:45:49.038124 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034611 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034613 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034616 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034618 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034621 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034623 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034626 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034629 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034633 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034636 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034638 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034641 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034644 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034648 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034650 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034653 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034655 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034658 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034661 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034663 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:45:49.038599 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034665 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:45:49.039092 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034668 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:45:49.039092 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034670 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:45:49.039092 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034672 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:45:49.039092 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034675 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:45:49.039092 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034678 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:45:49.039092 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:49.034681 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:45:49.039092 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.034685 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 14:45:49.039092 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.034796 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 14:45:49.039284 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.039167 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 14:45:49.041076 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.041064 2579 server.go:1019] "Starting client certificate rotation" Jul 13 14:45:49.041191 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.041174 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 14:45:49.041219 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.041205 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 14:45:49.043681 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.043670 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 14:45:49.044920 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.044906 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 14:45:49.055009 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.054982 2579 log.go:25] "Validated CRI v1 runtime API" Jul 13 14:45:49.057177 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.057162 2579 log.go:25] "Validated CRI v1 image API" Jul 13 14:45:49.058025 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.058011 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 14:45:49.066464 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.066444 2579 fs.go:135] Filesystem UUIDs: map[53e200d3-f9f2-4dd4-a2bd-dc926d663837:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cdaf21fd-b545-4e23-9641-2ea8f48d11d3:/dev/nvme0n1p4] Jul 13 14:45:49.066530 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.066462 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 14:45:49.071564 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.071460 2579 manager.go:216] Machine: {Timestamp:2026-07-13 14:45:49.07034669 +0000 UTC m=+0.383654307 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100515 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec237d9e58489cb731e21c779abe0c8a SystemUUID:ec237d9e-5848-9cb7-31e2-1c779abe0c8a BootID:672f0fe6-ea98-4c5e-bc74-6cd2476611fc Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a3:f0:ad:b3:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a3:f0:ad:b3:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:68:c6:4c:48:90 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 14:45:49.071564 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.071562 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 14:45:49.071665 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.071642 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 14:45:49.073191 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.073162 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 14:45:49.073326 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.073194 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 14:45:49.074036 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.074024 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 14:45:49.074036 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.074037 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 14:45:49.074114 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.074044 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 14:45:49.074805 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.074794 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 14:45:49.075784 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.075775 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 14:45:49.079181 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.079169 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 13 14:45:49.079288 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.079279 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 14:45:49.079320 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.079308 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 13 14:45:49.079320 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.079317 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 14:45:49.079369 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.079330 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 14:45:49.079369 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.079339 2579 kubelet.go:398] "Adding apiserver pod source" Jul 13 14:45:49.079369 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.079347 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 14:45:49.079730 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.079718 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 14:45:49.079763 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.079739 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 14:45:49.080576 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.080558 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 14:45:49.083154 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.083139 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 14:45:49.084659 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.084640 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 14:45:49.084729 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.084690 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 14:45:49.085461 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.085450 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 14:45:49.085496 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.085466 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 14:45:49.085496 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.085474 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 14:45:49.085496 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.085482 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 14:45:49.085496 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.085493 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 14:45:49.085604 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.085499 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 14:45:49.085912 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.085903 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 14:45:49.085912 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.085912 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 14:45:49.085976 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.085918 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 14:45:49.085976 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.085925 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 14:45:49.085976 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.085933 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 14:45:49.085976 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.085942 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 14:45:49.088360 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.088347 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 14:45:49.088360 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.088360 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 14:45:49.091143 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.091123 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 14:45:49.091434 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.091420 2579 server.go:1268] "Started kubelet" Jul 13 14:45:49.091534 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.091486 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 14:45:49.091644 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.091609 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 14:45:49.091644 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.091608 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 14:45:49.091739 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.091671 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 14:45:49.091739 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.091682 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 14:45:49.092185 ip-10-0-133-95 systemd[1]: Started Kubernetes Kubelet. Jul 13 14:45:49.092856 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.092839 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 14:45:49.093438 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.093426 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 13 14:45:49.097962 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.097948 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 14:45:49.098358 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.098089 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 14:45:49.098907 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.098868 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 14:45:49.099057 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.099044 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 14:45:49.099131 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.099122 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 14:45:49.099237 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.099214 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:49.099514 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.099491 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 14:45:49.099969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.099954 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 13 14:45:49.100075 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.100052 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 13 14:45:49.100781 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.100588 2579 factory.go:55] Registering systemd factory Jul 13 14:45:49.100781 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.100610 2579 factory.go:223] Registration of the systemd container factory successfully Jul 13 14:45:49.100947 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.100924 2579 factory.go:153] Registering CRI-O factory Jul 13 14:45:49.100947 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.100939 2579 factory.go:223] Registration of the crio container factory successfully Jul 13 14:45:49.101046 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.100991 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 14:45:49.101046 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.101015 2579 factory.go:103] Registering Raw factory Jul 13 14:45:49.101046 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.101032 2579 manager.go:1196] Started watching for new ooms in manager Jul 13 14:45:49.101454 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.101439 2579 manager.go:349] Starting recovery of all containers Jul 13 14:45:49.102956 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.102933 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 14:45:49.103180 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.103161 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 14:45:49.106949 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.103038 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-95.ec2.internal.18c1e0aa373f71ea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-95.ec2.internal,UID:ip-10-0-133-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-95.ec2.internal,},FirstTimestamp:2026-07-13 14:45:49.091394026 +0000 UTC m=+0.404701643,LastTimestamp:2026-07-13 14:45:49.091394026 +0000 UTC m=+0.404701643,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-95.ec2.internal,}" Jul 13 14:45:49.115060 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.115041 2579 manager.go:354] Recovery completed Jul 13 14:45:49.120496 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.120484 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:45:49.122610 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.122586 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:45:49.122670 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.122623 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:45:49.122670 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.122633 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:45:49.123182 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.123167 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 14:45:49.123182 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.123178 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 14:45:49.123182 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.123182 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:45:49.123310 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.123192 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 13 14:45:49.124015 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.123978 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:45:49.124015 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.124005 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:45:49.124111 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.124018 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:45:49.124782 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.124703 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-95.ec2.internal.18c1e0aa391bbffc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-95.ec2.internal,UID:ip-10-0-133-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-95.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-95.ec2.internal,},FirstTimestamp:2026-07-13 14:45:49.122609148 +0000 UTC m=+0.435916767,LastTimestamp:2026-07-13 14:45:49.122609148 +0000 UTC m=+0.435916767,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-95.ec2.internal,}" Jul 13 14:45:49.124869 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.124818 2579 policy_none.go:49] "None policy: Start" Jul 13 14:45:49.124869 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.124837 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 14:45:49.124869 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.124852 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 14:45:49.126404 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.126390 2579 policy_none.go:47] "Start" Jul 13 14:45:49.133900 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.133868 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-42cgd" Jul 13 14:45:49.135868 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.135782 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-95.ec2.internal.18c1e0aa391c092d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-95.ec2.internal,UID:ip-10-0-133-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-95.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-95.ec2.internal,},FirstTimestamp:2026-07-13 14:45:49.122627885 +0000 UTC m=+0.435935502,LastTimestamp:2026-07-13 14:45:49.122627885 +0000 UTC m=+0.435935502,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-95.ec2.internal,}" Jul 13 14:45:49.142068 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.142032 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-42cgd" Jul 13 14:45:49.146223 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.146149 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-95.ec2.internal.18c1e0aa391c2d16 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-95.ec2.internal,UID:ip-10-0-133-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-95.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-95.ec2.internal,},FirstTimestamp:2026-07-13 14:45:49.122637078 +0000 UTC m=+0.435944695,LastTimestamp:2026-07-13 14:45:49.122637078 +0000 UTC m=+0.435944695,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-95.ec2.internal,}" Jul 13 14:45:49.150570 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.150556 2579 manager.go:337] "Starting Device Plugin manager" Jul 13 14:45:49.150697 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.150590 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 14:45:49.150697 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.150602 2579 server.go:87] "Starting device plugin registration server" Jul 13 14:45:49.150853 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.150841 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 14:45:49.150920 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.150855 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 14:45:49.150961 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.150942 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 14:45:49.151033 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.151021 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 14:45:49.151080 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.151034 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 14:45:49.152226 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.152206 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 14:45:49.152307 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.152260 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:49.169510 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.169457 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 14:45:49.175772 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.170605 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 14:45:49.175772 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.170645 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 14:45:49.175772 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.170667 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 14:45:49.175772 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.170717 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 14:45:49.175772 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.172541 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:45:49.251585 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.251541 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:45:49.252678 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.252654 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:45:49.252802 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.252689 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:45:49.252802 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.252704 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:45:49.252802 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.252729 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.262669 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.262650 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.262777 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.262677 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-95.ec2.internal\": node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:49.271221 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.271200 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-95.ec2.internal"] Jul 13 14:45:49.271325 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.271260 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:45:49.272120 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.272101 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:45:49.272230 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.272131 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:45:49.272230 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.272141 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:45:49.273667 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.273655 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:45:49.273786 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.273771 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.273851 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.273801 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:45:49.274366 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.274345 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:45:49.274458 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.274369 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:45:49.274458 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.274393 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:45:49.274458 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.274398 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:45:49.274458 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.274420 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:45:49.274458 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.274436 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:45:49.275639 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.275621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.275742 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.275651 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:45:49.276358 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.276341 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:45:49.276445 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.276369 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:45:49.276445 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.276379 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:45:49.287620 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.287604 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:49.298444 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.298428 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-95.ec2.internal\" not found" node="ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.300441 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.300421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ec2e19d71065addb6c77b51d2691a32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal\" (UID: \"4ec2e19d71065addb6c77b51d2691a32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.300538 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.300447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ec2e19d71065addb6c77b51d2691a32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal\" (UID: \"4ec2e19d71065addb6c77b51d2691a32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.300538 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.300462 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4e72ecf078b84cf1a21b2a5799579a9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-95.ec2.internal\" (UID: \"a4e72ecf078b84cf1a21b2a5799579a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.302410 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.302392 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-95.ec2.internal\" not found" node="ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.388575 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.388542 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:49.400926 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.400899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ec2e19d71065addb6c77b51d2691a32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal\" (UID: \"4ec2e19d71065addb6c77b51d2691a32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.401034 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.400941 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ec2e19d71065addb6c77b51d2691a32-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal\" (UID: \"4ec2e19d71065addb6c77b51d2691a32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.401034 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.400973 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ec2e19d71065addb6c77b51d2691a32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal\" (UID: \"4ec2e19d71065addb6c77b51d2691a32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.401034 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.400940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ec2e19d71065addb6c77b51d2691a32-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal\" (UID: \"4ec2e19d71065addb6c77b51d2691a32\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.401034 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.401004 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4e72ecf078b84cf1a21b2a5799579a9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-95.ec2.internal\" (UID: \"a4e72ecf078b84cf1a21b2a5799579a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.401034 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.401029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4e72ecf078b84cf1a21b2a5799579a9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-95.ec2.internal\" (UID: \"a4e72ecf078b84cf1a21b2a5799579a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.489128 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.489064 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:49.589870 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.589829 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:49.601207 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.601182 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.606501 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:49.606483 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-95.ec2.internal" Jul 13 14:45:49.690874 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:49.690833 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:50.820939 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:50.820893 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:50.921538 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:50.921493 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:51.022104 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:51.022073 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:51.069677 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.069604 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 14:45:51.070162 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.069770 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 14:45:51.122518 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:51.122490 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:51.176912 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.176870 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 14:40:50 +0000 UTC" deadline="2028-04-07 20:11:00.693500716 +0000 UTC" Jul 13 14:45:51.176912 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.176909 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15221h25m9.516599634s" Jul 13 14:45:51.189666 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.189641 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:45:51.195609 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:51.195572 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec2e19d71065addb6c77b51d2691a32.slice/crio-265a72c41fb944c7724f49ea072d469e4757d0949e6697e756f99027ac606257 WatchSource:0}: Error finding container 265a72c41fb944c7724f49ea072d469e4757d0949e6697e756f99027ac606257: Status 404 returned error can't find the container with id 265a72c41fb944c7724f49ea072d469e4757d0949e6697e756f99027ac606257 Jul 13 14:45:51.199448 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.199434 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 14:45:51.203927 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.203882 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" event={"ID":"4ec2e19d71065addb6c77b51d2691a32","Type":"ContainerStarted","Data":"265a72c41fb944c7724f49ea072d469e4757d0949e6697e756f99027ac606257"} Jul 13 14:45:51.222641 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:51.222609 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:51.280830 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.280806 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:45:51.315367 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.315325 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:45:51.316615 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.316597 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:45:51.316698 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.316629 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:45:51.316698 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.316640 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:45:51.323372 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:51.323313 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:51.423812 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:51.423767 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:51.455000 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:51.454974 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e72ecf078b84cf1a21b2a5799579a9.slice/crio-596e7ebe60fc247e83098da56553733de97f0e71f14ce5b1523167983781e0a5 WatchSource:0}: Error finding container 596e7ebe60fc247e83098da56553733de97f0e71f14ce5b1523167983781e0a5: Status 404 returned error can't find the container with id 596e7ebe60fc247e83098da56553733de97f0e71f14ce5b1523167983781e0a5 Jul 13 14:45:51.524868 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:51.524817 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-95.ec2.internal\" not found" Jul 13 14:45:51.622260 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.622239 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:45:51.630062 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.630029 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" Jul 13 14:45:51.646051 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.646032 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 14:45:51.647177 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.647165 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-95.ec2.internal" Jul 13 14:45:51.657629 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.657613 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 14:45:51.961273 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:51.961195 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:45:52.110123 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.110080 2579 apiserver.go:52] "Watching apiserver" Jul 13 14:45:52.118171 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.118149 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 14:45:52.119777 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.119756 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal","openshift-multus/multus-additional-cni-plugins-k9tlg","openshift-multus/multus-vdzl2","openshift-network-operator/iptables-alerter-4l644","kube-system/global-pull-secret-syncer-zclht","kube-system/konnectivity-agent-tw45d","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc","openshift-multus/network-metrics-daemon-nh2nq","openshift-network-diagnostics/network-check-target-cv8h7","openshift-ovn-kubernetes/ovnkube-node-h8xdx","kube-system/kube-apiserver-proxy-ip-10-0-133-95.ec2.internal","openshift-cluster-node-tuning-operator/tuned-26g4r","openshift-dns/node-resolver-lkrg2","openshift-image-registry/node-ca-89rws"] Jul 13 14:45:52.121456 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.121438 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.122749 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.122728 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lkrg2" Jul 13 14:45:52.123860 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.123842 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.124427 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.124376 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 14:45:52.124427 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.124422 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 14:45:52.124562 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.124550 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-86lq2\"" Jul 13 14:45:52.124627 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.124550 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 14:45:52.125309 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.125285 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 14:45:52.125434 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.125415 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-brlvl\"" Jul 13 14:45:52.126383 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.125689 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 14:45:52.126383 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.125700 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4l644" Jul 13 14:45:52.127582 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.127562 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 14:45:52.127930 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.127854 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 14:45:52.127930 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.127873 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 14:45:52.127930 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.127905 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 14:45:52.128314 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.128167 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ng9pb\"" Jul 13 14:45:52.128412 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.128390 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 14:45:52.128529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.128510 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rb995\"" Jul 13 14:45:52.128592 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.128544 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 14:45:52.128917 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.128738 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:52.128917 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.128819 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:45:52.128917 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.128885 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:45:52.129099 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.128885 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 14:45:52.130527 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.130164 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tw45d" Jul 13 14:45:52.131385 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.131368 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:45:52.131476 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.131418 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:45:52.132753 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.132719 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 14:45:52.132862 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.132754 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cbl5z\"" Jul 13 14:45:52.132862 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.132765 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-89rws" Jul 13 14:45:52.132970 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.132939 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 14:45:52.134190 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.134176 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.135734 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.135666 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 14:45:52.135734 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.135686 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 14:45:52.135734 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.135718 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.136108 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.136089 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 14:45:52.136423 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.136408 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6lkfj\"" Jul 13 14:45:52.136503 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.136470 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 14:45:52.136812 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.136800 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q7669\"" Jul 13 14:45:52.136859 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.136837 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 14:45:52.137219 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.137205 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:52.137285 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.137268 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:45:52.138186 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.138170 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-59qsf\"" Jul 13 14:45:52.138511 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.138499 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.139522 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.139505 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 14:45:52.139592 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.139510 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 14:45:52.139683 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.139668 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 14:45:52.139860 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.139847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-device-dir\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.139906 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.139871 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 14:45:52.139906 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.139869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-system-cni-dir\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.139970 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.139910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-var-lib-cni-bin\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.139970 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.139931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-var-lib-cni-multus\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.139970 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.139947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/687ef339-93d5-47be-931e-aacc68f61a06-dbus\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:52.140065 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.139980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.140065 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.140065 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99jnv\" (UniqueName: \"kubernetes.io/projected/25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1-kube-api-access-99jnv\") pod \"node-resolver-lkrg2\" (UID: \"25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1\") " pod="openshift-dns/node-resolver-lkrg2" Jul 13 14:45:52.140184 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140074 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-multus-daemon-config\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140184 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140098 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpcnq\" (UniqueName: \"kubernetes.io/projected/314eeac8-e095-44d1-ad77-af880fc56d01-kube-api-access-bpcnq\") pod \"iptables-alerter-4l644\" (UID: \"314eeac8-e095-44d1-ad77-af880fc56d01\") " pod="openshift-network-operator/iptables-alerter-4l644" Jul 13 14:45:52.140184 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:52.140184 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-socket-dir\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.140392 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hrlh\" (UniqueName: \"kubernetes.io/projected/d6733c40-1aed-4407-af44-f928972c70bc-kube-api-access-9hrlh\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.140392 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140223 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 14:45:52.140392 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1-hosts-file\") pod \"node-resolver-lkrg2\" (UID: \"25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1\") " pod="openshift-dns/node-resolver-lkrg2" Jul 13 14:45:52.140392 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-os-release\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140392 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-cni-binary-copy\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140392 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-multus-socket-dir-parent\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140392 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140352 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-run-multus-certs\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140392 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140377 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/314eeac8-e095-44d1-ad77-af880fc56d01-iptables-alerter-script\") pod \"iptables-alerter-4l644\" (UID: \"314eeac8-e095-44d1-ad77-af880fc56d01\") " pod="openshift-network-operator/iptables-alerter-4l644" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-cnibin\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-run-k8s-cni-cncf-io\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140459 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-run-netns\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140472 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-hostroot\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140493 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p84ft\" (UniqueName: \"kubernetes.io/projected/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-kube-api-access-p84ft\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140530 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/314eeac8-e095-44d1-ad77-af880fc56d01-host-slash\") pod \"iptables-alerter-4l644\" (UID: \"314eeac8-e095-44d1-ad77-af880fc56d01\") " pod="openshift-network-operator/iptables-alerter-4l644" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140555 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-multus-cni-dir\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-var-lib-kubelet\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/687ef339-93d5-47be-931e-aacc68f61a06-kubelet-config\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-registration-dir\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140674 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-sys-fs\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1-tmp-dir\") pod \"node-resolver-lkrg2\" (UID: \"25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1\") " pod="openshift-dns/node-resolver-lkrg2" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-multus-conf-dir\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.140756 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.140746 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-etc-kubernetes\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.141277 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.141262 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 14:45:52.141362 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.141278 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 14:45:52.141362 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.141298 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hhkcf\"" Jul 13 14:45:52.141362 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.141266 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:45:52.171578 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.171562 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8b79v" Jul 13 14:45:52.179474 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.179452 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8b79v" Jul 13 14:45:52.205721 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.205694 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-95.ec2.internal" event={"ID":"a4e72ecf078b84cf1a21b2a5799579a9","Type":"ContainerStarted","Data":"596e7ebe60fc247e83098da56553733de97f0e71f14ce5b1523167983781e0a5"} Jul 13 14:45:52.229419 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.229376 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 14:45:52.241576 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-run-ovn-kubernetes\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.241663 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-cnibin\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.241663 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-run-netns\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.241663 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241622 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/314eeac8-e095-44d1-ad77-af880fc56d01-host-slash\") pod \"iptables-alerter-4l644\" (UID: \"314eeac8-e095-44d1-ad77-af880fc56d01\") " pod="openshift-network-operator/iptables-alerter-4l644" Jul 13 14:45:52.241663 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-modprobe-d\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.241663 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241651 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33930854-38d6-42e1-80d5-fa8a9eef5155-tmp\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241673 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-var-lib-kubelet\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241673 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-run-netns\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241693 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-cnibin\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241697 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/687ef339-93d5-47be-931e-aacc68f61a06-kubelet-config\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241725 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-var-lib-kubelet\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241739 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-systemd-units\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241693 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/314eeac8-e095-44d1-ad77-af880fc56d01-host-slash\") pod \"iptables-alerter-4l644\" (UID: \"314eeac8-e095-44d1-ad77-af880fc56d01\") " pod="openshift-network-operator/iptables-alerter-4l644" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccd01179-7f16-4d02-8647-4395aa09e576-ovnkube-config\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241746 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/687ef339-93d5-47be-931e-aacc68f61a06-kubelet-config\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241818 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241853 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e4f81427-426f-4009-a1fc-1a2e9c436860-os-release\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241881 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e4f81427-426f-4009-a1fc-1a2e9c436860-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.241919 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241908 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-registration-dir\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241951 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-registration-dir\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-sys-fs\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1-tmp-dir\") pod \"node-resolver-lkrg2\" (UID: \"25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1\") " pod="openshift-dns/node-resolver-lkrg2" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.241998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgwtt\" (UniqueName: \"kubernetes.io/projected/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-kube-api-access-vgwtt\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-sys\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-lib-modules\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a80b9629-203e-4dfa-a1ef-548a3a668e06-agent-certs\") pod \"konnectivity-agent-tw45d\" (UID: \"a80b9629-203e-4dfa-a1ef-548a3a668e06\") " pod="kube-system/konnectivity-agent-tw45d" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242062 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-sys-fs\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242085 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e4f81427-426f-4009-a1fc-1a2e9c436860-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-device-dir\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-var-lib-cni-bin\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242137 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-device-dir\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-slash\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242170 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac81ad92-c6e5-4a69-a093-ca92f73b965c-serviceca\") pod \"node-ca-89rws\" (UID: \"ac81ad92-c6e5-4a69-a093-ca92f73b965c\") " pod="openshift-image-registry/node-ca-89rws" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e4f81427-426f-4009-a1fc-1a2e9c436860-cni-binary-copy\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-582kp\" (UniqueName: \"kubernetes.io/projected/e4f81427-426f-4009-a1fc-1a2e9c436860-kube-api-access-582kp\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.242529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242231 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-var-lib-cni-bin\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-host\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242268 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4f81427-426f-4009-a1fc-1a2e9c436860-system-cni-dir\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-run-netns\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-cni-netd\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242323 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1-tmp-dir\") pod \"node-resolver-lkrg2\" (UID: \"25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1\") " pod="openshift-dns/node-resolver-lkrg2" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccd01179-7f16-4d02-8647-4395aa09e576-ovnkube-script-lib\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242392 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-kubernetes\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-socket-dir\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-var-lib-openvswitch\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccd01179-7f16-4d02-8647-4395aa09e576-ovn-node-metrics-cert\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-sysconfig\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242514 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-socket-dir\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-sysctl-d\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-sysctl-conf\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-run\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242592 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-cni-bin\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.243180 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1-hosts-file\") pod \"node-resolver-lkrg2\" (UID: \"25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1\") " pod="openshift-dns/node-resolver-lkrg2" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-cni-binary-copy\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-run-multus-certs\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242711 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1-hosts-file\") pod \"node-resolver-lkrg2\" (UID: \"25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1\") " pod="openshift-dns/node-resolver-lkrg2" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/314eeac8-e095-44d1-ad77-af880fc56d01-iptables-alerter-script\") pod \"iptables-alerter-4l644\" (UID: \"314eeac8-e095-44d1-ad77-af880fc56d01\") " pod="openshift-network-operator/iptables-alerter-4l644" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242739 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-run-multus-certs\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242769 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-etc-openvswitch\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242864 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-var-lib-kubelet\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-node-log\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-run-k8s-cni-cncf-io\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-hostroot\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242965 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-run-k8s-cni-cncf-io\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.242987 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p84ft\" (UniqueName: \"kubernetes.io/projected/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-kube-api-access-p84ft\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243006 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-run-openvswitch\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243030 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-cni-binary-copy\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243046 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-hostroot\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx852\" (UniqueName: \"kubernetes.io/projected/33930854-38d6-42e1-80d5-fa8a9eef5155-kube-api-access-gx852\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.243839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac81ad92-c6e5-4a69-a093-ca92f73b965c-host\") pod \"node-ca-89rws\" (UID: \"ac81ad92-c6e5-4a69-a093-ca92f73b965c\") " pod="openshift-image-registry/node-ca-89rws" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e4f81427-426f-4009-a1fc-1a2e9c436860-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-multus-cni-dir\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-log-socket\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243189 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccd01179-7f16-4d02-8647-4395aa09e576-env-overrides\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-multus-conf-dir\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-etc-kubernetes\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-system-cni-dir\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243261 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/314eeac8-e095-44d1-ad77-af880fc56d01-iptables-alerter-script\") pod \"iptables-alerter-4l644\" (UID: \"314eeac8-e095-44d1-ad77-af880fc56d01\") " pod="openshift-network-operator/iptables-alerter-4l644" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243271 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-multus-conf-dir\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243286 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-etc-kubernetes\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-var-lib-cni-multus\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243287 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-system-cni-dir\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243323 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-multus-cni-dir\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243329 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-host-var-lib-cni-multus\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/687ef339-93d5-47be-931e-aacc68f61a06-dbus\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-run-ovn\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.244377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243420 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-tuned\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243445 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/687ef339-93d5-47be-931e-aacc68f61a06-dbus\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243469 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99jnv\" (UniqueName: \"kubernetes.io/projected/25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1-kube-api-access-99jnv\") pod \"node-resolver-lkrg2\" (UID: \"25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1\") " pod="openshift-dns/node-resolver-lkrg2" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243524 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-multus-daemon-config\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243548 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpcnq\" (UniqueName: \"kubernetes.io/projected/314eeac8-e095-44d1-ad77-af880fc56d01-kube-api-access-bpcnq\") pod \"iptables-alerter-4l644\" (UID: \"314eeac8-e095-44d1-ad77-af880fc56d01\") " pod="openshift-network-operator/iptables-alerter-4l644" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243550 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6733c40-1aed-4407-af44-f928972c70bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243634 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb5m7\" (UniqueName: \"kubernetes.io/projected/ccd01179-7f16-4d02-8647-4395aa09e576-kube-api-access-wb5m7\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243667 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz7fd\" (UniqueName: \"kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd\") pod \"network-check-target-cv8h7\" (UID: \"448bca0a-4f78-4b52-b3cb-daaf9ee34ab7\") " pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.243680 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243689 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn7zp\" (UniqueName: \"kubernetes.io/projected/ac81ad92-c6e5-4a69-a093-ca92f73b965c-kube-api-access-hn7zp\") pod \"node-ca-89rws\" (UID: \"ac81ad92-c6e5-4a69-a093-ca92f73b965c\") " pod="openshift-image-registry/node-ca-89rws" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hrlh\" (UniqueName: \"kubernetes.io/projected/d6733c40-1aed-4407-af44-f928972c70bc-kube-api-access-9hrlh\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.244826 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.243762 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret podName:687ef339-93d5-47be-931e-aacc68f61a06 nodeName:}" failed. No retries permitted until 2026-07-13 14:45:52.743732035 +0000 UTC m=+3.027581248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret") pod "global-pull-secret-syncer-zclht" (UID: "687ef339-93d5-47be-931e-aacc68f61a06") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:45:52.245261 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243789 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-run-systemd\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.245261 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243827 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e4f81427-426f-4009-a1fc-1a2e9c436860-cnibin\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.245261 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-os-release\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.245261 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243886 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-multus-socket-dir-parent\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.245261 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-kubelet\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.245261 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-systemd\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.245261 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a80b9629-203e-4dfa-a1ef-548a3a668e06-konnectivity-ca\") pod \"konnectivity-agent-tw45d\" (UID: \"a80b9629-203e-4dfa-a1ef-548a3a668e06\") " pod="kube-system/konnectivity-agent-tw45d" Jul 13 14:45:52.245261 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243965 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-multus-socket-dir-parent\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.245261 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.243987 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-os-release\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.245261 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.244028 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-multus-daemon-config\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.250266 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.250249 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 14:45:52.253828 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.253797 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p84ft\" (UniqueName: \"kubernetes.io/projected/7074c75a-9e03-40a9-b0cf-0d4b1a3f1193-kube-api-access-p84ft\") pod \"multus-vdzl2\" (UID: \"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193\") " pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.255995 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.255966 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99jnv\" (UniqueName: \"kubernetes.io/projected/25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1-kube-api-access-99jnv\") pod \"node-resolver-lkrg2\" (UID: \"25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1\") " pod="openshift-dns/node-resolver-lkrg2" Jul 13 14:45:52.256157 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.256142 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hrlh\" (UniqueName: \"kubernetes.io/projected/d6733c40-1aed-4407-af44-f928972c70bc-kube-api-access-9hrlh\") pod \"aws-ebs-csi-driver-node-j92nc\" (UID: \"d6733c40-1aed-4407-af44-f928972c70bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.256199 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.256185 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpcnq\" (UniqueName: \"kubernetes.io/projected/314eeac8-e095-44d1-ad77-af880fc56d01-kube-api-access-bpcnq\") pod \"iptables-alerter-4l644\" (UID: \"314eeac8-e095-44d1-ad77-af880fc56d01\") " pod="openshift-network-operator/iptables-alerter-4l644" Jul 13 14:45:52.344227 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-run-ovn\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344406 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344233 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344406 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-tuned\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.344406 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344248 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-run-ovn\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344406 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344292 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344406 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344292 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb5m7\" (UniqueName: \"kubernetes.io/projected/ccd01179-7f16-4d02-8647-4395aa09e576-kube-api-access-wb5m7\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344406 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7fd\" (UniqueName: \"kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd\") pod \"network-check-target-cv8h7\" (UID: \"448bca0a-4f78-4b52-b3cb-daaf9ee34ab7\") " pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:45:52.344406 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn7zp\" (UniqueName: \"kubernetes.io/projected/ac81ad92-c6e5-4a69-a093-ca92f73b965c-kube-api-access-hn7zp\") pod \"node-ca-89rws\" (UID: \"ac81ad92-c6e5-4a69-a093-ca92f73b965c\") " pod="openshift-image-registry/node-ca-89rws" Jul 13 14:45:52.344406 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-run-systemd\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344439 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-run-systemd\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e4f81427-426f-4009-a1fc-1a2e9c436860-cnibin\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344491 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-kubelet\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-systemd\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344531 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-kubelet\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344539 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e4f81427-426f-4009-a1fc-1a2e9c436860-cnibin\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a80b9629-203e-4dfa-a1ef-548a3a668e06-konnectivity-ca\") pod \"konnectivity-agent-tw45d\" (UID: \"a80b9629-203e-4dfa-a1ef-548a3a668e06\") " pod="kube-system/konnectivity-agent-tw45d" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344577 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-systemd\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-run-ovn-kubernetes\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-modprobe-d\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33930854-38d6-42e1-80d5-fa8a9eef5155-tmp\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344661 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-run-ovn-kubernetes\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-systemd-units\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344709 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-systemd-units\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344721 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccd01179-7f16-4d02-8647-4395aa09e576-ovnkube-config\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.344770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344754 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:52.345353 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e4f81427-426f-4009-a1fc-1a2e9c436860-os-release\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.345353 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344806 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e4f81427-426f-4009-a1fc-1a2e9c436860-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.345353 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344754 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-modprobe-d\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.345353 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.344823 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:45:52.345353 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344879 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e4f81427-426f-4009-a1fc-1a2e9c436860-os-release\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.345353 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.345271 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs podName:db0f7b6d-a74a-4e54-a9f2-9069e242a4e3 nodeName:}" failed. No retries permitted until 2026-07-13 14:45:52.845243824 +0000 UTC m=+3.129093036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs") pod "network-metrics-daemon-nh2nq" (UID: "db0f7b6d-a74a-4e54-a9f2-9069e242a4e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:45:52.345646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.344835 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgwtt\" (UniqueName: \"kubernetes.io/projected/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-kube-api-access-vgwtt\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:52.345646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.345463 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a80b9629-203e-4dfa-a1ef-548a3a668e06-konnectivity-ca\") pod \"konnectivity-agent-tw45d\" (UID: \"a80b9629-203e-4dfa-a1ef-548a3a668e06\") " pod="kube-system/konnectivity-agent-tw45d" Jul 13 14:45:52.345646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.345527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-sys\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.345646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.345566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-lib-modules\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.345646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.345599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a80b9629-203e-4dfa-a1ef-548a3a668e06-agent-certs\") pod \"konnectivity-agent-tw45d\" (UID: \"a80b9629-203e-4dfa-a1ef-548a3a668e06\") " pod="kube-system/konnectivity-agent-tw45d" Jul 13 14:45:52.345646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.345608 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ccd01179-7f16-4d02-8647-4395aa09e576-ovnkube-config\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.345646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.345634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e4f81427-426f-4009-a1fc-1a2e9c436860-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.346019 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.345654 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e4f81427-426f-4009-a1fc-1a2e9c436860-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.346019 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.345816 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-lib-modules\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.346127 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346102 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e4f81427-426f-4009-a1fc-1a2e9c436860-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.346250 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-slash\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.346310 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac81ad92-c6e5-4a69-a093-ca92f73b965c-serviceca\") pod \"node-ca-89rws\" (UID: \"ac81ad92-c6e5-4a69-a093-ca92f73b965c\") " pod="openshift-image-registry/node-ca-89rws" Jul 13 14:45:52.346390 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346304 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-sys\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.346390 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e4f81427-426f-4009-a1fc-1a2e9c436860-cni-binary-copy\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.346390 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-582kp\" (UniqueName: \"kubernetes.io/projected/e4f81427-426f-4009-a1fc-1a2e9c436860-kube-api-access-582kp\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.346390 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346386 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-slash\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.346585 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-host\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.346585 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4f81427-426f-4009-a1fc-1a2e9c436860-system-cni-dir\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.346585 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-run-netns\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.346585 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-cni-netd\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.346585 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccd01179-7f16-4d02-8647-4395aa09e576-ovnkube-script-lib\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.346825 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-kubernetes\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.346825 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-var-lib-openvswitch\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.346825 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346677 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccd01179-7f16-4d02-8647-4395aa09e576-ovn-node-metrics-cert\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.346825 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-sysconfig\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.346825 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-sysctl-d\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.346825 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-sysctl-conf\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.346825 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-run\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.346825 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-cni-bin\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.347209 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-etc-openvswitch\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.347209 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-var-lib-kubelet\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.347209 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346919 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e4f81427-426f-4009-a1fc-1a2e9c436860-cni-binary-copy\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.347209 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346996 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-node-log\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.347209 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.347111 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-host\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.347209 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.347174 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4f81427-426f-4009-a1fc-1a2e9c436860-system-cni-dir\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.347509 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.347229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-run-netns\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.347509 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.346922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-node-log\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.347509 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.347278 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-cni-netd\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.347509 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.347287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-run-openvswitch\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.347509 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.347355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx852\" (UniqueName: \"kubernetes.io/projected/33930854-38d6-42e1-80d5-fa8a9eef5155-kube-api-access-gx852\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.347509 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.347385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac81ad92-c6e5-4a69-a093-ca92f73b965c-host\") pod \"node-ca-89rws\" (UID: \"ac81ad92-c6e5-4a69-a093-ca92f73b965c\") " pod="openshift-image-registry/node-ca-89rws" Jul 13 14:45:52.347509 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.347414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e4f81427-426f-4009-a1fc-1a2e9c436860-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.347509 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.347442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-log-socket\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.347509 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.347464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccd01179-7f16-4d02-8647-4395aa09e576-env-overrides\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.348018 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.347886 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ccd01179-7f16-4d02-8647-4395aa09e576-env-overrides\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.348018 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.347954 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-run-openvswitch\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.348114 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348071 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac81ad92-c6e5-4a69-a093-ca92f73b965c-serviceca\") pod \"node-ca-89rws\" (UID: \"ac81ad92-c6e5-4a69-a093-ca92f73b965c\") " pod="openshift-image-registry/node-ca-89rws" Jul 13 14:45:52.348208 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348187 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac81ad92-c6e5-4a69-a093-ca92f73b965c-host\") pod \"node-ca-89rws\" (UID: \"ac81ad92-c6e5-4a69-a093-ca92f73b965c\") " pod="openshift-image-registry/node-ca-89rws" Jul 13 14:45:52.348265 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348240 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33930854-38d6-42e1-80d5-fa8a9eef5155-tmp\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.348370 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348350 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e4f81427-426f-4009-a1fc-1a2e9c436860-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.348446 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348406 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-log-socket\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.348502 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348460 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-host-cni-bin\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.348502 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348479 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ccd01179-7f16-4d02-8647-4395aa09e576-ovnkube-script-lib\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.348602 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348549 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-var-lib-openvswitch\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.348602 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348572 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-sysconfig\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.348602 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348587 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-sysctl-conf\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.348750 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348605 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a80b9629-203e-4dfa-a1ef-548a3a668e06-agent-certs\") pod \"konnectivity-agent-tw45d\" (UID: \"a80b9629-203e-4dfa-a1ef-548a3a668e06\") " pod="kube-system/konnectivity-agent-tw45d" Jul 13 14:45:52.348750 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348639 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-sysctl-d\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.348750 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348649 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-var-lib-kubelet\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.348750 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348651 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-run\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.348750 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348687 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ccd01179-7f16-4d02-8647-4395aa09e576-etc-openvswitch\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.348964 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.348843 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-kubernetes\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.349383 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.349362 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/33930854-38d6-42e1-80d5-fa8a9eef5155-etc-tuned\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.351231 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.351211 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccd01179-7f16-4d02-8647-4395aa09e576-ovn-node-metrics-cert\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.352285 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.352264 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:45:52.352401 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.352293 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:45:52.352401 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.352308 2579 projected.go:196] Error preparing data for projected volume kube-api-access-xz7fd for pod openshift-network-diagnostics/network-check-target-cv8h7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:45:52.352401 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.352386 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd podName:448bca0a-4f78-4b52-b3cb-daaf9ee34ab7 nodeName:}" failed. No retries permitted until 2026-07-13 14:45:52.852364632 +0000 UTC m=+3.136213868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xz7fd" (UniqueName: "kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd") pod "network-check-target-cv8h7" (UID: "448bca0a-4f78-4b52-b3cb-daaf9ee34ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:45:52.354278 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.354249 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgwtt\" (UniqueName: \"kubernetes.io/projected/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-kube-api-access-vgwtt\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:52.354398 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.354378 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb5m7\" (UniqueName: \"kubernetes.io/projected/ccd01179-7f16-4d02-8647-4395aa09e576-kube-api-access-wb5m7\") pod \"ovnkube-node-h8xdx\" (UID: \"ccd01179-7f16-4d02-8647-4395aa09e576\") " pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.354709 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.354678 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn7zp\" (UniqueName: \"kubernetes.io/projected/ac81ad92-c6e5-4a69-a093-ca92f73b965c-kube-api-access-hn7zp\") pod \"node-ca-89rws\" (UID: \"ac81ad92-c6e5-4a69-a093-ca92f73b965c\") " pod="openshift-image-registry/node-ca-89rws" Jul 13 14:45:52.356046 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.356029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx852\" (UniqueName: \"kubernetes.io/projected/33930854-38d6-42e1-80d5-fa8a9eef5155-kube-api-access-gx852\") pod \"tuned-26g4r\" (UID: \"33930854-38d6-42e1-80d5-fa8a9eef5155\") " pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.356191 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.356176 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-582kp\" (UniqueName: \"kubernetes.io/projected/e4f81427-426f-4009-a1fc-1a2e9c436860-kube-api-access-582kp\") pod \"multus-additional-cni-plugins-k9tlg\" (UID: \"e4f81427-426f-4009-a1fc-1a2e9c436860\") " pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.433248 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.433217 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" Jul 13 14:45:52.439676 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.439655 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lkrg2" Jul 13 14:45:52.441664 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:52.441642 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6733c40_1aed_4407_af44_f928972c70bc.slice/crio-4c47631b6bc2fdb4939df7f5b59974fc8b154558299fd0c2de6aca4050fc5e55 WatchSource:0}: Error finding container 4c47631b6bc2fdb4939df7f5b59974fc8b154558299fd0c2de6aca4050fc5e55: Status 404 returned error can't find the container with id 4c47631b6bc2fdb4939df7f5b59974fc8b154558299fd0c2de6aca4050fc5e55 Jul 13 14:45:52.446780 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.446756 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vdzl2" Jul 13 14:45:52.447017 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:52.446995 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25809cb4_9092_4b5b_bdf8_c1ddf28a4fa1.slice/crio-5064f32f8087bdd72e0c7959c655cb2ceff0052bcde5b60c6ee73f4e80bf5efb WatchSource:0}: Error finding container 5064f32f8087bdd72e0c7959c655cb2ceff0052bcde5b60c6ee73f4e80bf5efb: Status 404 returned error can't find the container with id 5064f32f8087bdd72e0c7959c655cb2ceff0052bcde5b60c6ee73f4e80bf5efb Jul 13 14:45:52.450531 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.450516 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4l644" Jul 13 14:45:52.456596 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.456577 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tw45d" Jul 13 14:45:52.457322 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:52.457292 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7074c75a_9e03_40a9_b0cf_0d4b1a3f1193.slice/crio-1160a249d87a8ad83e2868149c86e9a91a5133e9b0d8b28c179dd353bb59c1af WatchSource:0}: Error finding container 1160a249d87a8ad83e2868149c86e9a91a5133e9b0d8b28c179dd353bb59c1af: Status 404 returned error can't find the container with id 1160a249d87a8ad83e2868149c86e9a91a5133e9b0d8b28c179dd353bb59c1af Jul 13 14:45:52.459862 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:52.459843 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314eeac8_e095_44d1_ad77_af880fc56d01.slice/crio-9bea582bc6980d73f55ed172cbba40e76a68d1c06aabb4cde6dfd8c4189208f2 WatchSource:0}: Error finding container 9bea582bc6980d73f55ed172cbba40e76a68d1c06aabb4cde6dfd8c4189208f2: Status 404 returned error can't find the container with id 9bea582bc6980d73f55ed172cbba40e76a68d1c06aabb4cde6dfd8c4189208f2 Jul 13 14:45:52.461253 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.461222 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-89rws" Jul 13 14:45:52.467221 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.467179 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k9tlg" Jul 13 14:45:52.467539 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:52.467521 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80b9629_203e_4dfa_a1ef_548a3a668e06.slice/crio-a1035f44e2e40fa4dfdf23fe3fd852ade850e996c56b19f31c41425f1c5a9e2c WatchSource:0}: Error finding container a1035f44e2e40fa4dfdf23fe3fd852ade850e996c56b19f31c41425f1c5a9e2c: Status 404 returned error can't find the container with id a1035f44e2e40fa4dfdf23fe3fd852ade850e996c56b19f31c41425f1c5a9e2c Jul 13 14:45:52.472875 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.472856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:45:52.473031 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:52.473005 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac81ad92_c6e5_4a69_a093_ca92f73b965c.slice/crio-795993e286bc022adb30dafec20554986becf490391e05f52077c0f443d89f2c WatchSource:0}: Error finding container 795993e286bc022adb30dafec20554986becf490391e05f52077c0f443d89f2c: Status 404 returned error can't find the container with id 795993e286bc022adb30dafec20554986becf490391e05f52077c0f443d89f2c Jul 13 14:45:52.475529 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:52.475481 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f81427_426f_4009_a1fc_1a2e9c436860.slice/crio-1720efe12bc6500b15418d9cb868cc193ec5c8d32bff9bb67ba11ca6187feae1 WatchSource:0}: Error finding container 1720efe12bc6500b15418d9cb868cc193ec5c8d32bff9bb67ba11ca6187feae1: Status 404 returned error can't find the container with id 1720efe12bc6500b15418d9cb868cc193ec5c8d32bff9bb67ba11ca6187feae1 Jul 13 14:45:52.476253 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.476127 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26g4r" Jul 13 14:45:52.482139 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:52.482092 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd01179_7f16_4d02_8647_4395aa09e576.slice/crio-00a51b7154e7c33dd6c2704d6d9a39fd2ea9bcc6ef71294e9274c68605d2a326 WatchSource:0}: Error finding container 00a51b7154e7c33dd6c2704d6d9a39fd2ea9bcc6ef71294e9274c68605d2a326: Status 404 returned error can't find the container with id 00a51b7154e7c33dd6c2704d6d9a39fd2ea9bcc6ef71294e9274c68605d2a326 Jul 13 14:45:52.484703 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:45:52.484685 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33930854_38d6_42e1_80d5_fa8a9eef5155.slice/crio-02ca1818a3499a0f15117356467ccf5d161da3b844668f74283e59dc4ad8cb56 WatchSource:0}: Error finding container 02ca1818a3499a0f15117356467ccf5d161da3b844668f74283e59dc4ad8cb56: Status 404 returned error can't find the container with id 02ca1818a3499a0f15117356467ccf5d161da3b844668f74283e59dc4ad8cb56 Jul 13 14:45:52.750181 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.750102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:52.750358 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.750285 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:45:52.750503 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.750360 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret podName:687ef339-93d5-47be-931e-aacc68f61a06 nodeName:}" failed. No retries permitted until 2026-07-13 14:45:53.75032658 +0000 UTC m=+4.034175778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret") pod "global-pull-secret-syncer-zclht" (UID: "687ef339-93d5-47be-931e-aacc68f61a06") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:45:52.851395 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.851361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:52.851554 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.851528 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:45:52.851633 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.851597 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs podName:db0f7b6d-a74a-4e54-a9f2-9069e242a4e3 nodeName:}" failed. No retries permitted until 2026-07-13 14:45:53.851575657 +0000 UTC m=+4.135424864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs") pod "network-metrics-daemon-nh2nq" (UID: "db0f7b6d-a74a-4e54-a9f2-9069e242a4e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:45:52.952263 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:52.952224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7fd\" (UniqueName: \"kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd\") pod \"network-check-target-cv8h7\" (UID: \"448bca0a-4f78-4b52-b3cb-daaf9ee34ab7\") " pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:45:52.952465 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.952444 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:45:52.952527 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.952467 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:45:52.952527 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.952480 2579 projected.go:196] Error preparing data for projected volume kube-api-access-xz7fd for pod openshift-network-diagnostics/network-check-target-cv8h7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:45:52.952670 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:52.952533 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd podName:448bca0a-4f78-4b52-b3cb-daaf9ee34ab7 nodeName:}" failed. No retries permitted until 2026-07-13 14:45:53.952515334 +0000 UTC m=+4.236364534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xz7fd" (UniqueName: "kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd") pod "network-check-target-cv8h7" (UID: "448bca0a-4f78-4b52-b3cb-daaf9ee34ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:45:53.181961 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.181917 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 14:40:52 +0000 UTC" deadline="2028-04-19 22:00:18.549032248 +0000 UTC" Jul 13 14:45:53.181961 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.181960 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15511h14m25.367077316s" Jul 13 14:45:53.214151 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.214042 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9tlg" event={"ID":"e4f81427-426f-4009-a1fc-1a2e9c436860","Type":"ContainerStarted","Data":"1720efe12bc6500b15418d9cb868cc193ec5c8d32bff9bb67ba11ca6187feae1"} Jul 13 14:45:53.221823 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.221758 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4l644" event={"ID":"314eeac8-e095-44d1-ad77-af880fc56d01","Type":"ContainerStarted","Data":"9bea582bc6980d73f55ed172cbba40e76a68d1c06aabb4cde6dfd8c4189208f2"} Jul 13 14:45:53.240748 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.240633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vdzl2" event={"ID":"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193","Type":"ContainerStarted","Data":"1160a249d87a8ad83e2868149c86e9a91a5133e9b0d8b28c179dd353bb59c1af"} Jul 13 14:45:53.251422 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.251317 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lkrg2" event={"ID":"25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1","Type":"ContainerStarted","Data":"5064f32f8087bdd72e0c7959c655cb2ceff0052bcde5b60c6ee73f4e80bf5efb"} Jul 13 14:45:53.256221 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.256112 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" event={"ID":"d6733c40-1aed-4407-af44-f928972c70bc","Type":"ContainerStarted","Data":"4c47631b6bc2fdb4939df7f5b59974fc8b154558299fd0c2de6aca4050fc5e55"} Jul 13 14:45:53.269882 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.269833 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26g4r" event={"ID":"33930854-38d6-42e1-80d5-fa8a9eef5155","Type":"ContainerStarted","Data":"02ca1818a3499a0f15117356467ccf5d161da3b844668f74283e59dc4ad8cb56"} Jul 13 14:45:53.284108 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.284077 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" event={"ID":"ccd01179-7f16-4d02-8647-4395aa09e576","Type":"ContainerStarted","Data":"00a51b7154e7c33dd6c2704d6d9a39fd2ea9bcc6ef71294e9274c68605d2a326"} Jul 13 14:45:53.295073 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.295027 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-89rws" event={"ID":"ac81ad92-c6e5-4a69-a093-ca92f73b965c","Type":"ContainerStarted","Data":"795993e286bc022adb30dafec20554986becf490391e05f52077c0f443d89f2c"} Jul 13 14:45:53.305636 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.305569 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tw45d" event={"ID":"a80b9629-203e-4dfa-a1ef-548a3a668e06","Type":"ContainerStarted","Data":"a1035f44e2e40fa4dfdf23fe3fd852ade850e996c56b19f31c41425f1c5a9e2c"} Jul 13 14:45:53.759311 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.758677 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:53.759311 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:53.758853 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:45:53.759311 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:53.758915 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret podName:687ef339-93d5-47be-931e-aacc68f61a06 nodeName:}" failed. No retries permitted until 2026-07-13 14:45:55.758897416 +0000 UTC m=+6.042746625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret") pod "global-pull-secret-syncer-zclht" (UID: "687ef339-93d5-47be-931e-aacc68f61a06") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:45:53.859352 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.859298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:53.859526 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:53.859476 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:45:53.859591 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:53.859540 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs podName:db0f7b6d-a74a-4e54-a9f2-9069e242a4e3 nodeName:}" failed. No retries permitted until 2026-07-13 14:45:55.859520848 +0000 UTC m=+6.143370045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs") pod "network-metrics-daemon-nh2nq" (UID: "db0f7b6d-a74a-4e54-a9f2-9069e242a4e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:45:53.960251 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:53.960215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7fd\" (UniqueName: \"kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd\") pod \"network-check-target-cv8h7\" (UID: \"448bca0a-4f78-4b52-b3cb-daaf9ee34ab7\") " pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:45:53.960457 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:53.960437 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:45:53.960542 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:53.960467 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:45:53.960542 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:53.960481 2579 projected.go:196] Error preparing data for projected volume kube-api-access-xz7fd for pod openshift-network-diagnostics/network-check-target-cv8h7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:45:53.960692 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:53.960541 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd podName:448bca0a-4f78-4b52-b3cb-daaf9ee34ab7 nodeName:}" failed. No retries permitted until 2026-07-13 14:45:55.960523079 +0000 UTC m=+6.244372280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xz7fd" (UniqueName: "kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd") pod "network-check-target-cv8h7" (UID: "448bca0a-4f78-4b52-b3cb-daaf9ee34ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:45:54.182228 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:54.182146 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 14:40:52 +0000 UTC" deadline="2028-03-17 06:47:27.605335388 +0000 UTC" Jul 13 14:45:54.182228 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:54.182185 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14704h1m33.423154693s" Jul 13 14:45:54.201503 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:54.201472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:45:54.201674 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:54.201472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:54.201674 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:54.201602 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:45:54.201799 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:54.201702 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:45:54.201799 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:54.201768 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:54.201893 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:54.201852 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:45:55.782017 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:55.781973 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:55.782563 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:55.782138 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:45:55.782563 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:55.782202 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret podName:687ef339-93d5-47be-931e-aacc68f61a06 nodeName:}" failed. No retries permitted until 2026-07-13 14:45:59.782183174 +0000 UTC m=+10.066032383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret") pod "global-pull-secret-syncer-zclht" (UID: "687ef339-93d5-47be-931e-aacc68f61a06") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:45:55.883245 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:55.882656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:55.883245 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:55.882841 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:45:55.883245 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:55.882908 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs podName:db0f7b6d-a74a-4e54-a9f2-9069e242a4e3 nodeName:}" failed. No retries permitted until 2026-07-13 14:45:59.882889057 +0000 UTC m=+10.166738254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs") pod "network-metrics-daemon-nh2nq" (UID: "db0f7b6d-a74a-4e54-a9f2-9069e242a4e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:45:55.984684 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:55.983984 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7fd\" (UniqueName: \"kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd\") pod \"network-check-target-cv8h7\" (UID: \"448bca0a-4f78-4b52-b3cb-daaf9ee34ab7\") " pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:45:55.984684 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:55.984163 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:45:55.984684 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:55.984185 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:45:55.984684 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:55.984197 2579 projected.go:196] Error preparing data for projected volume kube-api-access-xz7fd for pod openshift-network-diagnostics/network-check-target-cv8h7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:45:55.984684 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:55.984256 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd podName:448bca0a-4f78-4b52-b3cb-daaf9ee34ab7 nodeName:}" failed. No retries permitted until 2026-07-13 14:45:59.984237768 +0000 UTC m=+10.268086967 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xz7fd" (UniqueName: "kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd") pod "network-check-target-cv8h7" (UID: "448bca0a-4f78-4b52-b3cb-daaf9ee34ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:45:56.204949 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:56.204477 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:56.204949 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:56.204606 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:45:56.204949 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:56.204888 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:45:56.205245 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:56.204978 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:45:56.205245 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:56.205037 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:56.205245 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:56.205103 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:45:58.202388 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:58.202354 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:45:58.202843 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:58.202358 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:58.202843 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:58.202493 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:45:58.202843 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:58.202592 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:45:58.202843 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:58.202354 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:58.202843 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:58.202685 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:45:59.818956 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:59.818409 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:45:59.818956 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:59.818589 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:45:59.818956 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:59.818762 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret podName:687ef339-93d5-47be-931e-aacc68f61a06 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:07.818743543 +0000 UTC m=+18.102592764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret") pod "global-pull-secret-syncer-zclht" (UID: "687ef339-93d5-47be-931e-aacc68f61a06") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:45:59.920017 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:45:59.919973 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:45:59.920184 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:59.920122 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:45:59.920184 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:45:59.920184 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs podName:db0f7b6d-a74a-4e54-a9f2-9069e242a4e3 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:07.92016566 +0000 UTC m=+18.204014868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs") pod "network-metrics-daemon-nh2nq" (UID: "db0f7b6d-a74a-4e54-a9f2-9069e242a4e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:46:00.021199 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:00.021155 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7fd\" (UniqueName: \"kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd\") pod \"network-check-target-cv8h7\" (UID: \"448bca0a-4f78-4b52-b3cb-daaf9ee34ab7\") " pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:00.021411 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:00.021370 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:46:00.021411 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:00.021398 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:46:00.021411 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:00.021412 2579 projected.go:196] Error preparing data for projected volume kube-api-access-xz7fd for pod openshift-network-diagnostics/network-check-target-cv8h7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:46:00.021564 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:00.021477 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd podName:448bca0a-4f78-4b52-b3cb-daaf9ee34ab7 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:08.021458775 +0000 UTC m=+18.305307975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xz7fd" (UniqueName: "kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd") pod "network-check-target-cv8h7" (UID: "448bca0a-4f78-4b52-b3cb-daaf9ee34ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:46:00.201329 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:00.201301 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:00.201750 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:00.201598 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:00.201750 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:00.201628 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:00.201993 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:00.201967 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:00.202090 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:00.202067 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:00.202153 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:00.201831 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:02.201502 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:02.201378 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:02.201963 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:02.201524 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:02.201963 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:02.201851 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:02.201963 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:02.201925 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:02.202132 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:02.201967 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:02.202132 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:02.202031 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:04.200811 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:04.200770 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:04.201323 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:04.200776 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:04.201323 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:04.200877 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:04.201323 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:04.200776 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:04.201323 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:04.200961 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:04.201323 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:04.201077 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:06.200603 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:06.200567 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:06.200603 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:06.200588 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:06.201118 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:06.200578 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:06.201118 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:06.200706 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:06.201118 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:06.200787 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:06.201118 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:06.200913 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:07.877086 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:07.877031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:07.877606 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:07.877218 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:46:07.877606 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:07.877294 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret podName:687ef339-93d5-47be-931e-aacc68f61a06 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:23.877273595 +0000 UTC m=+34.161122807 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret") pod "global-pull-secret-syncer-zclht" (UID: "687ef339-93d5-47be-931e-aacc68f61a06") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:46:07.978358 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:07.978313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:07.978513 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:07.978464 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:46:07.978556 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:07.978543 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs podName:db0f7b6d-a74a-4e54-a9f2-9069e242a4e3 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:23.978522121 +0000 UTC m=+34.262371338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs") pod "network-metrics-daemon-nh2nq" (UID: "db0f7b6d-a74a-4e54-a9f2-9069e242a4e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:46:08.079672 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:08.079630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7fd\" (UniqueName: \"kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd\") pod \"network-check-target-cv8h7\" (UID: \"448bca0a-4f78-4b52-b3cb-daaf9ee34ab7\") " pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:08.079855 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:08.079809 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:46:08.079855 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:08.079834 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:46:08.079855 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:08.079847 2579 projected.go:196] Error preparing data for projected volume kube-api-access-xz7fd for pod openshift-network-diagnostics/network-check-target-cv8h7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:46:08.080010 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:08.079910 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd podName:448bca0a-4f78-4b52-b3cb-daaf9ee34ab7 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:24.079891538 +0000 UTC m=+34.363740754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xz7fd" (UniqueName: "kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd") pod "network-check-target-cv8h7" (UID: "448bca0a-4f78-4b52-b3cb-daaf9ee34ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:46:08.200847 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:08.200755 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:08.200997 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:08.200755 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:08.200997 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:08.200897 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:08.200997 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:08.200907 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:08.200997 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:08.200961 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:08.201186 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:08.201036 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:10.201308 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:10.201276 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:10.201785 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:10.201411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:10.201785 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:10.201414 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:10.201785 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:10.201533 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:10.201785 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:10.201586 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:10.201785 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:10.201649 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:12.201212 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:12.201173 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:12.201710 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:12.201183 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:12.201710 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:12.201315 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:12.201710 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:12.201318 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:12.201710 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:12.201429 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:12.201710 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:12.201481 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:13.376679 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:13.376364 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26g4r" event={"ID":"33930854-38d6-42e1-80d5-fa8a9eef5155","Type":"ContainerStarted","Data":"dcb08a467c96b63f2648dcb5c5f69e3fd3cfb2c587bb0006728c39dd34ceca5b"} Jul 13 14:46:13.378314 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:13.378294 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 14:46:13.381626 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:13.381600 2579 generic.go:356] "Generic (PLEG): container finished" podID="ccd01179-7f16-4d02-8647-4395aa09e576" containerID="5ad7748e5dc015c9218e2c4cef4f0f5c4fe00a94b5a43571c44491ba05485a98" exitCode=1 Jul 13 14:46:13.381729 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:13.381627 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" event={"ID":"ccd01179-7f16-4d02-8647-4395aa09e576","Type":"ContainerStarted","Data":"c01fdb507cc3f2b85e4d3dbcb7ff6c2fa962d1ac9f802dee19b91a051dff464c"} Jul 13 14:46:13.381794 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:13.381742 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" event={"ID":"ccd01179-7f16-4d02-8647-4395aa09e576","Type":"ContainerDied","Data":"5ad7748e5dc015c9218e2c4cef4f0f5c4fe00a94b5a43571c44491ba05485a98"} Jul 13 14:46:13.381849 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:13.381803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" event={"ID":"ccd01179-7f16-4d02-8647-4395aa09e576","Type":"ContainerStarted","Data":"166b1814f45ba80ffada0c33f6e518a2e049fea0908dad470dab02cfdbb27bef"} Jul 13 14:46:13.383432 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:13.383406 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vdzl2" event={"ID":"7074c75a-9e03-40a9-b0cf-0d4b1a3f1193","Type":"ContainerStarted","Data":"26ca820ff64716957609dccc62e7b62243fe61366bc0929c58288289b346f800"} Jul 13 14:46:13.385024 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:13.385006 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-95.ec2.internal" event={"ID":"a4e72ecf078b84cf1a21b2a5799579a9","Type":"ContainerStarted","Data":"d1f13360716fc4e5103dfc985149bfa15c36260d2a90f0c05afd5b6b2562d520"} Jul 13 14:46:13.402483 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:13.402424 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-26g4r" podStartSLOduration=3.183389362 podStartE2EDuration="23.402405533s" totalImagesPullingTime="20.219016171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:46:13.401890928 +0000 UTC m=+23.685740144" watchObservedRunningTime="2026-07-13 14:46:13.402405533 +0000 UTC m=+23.686254753" Jul 13 14:46:13.418037 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:13.417994 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-95.ec2.internal" podStartSLOduration=22.417977005 podStartE2EDuration="22.417977005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:46:13.417547704 +0000 UTC m=+23.701396922" watchObservedRunningTime="2026-07-13 14:46:13.417977005 +0000 UTC m=+23.701826258" Jul 13 14:46:13.444282 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:13.444240 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vdzl2" podStartSLOduration=3.198520052 podStartE2EDuration="23.444222897s" totalImagesPullingTime="20.245702845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:46:13.440787118 +0000 UTC m=+23.724636335" watchObservedRunningTime="2026-07-13 14:46:13.444222897 +0000 UTC m=+23.728072117" Jul 13 14:46:14.201288 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.201101 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:14.201534 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.201143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:14.201534 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:14.201385 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:14.201534 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.201166 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:14.201534 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:14.201466 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:14.201677 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:14.201540 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:14.388472 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.388441 2579 generic.go:356] "Generic (PLEG): container finished" podID="e4f81427-426f-4009-a1fc-1a2e9c436860" containerID="d8530f6fd4dacc05e2c51e4e710ada061d2d0ca069235a130f71a67ad8fa3d72" exitCode=0 Jul 13 14:46:14.389255 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.388530 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9tlg" event={"ID":"e4f81427-426f-4009-a1fc-1a2e9c436860","Type":"ContainerDied","Data":"d8530f6fd4dacc05e2c51e4e710ada061d2d0ca069235a130f71a67ad8fa3d72"} Jul 13 14:46:14.390044 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.390016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4l644" event={"ID":"314eeac8-e095-44d1-ad77-af880fc56d01","Type":"ContainerStarted","Data":"abcf6a931342bc34762d10e3e9cadac70b4f89bf20bcd06eb07b97973a35cb74"} Jul 13 14:46:14.391471 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.391449 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lkrg2" event={"ID":"25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1","Type":"ContainerStarted","Data":"48dc747cbc58c8ae9b41f403a10379367ba5b75f450b38d75cd3114cc5a860b0"} Jul 13 14:46:14.392917 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.392891 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" event={"ID":"d6733c40-1aed-4407-af44-f928972c70bc","Type":"ContainerStarted","Data":"c3fade520aa31ac8ec267ed3873f92483248aac79cbc2f3f95b7a5a4187f0985"} Jul 13 14:46:14.394354 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.394321 2579 generic.go:356] "Generic (PLEG): container finished" podID="4ec2e19d71065addb6c77b51d2691a32" containerID="b32fa305f0a5c0fda05de8c4559c98f82de93920e1ffd82fe4d3af8bc679e989" exitCode=0 Jul 13 14:46:14.394451 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.394371 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" event={"ID":"4ec2e19d71065addb6c77b51d2691a32","Type":"ContainerDied","Data":"b32fa305f0a5c0fda05de8c4559c98f82de93920e1ffd82fe4d3af8bc679e989"} Jul 13 14:46:14.397114 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.397099 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 14:46:14.399965 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.397937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" event={"ID":"ccd01179-7f16-4d02-8647-4395aa09e576","Type":"ContainerStarted","Data":"0b9972c534559c6f5ca63cd16d35c93a5f90a8bc947f9f7a8b389e2d8fc128db"} Jul 13 14:46:14.399965 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.398068 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" event={"ID":"ccd01179-7f16-4d02-8647-4395aa09e576","Type":"ContainerStarted","Data":"5d396c303260bf92fb1eccec793925603b809a890d8979405f2c84425458d328"} Jul 13 14:46:14.399965 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.398157 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" event={"ID":"ccd01179-7f16-4d02-8647-4395aa09e576","Type":"ContainerStarted","Data":"69a412010b751c29e2c6806982b59e0f0a4ea1d883b20647fad045fcc3b2c707"} Jul 13 14:46:14.401472 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.401445 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-89rws" event={"ID":"ac81ad92-c6e5-4a69-a093-ca92f73b965c","Type":"ContainerStarted","Data":"d496faf2c93525abdbd26ad0fd21d7c3263b5adb2cee1ec7336b1fe282065aa0"} Jul 13 14:46:14.402610 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.402592 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tw45d" event={"ID":"a80b9629-203e-4dfa-a1ef-548a3a668e06","Type":"ContainerStarted","Data":"6b326744190294b0049f3215383ee741b0016ff9089556231533ce27e22b7bcd"} Jul 13 14:46:14.444459 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.444193 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lkrg2" podStartSLOduration=4.189218464 podStartE2EDuration="24.444173692s" totalImagesPullingTime="20.254955228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:46:14.443717405 +0000 UTC m=+24.727566622" watchObservedRunningTime="2026-07-13 14:46:14.444173692 +0000 UTC m=+24.728022910" Jul 13 14:46:14.460772 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.460671 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4l644" podStartSLOduration=4.252830391 podStartE2EDuration="24.460656046s" totalImagesPullingTime="20.207825655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:46:14.460164728 +0000 UTC m=+24.744013957" watchObservedRunningTime="2026-07-13 14:46:14.460656046 +0000 UTC m=+24.744505265" Jul 13 14:46:14.491303 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.491258 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-89rws" podStartSLOduration=4.295986902 podStartE2EDuration="24.491241146s" totalImagesPullingTime="20.195254244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:46:14.491007504 +0000 UTC m=+24.774856861" watchObservedRunningTime="2026-07-13 14:46:14.491241146 +0000 UTC m=+24.775090362" Jul 13 14:46:14.491581 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:14.491557 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tw45d" podStartSLOduration=4.291663238 podStartE2EDuration="24.491551708s" totalImagesPullingTime="20.19988847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:46:14.475406722 +0000 UTC m=+24.759255938" watchObservedRunningTime="2026-07-13 14:46:14.491551708 +0000 UTC m=+24.775400924" Jul 13 14:46:15.407482 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:15.407438 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" event={"ID":"4ec2e19d71065addb6c77b51d2691a32","Type":"ContainerStarted","Data":"5b2cb9f8d444949ca158bcd347aaa48e4be7557f6fee7113ac5bfac9d92ecd3e"} Jul 13 14:46:15.424870 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:15.424827 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-95.ec2.internal" podStartSLOduration=24.424807281 podStartE2EDuration="24.424807281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:46:15.424779699 +0000 UTC m=+25.708628917" watchObservedRunningTime="2026-07-13 14:46:15.424807281 +0000 UTC m=+25.708656494" Jul 13 14:46:15.662053 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:15.661936 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tw45d" Jul 13 14:46:15.662568 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:15.662486 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tw45d" Jul 13 14:46:15.812192 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:15.812169 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 14:46:16.195203 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:16.195116 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T14:46:15.812186352Z","UUID":"081fee50-0b24-4576-af15-4e3bee73d473","Handler":null,"Name":"","Endpoint":""} Jul 13 14:46:16.196899 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:16.196878 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 14:46:16.197046 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:16.196921 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 14:46:16.204009 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:16.203956 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:16.204009 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:16.203987 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:16.204009 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:16.203989 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:16.204552 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:16.204519 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:16.204677 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:16.204617 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:16.204755 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:16.204703 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:16.412668 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:16.412567 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" event={"ID":"d6733c40-1aed-4407-af44-f928972c70bc","Type":"ContainerStarted","Data":"073d2904c0784d78190f7fa18de08df5dccc762217968915b2cecdb2a147bd37"} Jul 13 14:46:16.416571 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:16.416545 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 14:46:16.417224 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:16.417198 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" event={"ID":"ccd01179-7f16-4d02-8647-4395aa09e576","Type":"ContainerStarted","Data":"8e71ef4bf21fa05074b0886ece29ded8fad437669f13863bcd56d2e58b2d8e7c"} Jul 13 14:46:16.417649 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:16.417627 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tw45d" Jul 13 14:46:16.418355 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:16.418321 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tw45d" Jul 13 14:46:18.200876 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:18.200577 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:18.201401 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:18.200587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:18.201401 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:18.200942 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:18.201401 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:18.200587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:18.201401 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:18.201037 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:18.201401 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:18.201080 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:19.426297 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:19.426116 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 14:46:19.427002 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:19.426625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" event={"ID":"ccd01179-7f16-4d02-8647-4395aa09e576","Type":"ContainerStarted","Data":"dacc84424b5aef6edb60ccffa80477505f1d759fecf5b7ef15d5164fd18d2643"} Jul 13 14:46:19.427002 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:19.426967 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:46:19.427124 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:19.427017 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:46:19.427124 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:19.427067 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:46:19.427124 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:19.427117 2579 scope.go:117] "RemoveContainer" containerID="5ad7748e5dc015c9218e2c4cef4f0f5c4fe00a94b5a43571c44491ba05485a98" Jul 13 14:46:19.429115 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:19.429089 2579 generic.go:356] "Generic (PLEG): container finished" podID="e4f81427-426f-4009-a1fc-1a2e9c436860" containerID="e9eb08437a100e1d2fba44305bcd6d19b12873a46977f29aa2ccb1687813b64e" exitCode=0 Jul 13 14:46:19.429243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:19.429172 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9tlg" event={"ID":"e4f81427-426f-4009-a1fc-1a2e9c436860","Type":"ContainerDied","Data":"e9eb08437a100e1d2fba44305bcd6d19b12873a46977f29aa2ccb1687813b64e"} Jul 13 14:46:19.434889 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:19.434736 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" event={"ID":"d6733c40-1aed-4407-af44-f928972c70bc","Type":"ContainerStarted","Data":"1d69769a2c0ad223b1dc95191e14edcd4bdafc22407e12d7480dc6375d84272d"} Jul 13 14:46:19.444646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:19.444625 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:46:19.444829 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:19.444809 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:46:19.540456 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:19.540403 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j92nc" podStartSLOduration=4.80285064 podStartE2EDuration="29.540384361s" totalImagesPullingTime="24.737533721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:46:19.540159728 +0000 UTC m=+29.824008944" watchObservedRunningTime="2026-07-13 14:46:19.540384361 +0000 UTC m=+29.824233577" Jul 13 14:46:20.201441 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:20.201410 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:20.201712 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:20.201410 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:20.201712 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:20.201518 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:20.201712 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:20.201589 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:20.201712 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:20.201426 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:20.201712 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:20.201660 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:20.440449 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:20.440427 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 14:46:20.440828 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:20.440800 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" event={"ID":"ccd01179-7f16-4d02-8647-4395aa09e576","Type":"ContainerStarted","Data":"95bdc7ff9b307f84db2d85df50c8297896317012e23e647cf5dcdc519b8b675e"} Jul 13 14:46:20.484930 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:20.484887 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" podStartSLOduration=10.007819894 podStartE2EDuration="30.484869838s" totalImagesPullingTime="20.477049944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:46:20.484853538 +0000 UTC m=+30.768702770" watchObservedRunningTime="2026-07-13 14:46:20.484869838 +0000 UTC m=+30.768719037" Jul 13 14:46:20.816361 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:20.816272 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zclht"] Jul 13 14:46:20.816601 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:20.816400 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:20.816601 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:20.816481 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:20.819554 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:20.819529 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nh2nq"] Jul 13 14:46:20.819686 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:20.819652 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:20.819791 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:20.819764 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:20.820260 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:20.820234 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cv8h7"] Jul 13 14:46:20.820364 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:20.820331 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:20.820442 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:20.820424 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:21.444889 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:21.444858 2579 generic.go:356] "Generic (PLEG): container finished" podID="e4f81427-426f-4009-a1fc-1a2e9c436860" containerID="0333eef1912957070bfa323c8dabe2d5994696324b0e77ce94008b1d07c29eed" exitCode=0 Jul 13 14:46:21.445374 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:21.444942 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9tlg" event={"ID":"e4f81427-426f-4009-a1fc-1a2e9c436860","Type":"ContainerDied","Data":"0333eef1912957070bfa323c8dabe2d5994696324b0e77ce94008b1d07c29eed"} Jul 13 14:46:22.200647 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:22.200412 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:22.200803 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:22.200412 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:22.200803 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:22.200725 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:22.200803 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:22.200452 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:22.200803 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:22.200752 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:22.201019 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:22.200865 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:23.451789 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:23.451756 2579 generic.go:356] "Generic (PLEG): container finished" podID="e4f81427-426f-4009-a1fc-1a2e9c436860" containerID="b0f279f8db42beda8c5b9a24fdcccf5f7a61af6411f4db19339b455a163d7777" exitCode=0 Jul 13 14:46:23.452431 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:23.451798 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9tlg" event={"ID":"e4f81427-426f-4009-a1fc-1a2e9c436860","Type":"ContainerDied","Data":"b0f279f8db42beda8c5b9a24fdcccf5f7a61af6411f4db19339b455a163d7777"} Jul 13 14:46:23.892486 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:23.892448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:23.892639 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:23.892612 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:46:23.892701 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:23.892679 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret podName:687ef339-93d5-47be-931e-aacc68f61a06 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:55.892662576 +0000 UTC m=+66.176511771 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret") pod "global-pull-secret-syncer-zclht" (UID: "687ef339-93d5-47be-931e-aacc68f61a06") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:46:23.993665 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:23.993630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:23.993822 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:23.993775 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:46:23.993865 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:23.993842 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs podName:db0f7b6d-a74a-4e54-a9f2-9069e242a4e3 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:55.993827155 +0000 UTC m=+66.277676367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs") pod "network-metrics-daemon-nh2nq" (UID: "db0f7b6d-a74a-4e54-a9f2-9069e242a4e3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:46:24.094479 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:24.094440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7fd\" (UniqueName: \"kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd\") pod \"network-check-target-cv8h7\" (UID: \"448bca0a-4f78-4b52-b3cb-daaf9ee34ab7\") " pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:24.094639 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:24.094614 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:46:24.094639 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:24.094640 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:46:24.094714 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:24.094650 2579 projected.go:196] Error preparing data for projected volume kube-api-access-xz7fd for pod openshift-network-diagnostics/network-check-target-cv8h7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:46:24.094714 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:24.094700 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd podName:448bca0a-4f78-4b52-b3cb-daaf9ee34ab7 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:56.094686497 +0000 UTC m=+66.378535711 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xz7fd" (UniqueName: "kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd") pod "network-check-target-cv8h7" (UID: "448bca0a-4f78-4b52-b3cb-daaf9ee34ab7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:46:24.201316 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:24.201196 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:24.201316 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:24.201218 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:24.201634 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:24.201317 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cv8h7" podUID="448bca0a-4f78-4b52-b3cb-daaf9ee34ab7" Jul 13 14:46:24.201634 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:24.201439 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zclht" podUID="687ef339-93d5-47be-931e-aacc68f61a06" Jul 13 14:46:24.201634 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:24.201520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:24.201634 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:24.201616 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nh2nq" podUID="db0f7b6d-a74a-4e54-a9f2-9069e242a4e3" Jul 13 14:46:26.032323 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.032297 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-95.ec2.internal" event="NodeReady" Jul 13 14:46:26.032762 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.032472 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 14:46:26.119260 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.119230 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77bbd4b67f-dlfnt"] Jul 13 14:46:26.122143 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.122123 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.125596 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.125574 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 14:46:26.125717 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.125611 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 14:46:26.125717 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.125646 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7ljvr\"" Jul 13 14:46:26.125921 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.125893 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 14:46:26.134504 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.134483 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 14:46:26.156061 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.156034 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fkvtf"] Jul 13 14:46:26.158372 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.158353 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.160865 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.160845 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77bbd4b67f-dlfnt"] Jul 13 14:46:26.163824 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.163634 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 14:46:26.165629 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.165597 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-94wgn"] Jul 13 14:46:26.167582 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.167553 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-94wgn" Jul 13 14:46:26.167700 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.167657 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k8vvm\"" Jul 13 14:46:26.168090 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.167867 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 14:46:26.173160 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.173138 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 14:46:26.173326 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.173307 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 14:46:26.174485 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.174467 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7xw2p\"" Jul 13 14:46:26.175870 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.175849 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 14:46:26.199746 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.199706 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-94wgn"] Jul 13 14:46:26.200554 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.200466 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fkvtf"] Jul 13 14:46:26.205237 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.205216 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:26.205372 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.205330 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:26.205372 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.205360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:26.208499 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.208472 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0989dede-a7f8-45af-9668-b778e5fbf86a-ca-trust-extracted\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.208595 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.208522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-certificates\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.208595 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.208553 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0989dede-a7f8-45af-9668-b778e5fbf86a-image-registry-private-configuration\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.208595 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.208584 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0989dede-a7f8-45af-9668-b778e5fbf86a-installation-pull-secrets\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.208760 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.208600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whgp2\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-kube-api-access-whgp2\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.208760 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.208622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-bound-sa-token\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.208760 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.208668 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.208760 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.208717 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0989dede-a7f8-45af-9668-b778e5fbf86a-trusted-ca\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.209887 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.209869 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 14:46:26.210027 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.209966 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 14:46:26.210110 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.210094 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2gzcz\"" Jul 13 14:46:26.210639 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.210622 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 14:46:26.212815 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.212798 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 14:46:26.212910 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.212872 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jvqn2\"" Jul 13 14:46:26.309238 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0989dede-a7f8-45af-9668-b778e5fbf86a-trusted-ca\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.309238 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309203 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/619758d9-bb0f-4d1a-9072-b078268744e8-config-volume\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.309476 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqln8\" (UniqueName: \"kubernetes.io/projected/619758d9-bb0f-4d1a-9072-b078268744e8-kube-api-access-hqln8\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.309476 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0989dede-a7f8-45af-9668-b778e5fbf86a-ca-trust-extracted\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.309582 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-certificates\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.309582 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619758d9-bb0f-4d1a-9072-b078268744e8-tmp-dir\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.309582 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vlnk\" (UniqueName: \"kubernetes.io/projected/7285b985-9f19-4d1e-aa48-28b5fd21e53c-kube-api-access-7vlnk\") pod \"ingress-canary-94wgn\" (UID: \"7285b985-9f19-4d1e-aa48-28b5fd21e53c\") " pod="openshift-ingress-canary/ingress-canary-94wgn" Jul 13 14:46:26.309582 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0989dede-a7f8-45af-9668-b778e5fbf86a-image-registry-private-configuration\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.309775 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309619 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.309775 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0989dede-a7f8-45af-9668-b778e5fbf86a-installation-pull-secrets\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.309775 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whgp2\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-kube-api-access-whgp2\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.309775 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-bound-sa-token\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.309775 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.309993 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.309798 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7285b985-9f19-4d1e-aa48-28b5fd21e53c-cert\") pod \"ingress-canary-94wgn\" (UID: \"7285b985-9f19-4d1e-aa48-28b5fd21e53c\") " pod="openshift-ingress-canary/ingress-canary-94wgn" Jul 13 14:46:26.310118 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.310091 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-certificates\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.310201 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:26.310131 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:46:26.310201 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:26.310148 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bbd4b67f-dlfnt: secret "image-registry-tls" not found Jul 13 14:46:26.310299 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:26.310205 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls podName:0989dede-a7f8-45af-9668-b778e5fbf86a nodeName:}" failed. No retries permitted until 2026-07-13 14:46:26.810187307 +0000 UTC m=+37.094036501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls") pod "image-registry-77bbd4b67f-dlfnt" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a") : secret "image-registry-tls" not found Jul 13 14:46:26.310389 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.310372 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0989dede-a7f8-45af-9668-b778e5fbf86a-trusted-ca\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.310458 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.310438 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0989dede-a7f8-45af-9668-b778e5fbf86a-ca-trust-extracted\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.313825 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.313805 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0989dede-a7f8-45af-9668-b778e5fbf86a-installation-pull-secrets\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.313825 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.313816 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0989dede-a7f8-45af-9668-b778e5fbf86a-image-registry-private-configuration\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.322467 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.322447 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-bound-sa-token\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.322592 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.322576 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whgp2\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-kube-api-access-whgp2\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.410969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.410927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/619758d9-bb0f-4d1a-9072-b078268744e8-config-volume\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.410969 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.410979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqln8\" (UniqueName: \"kubernetes.io/projected/619758d9-bb0f-4d1a-9072-b078268744e8-kube-api-access-hqln8\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.411220 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.411038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619758d9-bb0f-4d1a-9072-b078268744e8-tmp-dir\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.411220 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.411066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vlnk\" (UniqueName: \"kubernetes.io/projected/7285b985-9f19-4d1e-aa48-28b5fd21e53c-kube-api-access-7vlnk\") pod \"ingress-canary-94wgn\" (UID: \"7285b985-9f19-4d1e-aa48-28b5fd21e53c\") " pod="openshift-ingress-canary/ingress-canary-94wgn" Jul 13 14:46:26.411220 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.411102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.411220 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.411168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7285b985-9f19-4d1e-aa48-28b5fd21e53c-cert\") pod \"ingress-canary-94wgn\" (UID: \"7285b985-9f19-4d1e-aa48-28b5fd21e53c\") " pod="openshift-ingress-canary/ingress-canary-94wgn" Jul 13 14:46:26.411405 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:26.411293 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:46:26.411405 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:26.411374 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls podName:619758d9-bb0f-4d1a-9072-b078268744e8 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:26.911355409 +0000 UTC m=+37.195204615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls") pod "dns-default-fkvtf" (UID: "619758d9-bb0f-4d1a-9072-b078268744e8") : secret "dns-default-metrics-tls" not found Jul 13 14:46:26.411715 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.411692 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/619758d9-bb0f-4d1a-9072-b078268744e8-config-volume\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.411790 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.411695 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/619758d9-bb0f-4d1a-9072-b078268744e8-tmp-dir\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.413820 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.413798 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7285b985-9f19-4d1e-aa48-28b5fd21e53c-cert\") pod \"ingress-canary-94wgn\" (UID: \"7285b985-9f19-4d1e-aa48-28b5fd21e53c\") " pod="openshift-ingress-canary/ingress-canary-94wgn" Jul 13 14:46:26.422925 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.422901 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqln8\" (UniqueName: \"kubernetes.io/projected/619758d9-bb0f-4d1a-9072-b078268744e8-kube-api-access-hqln8\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.423015 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.422927 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vlnk\" (UniqueName: \"kubernetes.io/projected/7285b985-9f19-4d1e-aa48-28b5fd21e53c-kube-api-access-7vlnk\") pod \"ingress-canary-94wgn\" (UID: \"7285b985-9f19-4d1e-aa48-28b5fd21e53c\") " pod="openshift-ingress-canary/ingress-canary-94wgn" Jul 13 14:46:26.477370 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.477330 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-94wgn" Jul 13 14:46:26.815256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.815222 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:26.815455 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:26.815408 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:46:26.815455 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:26.815431 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bbd4b67f-dlfnt: secret "image-registry-tls" not found Jul 13 14:46:26.815556 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:26.815499 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls podName:0989dede-a7f8-45af-9668-b778e5fbf86a nodeName:}" failed. No retries permitted until 2026-07-13 14:46:27.815478934 +0000 UTC m=+38.099328154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls") pod "image-registry-77bbd4b67f-dlfnt" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a") : secret "image-registry-tls" not found Jul 13 14:46:26.916439 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:26.916399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:26.916613 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:26.916583 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:46:26.916674 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:26.916663 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls podName:619758d9-bb0f-4d1a-9072-b078268744e8 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:27.916639688 +0000 UTC m=+38.200488886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls") pod "dns-default-fkvtf" (UID: "619758d9-bb0f-4d1a-9072-b078268744e8") : secret "dns-default-metrics-tls" not found Jul 13 14:46:27.677790 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:27.677626 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-94wgn"] Jul 13 14:46:27.682869 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:46:27.682834 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7285b985_9f19_4d1e_aa48_28b5fd21e53c.slice/crio-0ae631298a5d27e08bdccd072deed9f0f6d4298fcd0dcf8e5907d36104bcd27d WatchSource:0}: Error finding container 0ae631298a5d27e08bdccd072deed9f0f6d4298fcd0dcf8e5907d36104bcd27d: Status 404 returned error can't find the container with id 0ae631298a5d27e08bdccd072deed9f0f6d4298fcd0dcf8e5907d36104bcd27d Jul 13 14:46:27.823144 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:27.823118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:27.823244 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:27.823231 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:46:27.823280 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:27.823247 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bbd4b67f-dlfnt: secret "image-registry-tls" not found Jul 13 14:46:27.823309 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:27.823300 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls podName:0989dede-a7f8-45af-9668-b778e5fbf86a nodeName:}" failed. No retries permitted until 2026-07-13 14:46:29.8232852 +0000 UTC m=+40.107134396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls") pod "image-registry-77bbd4b67f-dlfnt" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a") : secret "image-registry-tls" not found Jul 13 14:46:27.923914 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:27.923882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:27.924036 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:27.924005 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:46:27.924076 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:27.924056 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls podName:619758d9-bb0f-4d1a-9072-b078268744e8 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:29.924042725 +0000 UTC m=+40.207891934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls") pod "dns-default-fkvtf" (UID: "619758d9-bb0f-4d1a-9072-b078268744e8") : secret "dns-default-metrics-tls" not found Jul 13 14:46:28.467680 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:28.467638 2579 generic.go:356] "Generic (PLEG): container finished" podID="e4f81427-426f-4009-a1fc-1a2e9c436860" containerID="4528852a030dd6f6b6ff5127d16440e6e4c50cec846ccb91ace31c4158c096d1" exitCode=0 Jul 13 14:46:28.467862 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:28.467718 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9tlg" event={"ID":"e4f81427-426f-4009-a1fc-1a2e9c436860","Type":"ContainerDied","Data":"4528852a030dd6f6b6ff5127d16440e6e4c50cec846ccb91ace31c4158c096d1"} Jul 13 14:46:28.468793 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:28.468775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-94wgn" event={"ID":"7285b985-9f19-4d1e-aa48-28b5fd21e53c","Type":"ContainerStarted","Data":"0ae631298a5d27e08bdccd072deed9f0f6d4298fcd0dcf8e5907d36104bcd27d"} Jul 13 14:46:29.474202 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:29.474167 2579 generic.go:356] "Generic (PLEG): container finished" podID="e4f81427-426f-4009-a1fc-1a2e9c436860" containerID="0537b95eab2d64b3f52261ce432d0143ec57ee20cd0d076a5096ebb06f7eeb1f" exitCode=0 Jul 13 14:46:29.474634 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:29.474218 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9tlg" event={"ID":"e4f81427-426f-4009-a1fc-1a2e9c436860","Type":"ContainerDied","Data":"0537b95eab2d64b3f52261ce432d0143ec57ee20cd0d076a5096ebb06f7eeb1f"} Jul 13 14:46:29.842136 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:29.841856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:29.842285 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:29.842001 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:46:29.842285 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:29.842174 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bbd4b67f-dlfnt: secret "image-registry-tls" not found Jul 13 14:46:29.842285 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:29.842235 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls podName:0989dede-a7f8-45af-9668-b778e5fbf86a nodeName:}" failed. No retries permitted until 2026-07-13 14:46:33.842220118 +0000 UTC m=+44.126069327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls") pod "image-registry-77bbd4b67f-dlfnt" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a") : secret "image-registry-tls" not found Jul 13 14:46:29.942797 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:29.942764 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:29.942971 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:29.942946 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:46:29.943039 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:29.943029 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls podName:619758d9-bb0f-4d1a-9072-b078268744e8 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:33.943012276 +0000 UTC m=+44.226861484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls") pod "dns-default-fkvtf" (UID: "619758d9-bb0f-4d1a-9072-b078268744e8") : secret "dns-default-metrics-tls" not found Jul 13 14:46:30.480800 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:30.480717 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k9tlg" event={"ID":"e4f81427-426f-4009-a1fc-1a2e9c436860","Type":"ContainerStarted","Data":"3533466540f6b3f8211e5e3ac2ffb1db7ca8bb68bcd465ae878757bcf1a15adc"} Jul 13 14:46:30.517176 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:30.517076 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k9tlg" podStartSLOduration=10.036394094 podStartE2EDuration="40.5170562s" totalImagesPullingTime="30.480662106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:46:30.515359384 +0000 UTC m=+40.799208598" watchObservedRunningTime="2026-07-13 14:46:30.5170562 +0000 UTC m=+40.800905418" Jul 13 14:46:31.484704 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:31.484665 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-94wgn" event={"ID":"7285b985-9f19-4d1e-aa48-28b5fd21e53c","Type":"ContainerStarted","Data":"33eeebdba240c25e22f1a86aace52373d88d3f9c406716450c3fb87d90c07d7e"} Jul 13 14:46:31.507557 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:31.507514 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-94wgn" podStartSLOduration=2.390156402 podStartE2EDuration="5.507497723s" totalImagesPullingTime="3.117341321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:46:31.507495989 +0000 UTC m=+41.791345205" watchObservedRunningTime="2026-07-13 14:46:31.507497723 +0000 UTC m=+41.791346941" Jul 13 14:46:33.874967 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:33.874924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:33.875372 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:33.875079 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:46:33.875372 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:33.875099 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bbd4b67f-dlfnt: secret "image-registry-tls" not found Jul 13 14:46:33.875372 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:33.875152 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls podName:0989dede-a7f8-45af-9668-b778e5fbf86a nodeName:}" failed. No retries permitted until 2026-07-13 14:46:41.875137863 +0000 UTC m=+52.158987058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls") pod "image-registry-77bbd4b67f-dlfnt" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a") : secret "image-registry-tls" not found Jul 13 14:46:33.975520 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:33.975483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:33.975647 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:33.975628 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:46:33.975709 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:33.975698 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls podName:619758d9-bb0f-4d1a-9072-b078268744e8 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:41.975682212 +0000 UTC m=+52.259531420 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls") pod "dns-default-fkvtf" (UID: "619758d9-bb0f-4d1a-9072-b078268744e8") : secret "dns-default-metrics-tls" not found Jul 13 14:46:41.930762 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:41.930716 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:41.931218 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:41.930875 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:46:41.931218 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:41.930889 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bbd4b67f-dlfnt: secret "image-registry-tls" not found Jul 13 14:46:41.931218 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:41.930949 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls podName:0989dede-a7f8-45af-9668-b778e5fbf86a nodeName:}" failed. No retries permitted until 2026-07-13 14:46:57.930930617 +0000 UTC m=+68.214779832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls") pod "image-registry-77bbd4b67f-dlfnt" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a") : secret "image-registry-tls" not found Jul 13 14:46:42.031329 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:42.031293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:42.031505 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:42.031455 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:46:42.031543 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:42.031526 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls podName:619758d9-bb0f-4d1a-9072-b078268744e8 nodeName:}" failed. No retries permitted until 2026-07-13 14:46:58.031508543 +0000 UTC m=+68.315357761 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls") pod "dns-default-fkvtf" (UID: "619758d9-bb0f-4d1a-9072-b078268744e8") : secret "dns-default-metrics-tls" not found Jul 13 14:46:51.455403 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:51.455374 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h8xdx" Jul 13 14:46:55.927389 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:55.927308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:55.930231 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:55.930213 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 14:46:55.941331 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:55.941313 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/687ef339-93d5-47be-931e-aacc68f61a06-original-pull-secret\") pod \"global-pull-secret-syncer-zclht\" (UID: \"687ef339-93d5-47be-931e-aacc68f61a06\") " pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:56.028410 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.028362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:46:56.031847 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.031829 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 14:46:56.038936 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:56.038917 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 13 14:46:56.038998 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:56.038976 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs podName:db0f7b6d-a74a-4e54-a9f2-9069e242a4e3 nodeName:}" failed. No retries permitted until 2026-07-13 14:48:00.038958559 +0000 UTC m=+130.322807768 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs") pod "network-metrics-daemon-nh2nq" (UID: "db0f7b6d-a74a-4e54-a9f2-9069e242a4e3") : secret "metrics-daemon-secret" not found Jul 13 14:46:56.128959 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.128911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7fd\" (UniqueName: \"kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd\") pod \"network-check-target-cv8h7\" (UID: \"448bca0a-4f78-4b52-b3cb-daaf9ee34ab7\") " pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:56.132084 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.132067 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 14:46:56.144069 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.144050 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 14:46:56.153182 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.153154 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz7fd\" (UniqueName: \"kubernetes.io/projected/448bca0a-4f78-4b52-b3cb-daaf9ee34ab7-kube-api-access-xz7fd\") pod \"network-check-target-cv8h7\" (UID: \"448bca0a-4f78-4b52-b3cb-daaf9ee34ab7\") " pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:56.223603 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.223502 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zclht" Jul 13 14:46:56.232939 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.232922 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jvqn2\"" Jul 13 14:46:56.240034 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.240004 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:46:56.380095 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.380064 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zclht"] Jul 13 14:46:56.383123 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:46:56.383097 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687ef339_93d5_47be_931e_aacc68f61a06.slice/crio-18b30fb85e7603606030a63eb3fb80ecd49b3d90dbbbf3634c9f1906d853528c WatchSource:0}: Error finding container 18b30fb85e7603606030a63eb3fb80ecd49b3d90dbbbf3634c9f1906d853528c: Status 404 returned error can't find the container with id 18b30fb85e7603606030a63eb3fb80ecd49b3d90dbbbf3634c9f1906d853528c Jul 13 14:46:56.403804 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.403779 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cv8h7"] Jul 13 14:46:56.406605 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:46:56.406581 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod448bca0a_4f78_4b52_b3cb_daaf9ee34ab7.slice/crio-6369146f8d0c99f3aae1fde3da1861df3c6169cd6488ef827bb0899848374903 WatchSource:0}: Error finding container 6369146f8d0c99f3aae1fde3da1861df3c6169cd6488ef827bb0899848374903: Status 404 returned error can't find the container with id 6369146f8d0c99f3aae1fde3da1861df3c6169cd6488ef827bb0899848374903 Jul 13 14:46:56.544113 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.544023 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cv8h7" event={"ID":"448bca0a-4f78-4b52-b3cb-daaf9ee34ab7","Type":"ContainerStarted","Data":"6369146f8d0c99f3aae1fde3da1861df3c6169cd6488ef827bb0899848374903"} Jul 13 14:46:56.545126 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:56.545101 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zclht" event={"ID":"687ef339-93d5-47be-931e-aacc68f61a06","Type":"ContainerStarted","Data":"18b30fb85e7603606030a63eb3fb80ecd49b3d90dbbbf3634c9f1906d853528c"} Jul 13 14:46:57.946238 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:57.946187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:46:57.946719 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:57.946402 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:46:57.946719 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:57.946428 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bbd4b67f-dlfnt: secret "image-registry-tls" not found Jul 13 14:46:57.946719 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:57.946520 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls podName:0989dede-a7f8-45af-9668-b778e5fbf86a nodeName:}" failed. No retries permitted until 2026-07-13 14:47:29.946498052 +0000 UTC m=+100.230347250 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls") pod "image-registry-77bbd4b67f-dlfnt" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a") : secret "image-registry-tls" not found Jul 13 14:46:58.047327 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:46:58.047183 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:46:58.047327 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:58.047326 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:46:58.047573 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:46:58.047404 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls podName:619758d9-bb0f-4d1a-9072-b078268744e8 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:30.047386939 +0000 UTC m=+100.331236149 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls") pod "dns-default-fkvtf" (UID: "619758d9-bb0f-4d1a-9072-b078268744e8") : secret "dns-default-metrics-tls" not found Jul 13 14:47:00.429502 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.429465 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt"] Jul 13 14:47:00.450260 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.450228 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:00.454488 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.454458 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt"] Jul 13 14:47:00.455100 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.455077 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 13 14:47:00.455623 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.455585 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:47:00.456421 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.456397 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zgtm6\"" Jul 13 14:47:00.469955 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.469835 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 13 14:47:00.507840 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.507806 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-5xtgw"] Jul 13 14:47:00.528089 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.528050 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-5xtgw"] Jul 13 14:47:00.528252 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.528191 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.531415 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.531378 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 14:47:00.531415 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.531392 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-75vmj\"" Jul 13 14:47:00.531415 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.531408 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 13 14:47:00.531697 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.531665 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 13 14:47:00.531770 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.531712 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 14:47:00.539811 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.539783 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 13 14:47:00.558298 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.558258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cv8h7" event={"ID":"448bca0a-4f78-4b52-b3cb-daaf9ee34ab7","Type":"ContainerStarted","Data":"c9641d07122be31e71cd194a2e546bef7625f5dd2743afb0d65791066981f6ce"} Jul 13 14:47:00.558499 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.558407 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:47:00.565648 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.565619 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.565771 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.565659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-serving-cert\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.565771 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.565743 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8jrrt\" (UID: \"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:00.565840 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.565810 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txkpd\" (UniqueName: \"kubernetes.io/projected/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-kube-api-access-txkpd\") pod \"cluster-samples-operator-65db858894-8jrrt\" (UID: \"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:00.565885 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.565836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mbfv\" (UniqueName: \"kubernetes.io/projected/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-kube-api-access-2mbfv\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.565885 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.565874 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-snapshots\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.565966 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.565906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.565966 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.565945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-tmp\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.579168 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.579113 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cv8h7" podStartSLOduration=67.341226228 podStartE2EDuration="1m10.579094141s" totalImagesPullingTime="3.237867913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:00.578502595 +0000 UTC m=+70.862351813" watchObservedRunningTime="2026-07-13 14:47:00.579094141 +0000 UTC m=+70.862943353" Jul 13 14:47:00.666454 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.666421 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txkpd\" (UniqueName: \"kubernetes.io/projected/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-kube-api-access-txkpd\") pod \"cluster-samples-operator-65db858894-8jrrt\" (UID: \"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:00.666454 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.666465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mbfv\" (UniqueName: \"kubernetes.io/projected/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-kube-api-access-2mbfv\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.666712 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.666503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-snapshots\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.666712 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.666548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.666712 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.666612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-tmp\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.666712 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.666649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.666712 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.666671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-serving-cert\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.666918 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.666728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8jrrt\" (UID: \"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:00.666918 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:00.666842 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 14:47:00.666918 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:00.666911 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls podName:ab69fef5-70c9-4744-b7f0-e77cb5ec35fa nodeName:}" failed. No retries permitted until 2026-07-13 14:47:01.166891074 +0000 UTC m=+71.450740268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls") pod "cluster-samples-operator-65db858894-8jrrt" (UID: "ab69fef5-70c9-4744-b7f0-e77cb5ec35fa") : secret "samples-operator-tls" not found Jul 13 14:47:00.667232 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.667208 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-snapshots\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.667415 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.667385 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-tmp\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.667529 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.667423 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.667758 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.667734 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.669628 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.669609 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-serving-cert\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.677499 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.677450 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mbfv\" (UniqueName: \"kubernetes.io/projected/86e0453b-1b4c-4edd-9cd5-ddff7ba0e932-kube-api-access-2mbfv\") pod \"insights-operator-68d9dd94cf-5xtgw\" (UID: \"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932\") " pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:00.678131 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.678110 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txkpd\" (UniqueName: \"kubernetes.io/projected/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-kube-api-access-txkpd\") pod \"cluster-samples-operator-65db858894-8jrrt\" (UID: \"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:00.842365 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:00.842268 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" Jul 13 14:47:01.171758 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:01.171722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8jrrt\" (UID: \"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:01.171942 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:01.171844 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 14:47:01.171942 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:01.171915 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls podName:ab69fef5-70c9-4744-b7f0-e77cb5ec35fa nodeName:}" failed. No retries permitted until 2026-07-13 14:47:02.17189577 +0000 UTC m=+72.455744985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls") pod "cluster-samples-operator-65db858894-8jrrt" (UID: "ab69fef5-70c9-4744-b7f0-e77cb5ec35fa") : secret "samples-operator-tls" not found Jul 13 14:47:01.493634 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:01.493601 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-5xtgw"] Jul 13 14:47:01.496668 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:01.496631 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e0453b_1b4c_4edd_9cd5_ddff7ba0e932.slice/crio-b824887328332f141ac5154afd8e24b456f8152a8789cb3a83e6547d676b5268 WatchSource:0}: Error finding container b824887328332f141ac5154afd8e24b456f8152a8789cb3a83e6547d676b5268: Status 404 returned error can't find the container with id b824887328332f141ac5154afd8e24b456f8152a8789cb3a83e6547d676b5268 Jul 13 14:47:01.561669 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:01.561631 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" event={"ID":"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932","Type":"ContainerStarted","Data":"b824887328332f141ac5154afd8e24b456f8152a8789cb3a83e6547d676b5268"} Jul 13 14:47:02.180157 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:02.180124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8jrrt\" (UID: \"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:02.180365 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:02.180245 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 14:47:02.180365 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:02.180318 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls podName:ab69fef5-70c9-4744-b7f0-e77cb5ec35fa nodeName:}" failed. No retries permitted until 2026-07-13 14:47:04.180300776 +0000 UTC m=+74.464149975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls") pod "cluster-samples-operator-65db858894-8jrrt" (UID: "ab69fef5-70c9-4744-b7f0-e77cb5ec35fa") : secret "samples-operator-tls" not found Jul 13 14:47:02.565369 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:02.565286 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zclht" event={"ID":"687ef339-93d5-47be-931e-aacc68f61a06","Type":"ContainerStarted","Data":"17d8fac484a72ff1f66452f1db4f4d7c3d2470e76bc106bcf025ffc690442b6c"} Jul 13 14:47:02.596910 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:02.596862 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zclht" podStartSLOduration=67.254596498 podStartE2EDuration="1m12.596846346s" totalImagesPullingTime="5.342249848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:02.595997225 +0000 UTC m=+72.879846443" watchObservedRunningTime="2026-07-13 14:47:02.596846346 +0000 UTC m=+72.880695564" Jul 13 14:47:04.197269 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:04.197232 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8jrrt\" (UID: \"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:04.197653 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:04.197399 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 14:47:04.197653 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:04.197464 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls podName:ab69fef5-70c9-4744-b7f0-e77cb5ec35fa nodeName:}" failed. No retries permitted until 2026-07-13 14:47:08.197450144 +0000 UTC m=+78.481299356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls") pod "cluster-samples-operator-65db858894-8jrrt" (UID: "ab69fef5-70c9-4744-b7f0-e77cb5ec35fa") : secret "samples-operator-tls" not found Jul 13 14:47:04.576359 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:04.576259 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" event={"ID":"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932","Type":"ContainerStarted","Data":"b135366a146388f45cd77df3aec66e2d6b9e558eadc93869eeb51aecb379a150"} Jul 13 14:47:05.155867 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.155796 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" podStartSLOduration=3.135730514 podStartE2EDuration="5.155769742s" totalImagesPullingTime="2.020039228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:04.596775726 +0000 UTC m=+74.880624943" watchObservedRunningTime="2026-07-13 14:47:05.155769742 +0000 UTC m=+75.439618960" Jul 13 14:47:05.156679 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.156653 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pn5dm"] Jul 13 14:47:05.159044 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.159022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.163428 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.163401 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dhzjh\"" Jul 13 14:47:05.163541 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.163499 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 14:47:05.167322 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.167303 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 14:47:05.173128 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.173104 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pn5dm"] Jul 13 14:47:05.206617 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.206585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.206998 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.206641 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtr2h\" (UniqueName: \"kubernetes.io/projected/bdd25561-c565-40b6-b743-a7832ded9c13-kube-api-access-gtr2h\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.206998 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.206707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdd25561-c565-40b6-b743-a7832ded9c13-crio-socket\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.206998 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.206757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.206998 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.206784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdd25561-c565-40b6-b743-a7832ded9c13-data-volume\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.307164 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.307123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtr2h\" (UniqueName: \"kubernetes.io/projected/bdd25561-c565-40b6-b743-a7832ded9c13-kube-api-access-gtr2h\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.307390 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.307179 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdd25561-c565-40b6-b743-a7832ded9c13-crio-socket\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.307390 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.307260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.307390 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.307298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdd25561-c565-40b6-b743-a7832ded9c13-data-volume\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.307390 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.307267 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdd25561-c565-40b6-b743-a7832ded9c13-crio-socket\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.307390 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.307356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.307674 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:05.307405 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 14:47:05.307674 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:05.307422 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 14:47:05.307674 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:05.307470 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm podName:bdd25561-c565-40b6-b743-a7832ded9c13 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:05.807454201 +0000 UTC m=+76.091303417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pn5dm" (UID: "bdd25561-c565-40b6-b743-a7832ded9c13") : configmap "kube-rbac-proxy" not found Jul 13 14:47:05.307674 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:05.307483 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls podName:bdd25561-c565-40b6-b743-a7832ded9c13 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:05.807477283 +0000 UTC m=+76.091326478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pn5dm" (UID: "bdd25561-c565-40b6-b743-a7832ded9c13") : secret "insights-runtime-extractor-tls" not found Jul 13 14:47:05.307817 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.307679 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdd25561-c565-40b6-b743-a7832ded9c13-data-volume\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.316411 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.316393 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtr2h\" (UniqueName: \"kubernetes.io/projected/bdd25561-c565-40b6-b743-a7832ded9c13-kube-api-access-gtr2h\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.810868 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.810822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.811053 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:05.810881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:05.811053 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:05.810972 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 14:47:05.811053 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:05.810991 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 14:47:05.811053 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:05.811036 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls podName:bdd25561-c565-40b6-b743-a7832ded9c13 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:06.811020495 +0000 UTC m=+77.094869695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pn5dm" (UID: "bdd25561-c565-40b6-b743-a7832ded9c13") : secret "insights-runtime-extractor-tls" not found Jul 13 14:47:05.811053 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:05.811050 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm podName:bdd25561-c565-40b6-b743-a7832ded9c13 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:06.811044184 +0000 UTC m=+77.094893379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pn5dm" (UID: "bdd25561-c565-40b6-b743-a7832ded9c13") : configmap "kube-rbac-proxy" not found Jul 13 14:47:06.821372 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:06.821313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:06.821787 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:06.821396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:06.821787 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:06.821466 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 14:47:06.821787 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:06.821535 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls podName:bdd25561-c565-40b6-b743-a7832ded9c13 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:08.821520778 +0000 UTC m=+79.105369976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pn5dm" (UID: "bdd25561-c565-40b6-b743-a7832ded9c13") : secret "insights-runtime-extractor-tls" not found Jul 13 14:47:06.821787 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:06.821472 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 14:47:06.821787 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:06.821602 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm podName:bdd25561-c565-40b6-b743-a7832ded9c13 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:08.821591211 +0000 UTC m=+79.105440409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pn5dm" (UID: "bdd25561-c565-40b6-b743-a7832ded9c13") : configmap "kube-rbac-proxy" not found Jul 13 14:47:07.152791 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:07.152765 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lkrg2_25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1/dns-node-resolver/0.log" Jul 13 14:47:07.952634 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:07.952607 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-89rws_ac81ad92-c6e5-4a69-a093-ca92f73b965c/node-ca/0.log" Jul 13 14:47:08.232449 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:08.232333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8jrrt\" (UID: \"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:08.232622 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:08.232498 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 14:47:08.232622 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:08.232575 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls podName:ab69fef5-70c9-4744-b7f0-e77cb5ec35fa nodeName:}" failed. No retries permitted until 2026-07-13 14:47:16.232555981 +0000 UTC m=+86.516405180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls") pod "cluster-samples-operator-65db858894-8jrrt" (UID: "ab69fef5-70c9-4744-b7f0-e77cb5ec35fa") : secret "samples-operator-tls" not found Jul 13 14:47:08.753404 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:08.753359 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-94wgn_7285b985-9f19-4d1e-aa48-28b5fd21e53c/serve-healthcheck-canary/0.log" Jul 13 14:47:08.838007 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:08.837972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:08.838175 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:08.838022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:08.838175 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:08.838088 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 14:47:08.838175 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:08.838127 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 14:47:08.838175 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:08.838152 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm podName:bdd25561-c565-40b6-b743-a7832ded9c13 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:12.838137322 +0000 UTC m=+83.121986536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pn5dm" (UID: "bdd25561-c565-40b6-b743-a7832ded9c13") : configmap "kube-rbac-proxy" not found Jul 13 14:47:08.838312 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:08.838185 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls podName:bdd25561-c565-40b6-b743-a7832ded9c13 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:12.838171733 +0000 UTC m=+83.122020949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pn5dm" (UID: "bdd25561-c565-40b6-b743-a7832ded9c13") : secret "insights-runtime-extractor-tls" not found Jul 13 14:47:11.912691 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:11.912660 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zltvn"] Jul 13 14:47:11.914725 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:11.914710 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zltvn" Jul 13 14:47:11.917843 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:11.917822 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 13 14:47:11.919211 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:11.919194 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 13 14:47:11.919319 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:11.919298 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kqwrt\"" Jul 13 14:47:11.925857 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:11.925835 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zltvn"] Jul 13 14:47:11.963055 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:11.963020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6wm2\" (UniqueName: \"kubernetes.io/projected/0727e9e7-31e6-4544-9658-9b431a12408a-kube-api-access-f6wm2\") pod \"migrator-7f59b54f6c-zltvn\" (UID: \"0727e9e7-31e6-4544-9658-9b431a12408a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zltvn" Jul 13 14:47:12.063866 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:12.063830 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6wm2\" (UniqueName: \"kubernetes.io/projected/0727e9e7-31e6-4544-9658-9b431a12408a-kube-api-access-f6wm2\") pod \"migrator-7f59b54f6c-zltvn\" (UID: \"0727e9e7-31e6-4544-9658-9b431a12408a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zltvn" Jul 13 14:47:12.080298 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:12.080275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6wm2\" (UniqueName: \"kubernetes.io/projected/0727e9e7-31e6-4544-9658-9b431a12408a-kube-api-access-f6wm2\") pod \"migrator-7f59b54f6c-zltvn\" (UID: \"0727e9e7-31e6-4544-9658-9b431a12408a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zltvn" Jul 13 14:47:12.223125 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:12.223043 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zltvn" Jul 13 14:47:12.343243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:12.343055 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zltvn"] Jul 13 14:47:12.345742 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:12.345705 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0727e9e7_31e6_4544_9658_9b431a12408a.slice/crio-b87947750c424e691c49982466b456202a0b528fb218d29e93ede3fe80219352 WatchSource:0}: Error finding container b87947750c424e691c49982466b456202a0b528fb218d29e93ede3fe80219352: Status 404 returned error can't find the container with id b87947750c424e691c49982466b456202a0b528fb218d29e93ede3fe80219352 Jul 13 14:47:12.595168 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:12.595082 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zltvn" event={"ID":"0727e9e7-31e6-4544-9658-9b431a12408a","Type":"ContainerStarted","Data":"b87947750c424e691c49982466b456202a0b528fb218d29e93ede3fe80219352"} Jul 13 14:47:12.871004 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:12.870969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:12.871165 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:12.871025 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:12.871165 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:12.871091 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 14:47:12.871165 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:12.871138 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 14:47:12.871273 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:12.871144 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm podName:bdd25561-c565-40b6-b743-a7832ded9c13 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:20.871130454 +0000 UTC m=+91.154979662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pn5dm" (UID: "bdd25561-c565-40b6-b743-a7832ded9c13") : configmap "kube-rbac-proxy" not found Jul 13 14:47:12.871273 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:12.871203 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls podName:bdd25561-c565-40b6-b743-a7832ded9c13 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:20.871188805 +0000 UTC m=+91.155038003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pn5dm" (UID: "bdd25561-c565-40b6-b743-a7832ded9c13") : secret "insights-runtime-extractor-tls" not found Jul 13 14:47:14.601923 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:14.601888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zltvn" event={"ID":"0727e9e7-31e6-4544-9658-9b431a12408a","Type":"ContainerStarted","Data":"b5f76a8cde81193d1664d13a684717e0c6958dc186eaadafae0f1a0bff2e49a2"} Jul 13 14:47:15.606389 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:15.606356 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zltvn" event={"ID":"0727e9e7-31e6-4544-9658-9b431a12408a","Type":"ContainerStarted","Data":"65dd1920e0c0e4eab39ae1b35025acabb423e451d1b3cc7341f8d052b71d74fe"} Jul 13 14:47:15.625932 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:15.625887 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zltvn" podStartSLOduration=2.433670168 podStartE2EDuration="4.625872925s" totalImagesPullingTime="2.192202757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:15.625266155 +0000 UTC m=+85.909115404" watchObservedRunningTime="2026-07-13 14:47:15.625872925 +0000 UTC m=+85.909722187" Jul 13 14:47:16.302355 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:16.302299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8jrrt\" (UID: \"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:16.302522 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:16.302466 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 14:47:16.302586 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:16.302538 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls podName:ab69fef5-70c9-4744-b7f0-e77cb5ec35fa nodeName:}" failed. No retries permitted until 2026-07-13 14:47:32.302522085 +0000 UTC m=+102.586371285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls") pod "cluster-samples-operator-65db858894-8jrrt" (UID: "ab69fef5-70c9-4744-b7f0-e77cb5ec35fa") : secret "samples-operator-tls" not found Jul 13 14:47:20.940049 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:20.940007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:20.940472 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:20.940169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:20.940472 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:20.940291 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 14:47:20.940472 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:20.940381 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls podName:bdd25561-c565-40b6-b743-a7832ded9c13 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:36.940361537 +0000 UTC m=+107.224210748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pn5dm" (UID: "bdd25561-c565-40b6-b743-a7832ded9c13") : secret "insights-runtime-extractor-tls" not found Jul 13 14:47:20.940716 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:20.940693 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdd25561-c565-40b6-b743-a7832ded9c13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:30.015417 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.015370 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:47:30.017777 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.017753 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls\") pod \"image-registry-77bbd4b67f-dlfnt\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:47:30.037821 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.037798 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7ljvr\"" Jul 13 14:47:30.045081 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.045064 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:47:30.116836 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.116807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:47:30.118918 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.118898 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/619758d9-bb0f-4d1a-9072-b078268744e8-metrics-tls\") pod \"dns-default-fkvtf\" (UID: \"619758d9-bb0f-4d1a-9072-b078268744e8\") " pod="openshift-dns/dns-default-fkvtf" Jul 13 14:47:30.175091 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.175062 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77bbd4b67f-dlfnt"] Jul 13 14:47:30.180882 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:30.180855 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0989dede_a7f8_45af_9668_b778e5fbf86a.slice/crio-9dce8e7d69e21db16094d270216f39dafff0a2c09124906e8da795db7cf59330 WatchSource:0}: Error finding container 9dce8e7d69e21db16094d270216f39dafff0a2c09124906e8da795db7cf59330: Status 404 returned error can't find the container with id 9dce8e7d69e21db16094d270216f39dafff0a2c09124906e8da795db7cf59330 Jul 13 14:47:30.371715 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.371687 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k8vvm\"" Jul 13 14:47:30.379965 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.379944 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fkvtf" Jul 13 14:47:30.502324 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.502281 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fkvtf"] Jul 13 14:47:30.505005 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:30.504968 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod619758d9_bb0f_4d1a_9072_b078268744e8.slice/crio-afc3e150c8a385bd170eb02f66ee8c1e2129094724f078bcd76b4ff03cc011c4 WatchSource:0}: Error finding container afc3e150c8a385bd170eb02f66ee8c1e2129094724f078bcd76b4ff03cc011c4: Status 404 returned error can't find the container with id afc3e150c8a385bd170eb02f66ee8c1e2129094724f078bcd76b4ff03cc011c4 Jul 13 14:47:30.654374 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.654270 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fkvtf" event={"ID":"619758d9-bb0f-4d1a-9072-b078268744e8","Type":"ContainerStarted","Data":"afc3e150c8a385bd170eb02f66ee8c1e2129094724f078bcd76b4ff03cc011c4"} Jul 13 14:47:30.655716 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.655693 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" event={"ID":"0989dede-a7f8-45af-9668-b778e5fbf86a","Type":"ContainerStarted","Data":"5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734"} Jul 13 14:47:30.655818 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.655733 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" event={"ID":"0989dede-a7f8-45af-9668-b778e5fbf86a","Type":"ContainerStarted","Data":"9dce8e7d69e21db16094d270216f39dafff0a2c09124906e8da795db7cf59330"} Jul 13 14:47:30.655883 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.655832 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:47:30.677669 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:30.677620 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" podStartSLOduration=100.677604075 podStartE2EDuration="1m40.677604075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:30.677451197 +0000 UTC m=+100.961300414" watchObservedRunningTime="2026-07-13 14:47:30.677604075 +0000 UTC m=+100.961453291" Jul 13 14:47:31.564235 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:31.564200 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cv8h7" Jul 13 14:47:32.336524 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:32.336411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8jrrt\" (UID: \"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:32.338813 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:32.338784 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab69fef5-70c9-4744-b7f0-e77cb5ec35fa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8jrrt\" (UID: \"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:32.561806 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:32.561754 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" Jul 13 14:47:32.665330 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:32.665300 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fkvtf" event={"ID":"619758d9-bb0f-4d1a-9072-b078268744e8","Type":"ContainerStarted","Data":"cc34f6c01a08d1de8c10a7a8e3b73a786f4e0e4677ab3be617bb12785c37eca1"} Jul 13 14:47:32.665330 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:32.665373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fkvtf" event={"ID":"619758d9-bb0f-4d1a-9072-b078268744e8","Type":"ContainerStarted","Data":"e6e1c9bd4e3e40e595279238788fe154fffcc86c65706f67baa505dda885bbbc"} Jul 13 14:47:32.682482 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:32.682455 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt"] Jul 13 14:47:32.684892 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:32.684838 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fkvtf" podStartSLOduration=65.209230613 podStartE2EDuration="1m6.684818778s" totalImagesPullingTime="1.475588165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:32.683504644 +0000 UTC m=+102.967353861" watchObservedRunningTime="2026-07-13 14:47:32.684818778 +0000 UTC m=+102.968667996" Jul 13 14:47:33.671093 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:33.671047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" event={"ID":"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa","Type":"ContainerStarted","Data":"98076f334e1947295f1cf2fae24f12f2699c39eb950fbecfae95c5774f3f31c9"} Jul 13 14:47:33.671720 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:33.671388 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fkvtf" Jul 13 14:47:35.680676 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:35.680626 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" event={"ID":"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa","Type":"ContainerStarted","Data":"d874afba25c183a8de28a5c3ef25cea7c86006f01ba9f27e2168da1ce3ea1d73"} Jul 13 14:47:35.681135 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:35.680737 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" event={"ID":"ab69fef5-70c9-4744-b7f0-e77cb5ec35fa","Type":"ContainerStarted","Data":"e4ffa1e1f99802356c9dfbb8d1085a7cc567b0ba0d1968ca5c34f93906ee76aa"} Jul 13 14:47:35.700902 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:35.700850 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8jrrt" podStartSLOduration=33.40889332 podStartE2EDuration="35.700833902s" totalImagesPullingTime="2.291940582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:35.699767164 +0000 UTC m=+105.983616386" watchObservedRunningTime="2026-07-13 14:47:35.700833902 +0000 UTC m=+105.984683118" Jul 13 14:47:36.972780 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:36.972743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:36.974957 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:36.974939 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdd25561-c565-40b6-b743-a7832ded9c13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pn5dm\" (UID: \"bdd25561-c565-40b6-b743-a7832ded9c13\") " pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:37.268270 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:37.268185 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pn5dm" Jul 13 14:47:37.420017 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:37.419993 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pn5dm"] Jul 13 14:47:37.422417 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:37.422392 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd25561_c565_40b6_b743_a7832ded9c13.slice/crio-93ae535ab277be49838de00300992588d6c1934a2ef7db9955299237cce22cc3 WatchSource:0}: Error finding container 93ae535ab277be49838de00300992588d6c1934a2ef7db9955299237cce22cc3: Status 404 returned error can't find the container with id 93ae535ab277be49838de00300992588d6c1934a2ef7db9955299237cce22cc3 Jul 13 14:47:37.687709 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:37.687671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pn5dm" event={"ID":"bdd25561-c565-40b6-b743-a7832ded9c13","Type":"ContainerStarted","Data":"93ae535ab277be49838de00300992588d6c1934a2ef7db9955299237cce22cc3"} Jul 13 14:47:38.357553 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.356764 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j"] Jul 13 14:47:38.359689 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.359228 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:38.365805 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.365350 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 13 14:47:38.365805 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.365604 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 13 14:47:38.365805 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.365651 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 13 14:47:38.365805 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.365604 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 13 14:47:38.371750 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.371660 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j"] Jul 13 14:47:38.484816 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.484474 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j"] Jul 13 14:47:38.484816 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.484529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmj87\" (UniqueName: \"kubernetes.io/projected/43f961b9-a791-4389-938b-5c3da7c435f0-kube-api-access-gmj87\") pod \"klusterlet-addon-workmgr-6ffb8599f6-lvh7j\" (UID: \"43f961b9-a791-4389-938b-5c3da7c435f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:38.484816 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.484616 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/43f961b9-a791-4389-938b-5c3da7c435f0-klusterlet-config\") pod \"klusterlet-addon-workmgr-6ffb8599f6-lvh7j\" (UID: \"43f961b9-a791-4389-938b-5c3da7c435f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:38.484816 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.484645 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43f961b9-a791-4389-938b-5c3da7c435f0-tmp\") pod \"klusterlet-addon-workmgr-6ffb8599f6-lvh7j\" (UID: \"43f961b9-a791-4389-938b-5c3da7c435f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:38.486816 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.486791 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-bz27r"] Jul 13 14:47:38.486964 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.486925 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j" Jul 13 14:47:38.489045 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.489014 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-bz27r" Jul 13 14:47:38.491166 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.490741 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 13 14:47:38.491166 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.490997 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-847kw\"" Jul 13 14:47:38.491739 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.491601 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 14:47:38.491739 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.491642 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 14:47:38.492405 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.492086 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ntbmz\"" Jul 13 14:47:38.500935 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.500913 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j"] Jul 13 14:47:38.513483 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.513417 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-bz27r"] Jul 13 14:47:38.585712 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.585668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/43f961b9-a791-4389-938b-5c3da7c435f0-klusterlet-config\") pod \"klusterlet-addon-workmgr-6ffb8599f6-lvh7j\" (UID: \"43f961b9-a791-4389-938b-5c3da7c435f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:38.585712 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.585713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43f961b9-a791-4389-938b-5c3da7c435f0-tmp\") pod \"klusterlet-addon-workmgr-6ffb8599f6-lvh7j\" (UID: \"43f961b9-a791-4389-938b-5c3da7c435f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:38.585916 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.585893 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/59057457-d132-4527-919c-5c097bfcd8ad-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-srt9j\" (UID: \"59057457-d132-4527-919c-5c097bfcd8ad\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j" Jul 13 14:47:38.585974 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.585952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmj87\" (UniqueName: \"kubernetes.io/projected/43f961b9-a791-4389-938b-5c3da7c435f0-kube-api-access-gmj87\") pod \"klusterlet-addon-workmgr-6ffb8599f6-lvh7j\" (UID: \"43f961b9-a791-4389-938b-5c3da7c435f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:38.586031 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.586010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5kt2\" (UniqueName: \"kubernetes.io/projected/1920ad9c-d7a4-4fd7-b195-61a10b5a7699-kube-api-access-x5kt2\") pod \"downloads-68c9cbb497-bz27r\" (UID: \"1920ad9c-d7a4-4fd7-b195-61a10b5a7699\") " pod="openshift-console/downloads-68c9cbb497-bz27r" Jul 13 14:47:38.586126 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.586108 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43f961b9-a791-4389-938b-5c3da7c435f0-tmp\") pod \"klusterlet-addon-workmgr-6ffb8599f6-lvh7j\" (UID: \"43f961b9-a791-4389-938b-5c3da7c435f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:38.588434 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.588402 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/43f961b9-a791-4389-938b-5c3da7c435f0-klusterlet-config\") pod \"klusterlet-addon-workmgr-6ffb8599f6-lvh7j\" (UID: \"43f961b9-a791-4389-938b-5c3da7c435f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:38.595923 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.595895 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmj87\" (UniqueName: \"kubernetes.io/projected/43f961b9-a791-4389-938b-5c3da7c435f0-kube-api-access-gmj87\") pod \"klusterlet-addon-workmgr-6ffb8599f6-lvh7j\" (UID: \"43f961b9-a791-4389-938b-5c3da7c435f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:38.675799 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.675709 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:38.686406 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.686369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5kt2\" (UniqueName: \"kubernetes.io/projected/1920ad9c-d7a4-4fd7-b195-61a10b5a7699-kube-api-access-x5kt2\") pod \"downloads-68c9cbb497-bz27r\" (UID: \"1920ad9c-d7a4-4fd7-b195-61a10b5a7699\") " pod="openshift-console/downloads-68c9cbb497-bz27r" Jul 13 14:47:38.686540 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.686447 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/59057457-d132-4527-919c-5c097bfcd8ad-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-srt9j\" (UID: \"59057457-d132-4527-919c-5c097bfcd8ad\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j" Jul 13 14:47:38.690117 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.690062 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/59057457-d132-4527-919c-5c097bfcd8ad-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-srt9j\" (UID: \"59057457-d132-4527-919c-5c097bfcd8ad\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j" Jul 13 14:47:38.699590 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.699563 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5kt2\" (UniqueName: \"kubernetes.io/projected/1920ad9c-d7a4-4fd7-b195-61a10b5a7699-kube-api-access-x5kt2\") pod \"downloads-68c9cbb497-bz27r\" (UID: \"1920ad9c-d7a4-4fd7-b195-61a10b5a7699\") " pod="openshift-console/downloads-68c9cbb497-bz27r" Jul 13 14:47:38.801644 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.801534 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j" Jul 13 14:47:38.808627 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.808434 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-bz27r" Jul 13 14:47:38.824213 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.824183 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j"] Jul 13 14:47:38.828489 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:38.828456 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f961b9_a791_4389_938b_5c3da7c435f0.slice/crio-4d039a74e8200f4e01f27f16d8ae64b0b0c773425df70752e96d6c356022fa83 WatchSource:0}: Error finding container 4d039a74e8200f4e01f27f16d8ae64b0b0c773425df70752e96d6c356022fa83: Status 404 returned error can't find the container with id 4d039a74e8200f4e01f27f16d8ae64b0b0c773425df70752e96d6c356022fa83 Jul 13 14:47:38.977780 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.977753 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j"] Jul 13 14:47:38.980107 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:38.980076 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59057457_d132_4527_919c_5c097bfcd8ad.slice/crio-316ba4cc36139a094d8ad9b5be531786267d9d7ef74ba6322096a0092023b197 WatchSource:0}: Error finding container 316ba4cc36139a094d8ad9b5be531786267d9d7ef74ba6322096a0092023b197: Status 404 returned error can't find the container with id 316ba4cc36139a094d8ad9b5be531786267d9d7ef74ba6322096a0092023b197 Jul 13 14:47:38.995312 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:38.995287 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-bz27r"] Jul 13 14:47:38.998367 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:38.998325 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1920ad9c_d7a4_4fd7_b195_61a10b5a7699.slice/crio-5d272166f202dc07687ad54a6216f6fe2df318d4deee6d157091bf03d2b7583c WatchSource:0}: Error finding container 5d272166f202dc07687ad54a6216f6fe2df318d4deee6d157091bf03d2b7583c: Status 404 returned error can't find the container with id 5d272166f202dc07687ad54a6216f6fe2df318d4deee6d157091bf03d2b7583c Jul 13 14:47:39.699502 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:39.699462 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" event={"ID":"43f961b9-a791-4389-938b-5c3da7c435f0","Type":"ContainerStarted","Data":"4d039a74e8200f4e01f27f16d8ae64b0b0c773425df70752e96d6c356022fa83"} Jul 13 14:47:39.701222 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:39.701179 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j" event={"ID":"59057457-d132-4527-919c-5c097bfcd8ad","Type":"ContainerStarted","Data":"316ba4cc36139a094d8ad9b5be531786267d9d7ef74ba6322096a0092023b197"} Jul 13 14:47:39.702377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:39.702351 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-bz27r" event={"ID":"1920ad9c-d7a4-4fd7-b195-61a10b5a7699","Type":"ContainerStarted","Data":"5d272166f202dc07687ad54a6216f6fe2df318d4deee6d157091bf03d2b7583c"} Jul 13 14:47:42.716145 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:42.716093 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pn5dm" event={"ID":"bdd25561-c565-40b6-b743-a7832ded9c13","Type":"ContainerStarted","Data":"b2c7515c62b809fa8dad47da50643202821381b8018e896d02f8e726d735b2b8"} Jul 13 14:47:42.718149 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:42.718092 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j" event={"ID":"59057457-d132-4527-919c-5c097bfcd8ad","Type":"ContainerStarted","Data":"0b91e85da7a499bc28d0e3de090c56bb8caece99da1d9eb14dcd73a947e603fe"} Jul 13 14:47:42.718357 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:42.718325 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j" Jul 13 14:47:42.725470 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:42.725444 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j" Jul 13 14:47:42.735934 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:42.735877 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-srt9j" podStartSLOduration=1.7174520869999998 podStartE2EDuration="4.735857083s" totalImagesPullingTime="3.018404996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:42.734859899 +0000 UTC m=+113.018709123" watchObservedRunningTime="2026-07-13 14:47:42.735857083 +0000 UTC m=+113.019706282" Jul 13 14:47:43.143036 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.142996 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6766b75fb5-fwqzr"] Jul 13 14:47:43.150984 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.150944 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.154187 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.154157 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 14:47:43.154421 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.154400 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 14:47:43.154611 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.154596 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 14:47:43.156703 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.156146 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j5hvf\"" Jul 13 14:47:43.156703 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.156274 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 14:47:43.156703 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.156363 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 14:47:43.160804 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.160727 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6766b75fb5-fwqzr"] Jul 13 14:47:43.161269 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.161118 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 14:47:43.225769 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.225730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-config\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.225951 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.225791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-trusted-ca-bundle\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.225951 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.225830 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-oauth-config\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.225951 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.225856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-service-ca\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.225951 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.225930 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kjh\" (UniqueName: \"kubernetes.io/projected/58420915-ab25-4c2e-9abb-09c8f4c3b820-kube-api-access-c9kjh\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.226188 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.225954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-serving-cert\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.226188 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.225979 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-oauth-serving-cert\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.327207 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.327169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-config\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.327418 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.327225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-trusted-ca-bundle\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.327418 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.327268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-oauth-config\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.327418 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.327295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-service-ca\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.327418 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.327366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kjh\" (UniqueName: \"kubernetes.io/projected/58420915-ab25-4c2e-9abb-09c8f4c3b820-kube-api-access-c9kjh\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.327418 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.327400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-serving-cert\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.327705 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.327423 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-oauth-serving-cert\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.328153 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.328124 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-config\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.328258 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.328151 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-oauth-serving-cert\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.328373 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.328323 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-trusted-ca-bundle\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.328877 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.328854 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-service-ca\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.330697 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.330656 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-serving-cert\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.330801 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.330782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-oauth-config\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.337539 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.337499 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kjh\" (UniqueName: \"kubernetes.io/projected/58420915-ab25-4c2e-9abb-09c8f4c3b820-kube-api-access-c9kjh\") pod \"console-6766b75fb5-fwqzr\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.464654 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.464568 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:43.538751 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.538712 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-j5z2t"] Jul 13 14:47:43.541741 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.541712 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.544651 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.544600 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 13 14:47:43.545134 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.545113 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 14:47:43.545243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.545182 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2p6bk\"" Jul 13 14:47:43.545243 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.545212 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 13 14:47:43.545640 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.545463 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 14:47:43.545640 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.545520 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 14:47:43.551697 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.551632 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-j5z2t"] Jul 13 14:47:43.630078 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.630034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89462f5c-675c-484a-8a10-760a14d47242-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-j5z2t\" (UID: \"89462f5c-675c-484a-8a10-760a14d47242\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.630254 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.630170 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6vmv\" (UniqueName: \"kubernetes.io/projected/89462f5c-675c-484a-8a10-760a14d47242-kube-api-access-j6vmv\") pod \"prometheus-operator-64785b6675-j5z2t\" (UID: \"89462f5c-675c-484a-8a10-760a14d47242\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.630254 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.630224 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/89462f5c-675c-484a-8a10-760a14d47242-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-j5z2t\" (UID: \"89462f5c-675c-484a-8a10-760a14d47242\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.630403 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.630267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89462f5c-675c-484a-8a10-760a14d47242-metrics-client-ca\") pod \"prometheus-operator-64785b6675-j5z2t\" (UID: \"89462f5c-675c-484a-8a10-760a14d47242\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.677498 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.677461 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fkvtf" Jul 13 14:47:43.732230 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.731551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6vmv\" (UniqueName: \"kubernetes.io/projected/89462f5c-675c-484a-8a10-760a14d47242-kube-api-access-j6vmv\") pod \"prometheus-operator-64785b6675-j5z2t\" (UID: \"89462f5c-675c-484a-8a10-760a14d47242\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.732230 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.731611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/89462f5c-675c-484a-8a10-760a14d47242-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-j5z2t\" (UID: \"89462f5c-675c-484a-8a10-760a14d47242\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.732230 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.731659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89462f5c-675c-484a-8a10-760a14d47242-metrics-client-ca\") pod \"prometheus-operator-64785b6675-j5z2t\" (UID: \"89462f5c-675c-484a-8a10-760a14d47242\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.732230 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.731700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89462f5c-675c-484a-8a10-760a14d47242-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-j5z2t\" (UID: \"89462f5c-675c-484a-8a10-760a14d47242\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.733035 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.733008 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89462f5c-675c-484a-8a10-760a14d47242-metrics-client-ca\") pod \"prometheus-operator-64785b6675-j5z2t\" (UID: \"89462f5c-675c-484a-8a10-760a14d47242\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.735552 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.735387 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/89462f5c-675c-484a-8a10-760a14d47242-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-j5z2t\" (UID: \"89462f5c-675c-484a-8a10-760a14d47242\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.735986 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.735963 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89462f5c-675c-484a-8a10-760a14d47242-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-j5z2t\" (UID: \"89462f5c-675c-484a-8a10-760a14d47242\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.742410 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.742313 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6vmv\" (UniqueName: \"kubernetes.io/projected/89462f5c-675c-484a-8a10-760a14d47242-kube-api-access-j6vmv\") pod \"prometheus-operator-64785b6675-j5z2t\" (UID: \"89462f5c-675c-484a-8a10-760a14d47242\") " pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:43.854402 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:43.854368 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" Jul 13 14:47:44.975139 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:44.975041 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-j5z2t"] Jul 13 14:47:44.978929 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:44.978904 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89462f5c_675c_484a_8a10_760a14d47242.slice/crio-a81ecf7c6055b8219d6c21847dc651c1f8878049b5ce6e73d93f240c8ced2307 WatchSource:0}: Error finding container a81ecf7c6055b8219d6c21847dc651c1f8878049b5ce6e73d93f240c8ced2307: Status 404 returned error can't find the container with id a81ecf7c6055b8219d6c21847dc651c1f8878049b5ce6e73d93f240c8ced2307 Jul 13 14:47:44.987649 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:44.987575 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6766b75fb5-fwqzr"] Jul 13 14:47:44.990266 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:44.990234 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58420915_ab25_4c2e_9abb_09c8f4c3b820.slice/crio-cd3e2486293df86c3111b192f0c3ea67c439c784d65b27f8ecf83b4418b614c7 WatchSource:0}: Error finding container cd3e2486293df86c3111b192f0c3ea67c439c784d65b27f8ecf83b4418b614c7: Status 404 returned error can't find the container with id cd3e2486293df86c3111b192f0c3ea67c439c784d65b27f8ecf83b4418b614c7 Jul 13 14:47:45.733923 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:45.733887 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" event={"ID":"43f961b9-a791-4389-938b-5c3da7c435f0","Type":"ContainerStarted","Data":"3a827a747c58077c3fd9682921c564127b9279c1644746e90f38149d23391a12"} Jul 13 14:47:45.734453 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:45.734409 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:45.735980 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:45.735845 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" Jul 13 14:47:45.736476 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:45.736448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" event={"ID":"89462f5c-675c-484a-8a10-760a14d47242","Type":"ContainerStarted","Data":"a81ecf7c6055b8219d6c21847dc651c1f8878049b5ce6e73d93f240c8ced2307"} Jul 13 14:47:45.740103 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:45.740075 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pn5dm" event={"ID":"bdd25561-c565-40b6-b743-a7832ded9c13","Type":"ContainerStarted","Data":"ec177d7bc540b5ee49a80f792ca88dbd6ae273984b337f7e3bc41e7828b0b287"} Jul 13 14:47:45.741795 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:45.741736 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6766b75fb5-fwqzr" event={"ID":"58420915-ab25-4c2e-9abb-09c8f4c3b820","Type":"ContainerStarted","Data":"cd3e2486293df86c3111b192f0c3ea67c439c784d65b27f8ecf83b4418b614c7"} Jul 13 14:47:45.753885 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:45.753831 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ffb8599f6-lvh7j" podStartSLOduration=1.75901365 podStartE2EDuration="7.753812985s" totalImagesPullingTime="5.994799335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:45.752277579 +0000 UTC m=+116.036126797" watchObservedRunningTime="2026-07-13 14:47:45.753812985 +0000 UTC m=+116.037662205" Jul 13 14:47:46.752198 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:46.752125 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" event={"ID":"89462f5c-675c-484a-8a10-760a14d47242","Type":"ContainerStarted","Data":"3a61b24f2db5e66fc544874b6104e24e91a8d2d6f0621a7b8656d979aeb87698"} Jul 13 14:47:46.752198 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:46.752196 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" event={"ID":"89462f5c-675c-484a-8a10-760a14d47242","Type":"ContainerStarted","Data":"7bb7c15fe918f7ca283a5766c9efc37b251ee43406e013e6f845c3adb6f17458"} Jul 13 14:47:46.774144 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:46.773871 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-j5z2t" podStartSLOduration=2.510190072 podStartE2EDuration="3.773848242s" totalImagesPullingTime="1.26365817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:46.77195895 +0000 UTC m=+117.055808167" watchObservedRunningTime="2026-07-13 14:47:46.773848242 +0000 UTC m=+117.057697462" Jul 13 14:47:48.976431 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:48.976389 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4czr7"] Jul 13 14:47:48.983610 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:48.983208 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:48.998461 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:48.998402 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 14:47:48.998704 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:48.998519 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 14:47:48.998704 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:48.998598 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 14:47:48.998704 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:48.998685 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qt79p\"" Jul 13 14:47:49.080067 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.079998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aae023a-9895-49c6-a9a0-b203e6404c24-metrics-client-ca\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.080067 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.080050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.080308 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.080080 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj9k8\" (UniqueName: \"kubernetes.io/projected/3aae023a-9895-49c6-a9a0-b203e6404c24-kube-api-access-lj9k8\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.080308 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.080105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-wtmp\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.080308 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.080148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-accelerators-collector-config\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.080308 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.080206 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3aae023a-9895-49c6-a9a0-b203e6404c24-root\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.080308 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.080269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aae023a-9895-49c6-a9a0-b203e6404c24-sys\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.080568 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.080329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-textfile\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.080568 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.080375 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-tls\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.181420 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.181382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3aae023a-9895-49c6-a9a0-b203e6404c24-root\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.181578 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.181438 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aae023a-9895-49c6-a9a0-b203e6404c24-sys\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.181578 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.181487 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-textfile\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.181578 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.181506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-tls\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.181578 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.181520 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3aae023a-9895-49c6-a9a0-b203e6404c24-root\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.181578 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.181543 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aae023a-9895-49c6-a9a0-b203e6404c24-metrics-client-ca\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.181578 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.181571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.181896 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.181589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aae023a-9895-49c6-a9a0-b203e6404c24-sys\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.181896 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.181600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj9k8\" (UniqueName: \"kubernetes.io/projected/3aae023a-9895-49c6-a9a0-b203e6404c24-kube-api-access-lj9k8\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.181896 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.181638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-wtmp\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.181896 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.181677 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-accelerators-collector-config\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.181896 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.181873 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-textfile\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.182129 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:49.182015 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 13 14:47:49.182129 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:47:49.182087 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-tls podName:3aae023a-9895-49c6-a9a0-b203e6404c24 nodeName:}" failed. No retries permitted until 2026-07-13 14:47:49.682069012 +0000 UTC m=+119.965918215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-tls") pod "node-exporter-4czr7" (UID: "3aae023a-9895-49c6-a9a0-b203e6404c24") : secret "node-exporter-tls" not found Jul 13 14:47:49.182238 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.182216 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aae023a-9895-49c6-a9a0-b203e6404c24-metrics-client-ca\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.182293 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.182262 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-accelerators-collector-config\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.182426 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.182385 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-wtmp\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.184871 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.184844 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.196283 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.196233 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj9k8\" (UniqueName: \"kubernetes.io/projected/3aae023a-9895-49c6-a9a0-b203e6404c24-kube-api-access-lj9k8\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.687684 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.687646 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-tls\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.690446 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.690407 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3aae023a-9895-49c6-a9a0-b203e6404c24-node-exporter-tls\") pod \"node-exporter-4czr7\" (UID: \"3aae023a-9895-49c6-a9a0-b203e6404c24\") " pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.897302 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:49.897266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4czr7" Jul 13 14:47:49.909049 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:49.909018 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aae023a_9895_49c6_a9a0_b203e6404c24.slice/crio-0655777e3ddc2566dd793e10afae3c48f9c43dc3ea27cba5179dfec84c27104f WatchSource:0}: Error finding container 0655777e3ddc2566dd793e10afae3c48f9c43dc3ea27cba5179dfec84c27104f: Status 404 returned error can't find the container with id 0655777e3ddc2566dd793e10afae3c48f9c43dc3ea27cba5179dfec84c27104f Jul 13 14:47:50.050828 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:50.050732 2579 patch_prober.go:28] interesting pod/image-registry-77bbd4b67f-dlfnt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 13 14:47:50.050828 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:50.050799 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" podUID="0989dede-a7f8-45af-9668-b778e5fbf86a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 14:47:50.772434 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:50.772382 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pn5dm" event={"ID":"bdd25561-c565-40b6-b743-a7832ded9c13","Type":"ContainerStarted","Data":"7bda0d82e8dc4e791ab3da9b99a906a49bfe006638ae2e0054be39970f7dd11b"} Jul 13 14:47:50.774228 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:50.774190 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6766b75fb5-fwqzr" event={"ID":"58420915-ab25-4c2e-9abb-09c8f4c3b820","Type":"ContainerStarted","Data":"943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706"} Jul 13 14:47:50.775877 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:50.775845 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4czr7" event={"ID":"3aae023a-9895-49c6-a9a0-b203e6404c24","Type":"ContainerStarted","Data":"0655777e3ddc2566dd793e10afae3c48f9c43dc3ea27cba5179dfec84c27104f"} Jul 13 14:47:50.795672 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:50.795608 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pn5dm" podStartSLOduration=33.677174042 podStartE2EDuration="45.795584499s" totalImagesPullingTime="12.118410457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:47:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:50.793372394 +0000 UTC m=+121.077221652" watchObservedRunningTime="2026-07-13 14:47:50.795584499 +0000 UTC m=+121.079433743" Jul 13 14:47:50.815418 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:50.814946 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6766b75fb5-fwqzr" podStartSLOduration=3.071646405 podStartE2EDuration="7.814922166s" totalImagesPullingTime="4.743275761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:50.813399642 +0000 UTC m=+121.097248859" watchObservedRunningTime="2026-07-13 14:47:50.814922166 +0000 UTC m=+121.098771383" Jul 13 14:47:51.664349 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:51.664318 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:47:52.036750 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.036644 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-696dcb9849-6nxjk"] Jul 13 14:47:52.040815 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.040784 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.044220 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.044198 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 13 14:47:52.044426 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.044265 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 13 14:47:52.044426 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.044410 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ad0thrm7ni0b4\"" Jul 13 14:47:52.044618 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.044599 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2brw2\"" Jul 13 14:47:52.044877 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.044856 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 13 14:47:52.044975 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.044877 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 13 14:47:52.045168 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.045134 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 13 14:47:52.054961 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.054938 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-696dcb9849-6nxjk"] Jul 13 14:47:52.112030 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.110551 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.112030 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.110598 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.112030 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.110630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.112030 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.110669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.112030 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.110699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-grpc-tls\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.112030 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.110741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ade3f4e2-a136-4da9-9538-d2d271880738-metrics-client-ca\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.112030 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.110771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkzmz\" (UniqueName: \"kubernetes.io/projected/ade3f4e2-a136-4da9-9538-d2d271880738-kube-api-access-pkzmz\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.112030 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.110794 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-tls\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.211607 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.211573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ade3f4e2-a136-4da9-9538-d2d271880738-metrics-client-ca\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.211786 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.211628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkzmz\" (UniqueName: \"kubernetes.io/projected/ade3f4e2-a136-4da9-9538-d2d271880738-kube-api-access-pkzmz\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.211786 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.211667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-tls\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.211786 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.211722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.211786 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.211747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.212035 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.212009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.212098 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.212074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.212153 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.212114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-grpc-tls\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.212580 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.212532 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ade3f4e2-a136-4da9-9538-d2d271880738-metrics-client-ca\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.214898 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.214832 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.215016 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.214918 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-tls\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.215016 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.214925 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.215131 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.215019 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.215376 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.215355 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.215684 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.215665 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ade3f4e2-a136-4da9-9538-d2d271880738-secret-grpc-tls\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.225111 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.225061 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkzmz\" (UniqueName: \"kubernetes.io/projected/ade3f4e2-a136-4da9-9538-d2d271880738-kube-api-access-pkzmz\") pod \"thanos-querier-696dcb9849-6nxjk\" (UID: \"ade3f4e2-a136-4da9-9538-d2d271880738\") " pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:52.352567 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:52.352532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:47:53.464784 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:53.464746 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:53.465202 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:53.464834 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:53.470039 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:53.470014 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:53.795382 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:53.795272 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:47:55.161731 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.161698 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76979f657f-fm6rp"] Jul 13 14:47:55.164248 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.164224 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.175482 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.175458 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76979f657f-fm6rp"] Jul 13 14:47:55.235886 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.235855 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 14:47:55.239253 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.239229 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.242806 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.242437 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-trusted-ca-bundle\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.242806 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.242477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8m65\" (UniqueName: \"kubernetes.io/projected/dc66f947-247b-42df-af20-b119f6bf3138-kube-api-access-d8m65\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.242806 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.242521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc66f947-247b-42df-af20-b119f6bf3138-console-serving-cert\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.242806 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.242543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-service-ca\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.242806 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.242567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-oauth-serving-cert\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.242806 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.242618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc66f947-247b-42df-af20-b119f6bf3138-console-oauth-config\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.242806 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.242639 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-console-config\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.243838 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.243594 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 13 14:47:55.243838 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.243712 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 13 14:47:55.243838 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.243717 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 13 14:47:55.244536 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.244518 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wd76g\"" Jul 13 14:47:55.245111 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.245087 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 13 14:47:55.245204 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.245153 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 13 14:47:55.245204 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.245165 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 13 14:47:55.245713 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.245458 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 13 14:47:55.245713 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.245466 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 13 14:47:55.245713 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.245504 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 13 14:47:55.245713 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.245465 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 13 14:47:55.245955 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.245764 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 13 14:47:55.245955 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.245885 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4lu6doar10sc9\"" Jul 13 14:47:55.245955 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.245896 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 13 14:47:55.246254 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.246115 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 13 14:47:55.246254 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.246160 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 13 14:47:55.250215 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.250191 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 13 14:47:55.266976 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.266876 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 14:47:55.343971 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.343927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344143 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.343986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344143 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344143 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344143 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344060 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344143 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344143 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b378907a-7514-44fb-ad08-62c15acf4ee4-config-out\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344457 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344145 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344457 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-config\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344457 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344206 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b378907a-7514-44fb-ad08-62c15acf4ee4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344457 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344265 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344457 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344457 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-trusted-ca-bundle\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.344457 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8m65\" (UniqueName: \"kubernetes.io/projected/dc66f947-247b-42df-af20-b119f6bf3138-kube-api-access-d8m65\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.344784 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344485 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344784 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344784 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82tt6\" (UniqueName: \"kubernetes.io/projected/b378907a-7514-44fb-ad08-62c15acf4ee4-kube-api-access-82tt6\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.344784 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344673 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc66f947-247b-42df-af20-b119f6bf3138-console-serving-cert\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.344784 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-service-ca\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.344784 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-oauth-serving-cert\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.344784 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344755 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.345111 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc66f947-247b-42df-af20-b119f6bf3138-console-oauth-config\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.345111 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-console-config\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.345111 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344863 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-web-config\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.345111 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.345111 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344924 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.345111 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.344947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.345406 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.345368 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-trusted-ca-bundle\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.345544 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.345501 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-service-ca\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.345715 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.345689 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-console-config\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.346002 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.345957 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-oauth-serving-cert\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.348102 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.348082 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc66f947-247b-42df-af20-b119f6bf3138-console-serving-cert\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.348250 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.348229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc66f947-247b-42df-af20-b119f6bf3138-console-oauth-config\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.362854 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.362825 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8m65\" (UniqueName: \"kubernetes.io/projected/dc66f947-247b-42df-af20-b119f6bf3138-kube-api-access-d8m65\") pod \"console-76979f657f-fm6rp\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.446229 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.446126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.446229 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.446176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.446229 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.446204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.447486 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.447460 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.448066 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.448045 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.448469 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449152 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b378907a-7514-44fb-ad08-62c15acf4ee4-config-out\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449206 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-config\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b378907a-7514-44fb-ad08-62c15acf4ee4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449394 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82tt6\" (UniqueName: \"kubernetes.io/projected/b378907a-7514-44fb-ad08-62c15acf4ee4-kube-api-access-82tt6\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-web-config\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.450425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.449811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.451265 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.451218 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.451922 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.451897 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.452494 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.452469 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.455537 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.453752 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.455537 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.454076 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.455537 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.454843 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b378907a-7514-44fb-ad08-62c15acf4ee4-config-out\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.455537 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.455189 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.459184 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.458046 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.460665 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.460644 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.460761 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.460665 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-web-config\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.461256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.461236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.462994 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.462977 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.464322 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.464225 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.464883 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.464839 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.465712 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.465688 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b378907a-7514-44fb-ad08-62c15acf4ee4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.466725 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.466225 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b378907a-7514-44fb-ad08-62c15acf4ee4-config\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.468889 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.468863 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b378907a-7514-44fb-ad08-62c15acf4ee4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.469396 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.469354 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82tt6\" (UniqueName: \"kubernetes.io/projected/b378907a-7514-44fb-ad08-62c15acf4ee4-kube-api-access-82tt6\") pod \"prometheus-k8s-0\" (UID: \"b378907a-7514-44fb-ad08-62c15acf4ee4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:55.477062 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.477017 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:47:55.553232 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:55.553135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:47:58.395734 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.395711 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 14:47:58.397807 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:58.397762 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb378907a_7514_44fb_ad08_62c15acf4ee4.slice/crio-7b53b5eb6f12716a48898cabdf1d3d0ea2cd3edf2e38cc1a3ba0d307685c83fd WatchSource:0}: Error finding container 7b53b5eb6f12716a48898cabdf1d3d0ea2cd3edf2e38cc1a3ba0d307685c83fd: Status 404 returned error can't find the container with id 7b53b5eb6f12716a48898cabdf1d3d0ea2cd3edf2e38cc1a3ba0d307685c83fd Jul 13 14:47:58.402998 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.402971 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76979f657f-fm6rp"] Jul 13 14:47:58.421628 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.421604 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-696dcb9849-6nxjk"] Jul 13 14:47:58.508532 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:58.508502 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc66f947_247b_42df_af20_b119f6bf3138.slice/crio-a0c91350e75d3ab1d6aa4523ffdca54549cad96db6c880c7650a90c698455330 WatchSource:0}: Error finding container a0c91350e75d3ab1d6aa4523ffdca54549cad96db6c880c7650a90c698455330: Status 404 returned error can't find the container with id a0c91350e75d3ab1d6aa4523ffdca54549cad96db6c880c7650a90c698455330 Jul 13 14:47:58.508769 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:47:58.508745 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade3f4e2_a136_4da9_9538_d2d271880738.slice/crio-cdabe6d7f531601c6b332775254b60d6c55152508761ba3b282100bce25c82a5 WatchSource:0}: Error finding container cdabe6d7f531601c6b332775254b60d6c55152508761ba3b282100bce25c82a5: Status 404 returned error can't find the container with id cdabe6d7f531601c6b332775254b60d6c55152508761ba3b282100bce25c82a5 Jul 13 14:47:58.812117 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.812022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76979f657f-fm6rp" event={"ID":"dc66f947-247b-42df-af20-b119f6bf3138","Type":"ContainerStarted","Data":"02a7a2e8890b6d2b9a483c99066b8d07fcdb08f5b660f62b1dbdd798082f9c8f"} Jul 13 14:47:58.812117 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.812082 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76979f657f-fm6rp" event={"ID":"dc66f947-247b-42df-af20-b119f6bf3138","Type":"ContainerStarted","Data":"a0c91350e75d3ab1d6aa4523ffdca54549cad96db6c880c7650a90c698455330"} Jul 13 14:47:58.814110 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.814081 2579 generic.go:356] "Generic (PLEG): container finished" podID="3aae023a-9895-49c6-a9a0-b203e6404c24" containerID="8f34c6c90237e304a5c7c07a2854a10a4566d93d2a167d0ade2c40441ac78368" exitCode=0 Jul 13 14:47:58.814246 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.814192 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4czr7" event={"ID":"3aae023a-9895-49c6-a9a0-b203e6404c24","Type":"ContainerDied","Data":"8f34c6c90237e304a5c7c07a2854a10a4566d93d2a167d0ade2c40441ac78368"} Jul 13 14:47:58.816522 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.816276 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" event={"ID":"ade3f4e2-a136-4da9-9538-d2d271880738","Type":"ContainerStarted","Data":"cdabe6d7f531601c6b332775254b60d6c55152508761ba3b282100bce25c82a5"} Jul 13 14:47:58.817842 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.817733 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b378907a-7514-44fb-ad08-62c15acf4ee4","Type":"ContainerStarted","Data":"7b53b5eb6f12716a48898cabdf1d3d0ea2cd3edf2e38cc1a3ba0d307685c83fd"} Jul 13 14:47:58.819425 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.819399 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-bz27r" event={"ID":"1920ad9c-d7a4-4fd7-b195-61a10b5a7699","Type":"ContainerStarted","Data":"761ce463ea05ae9ee47b738d72bef94ad95d2139aa8e5fd1c27009a6602568f4"} Jul 13 14:47:58.819648 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.819627 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-bz27r" Jul 13 14:47:58.845572 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.845540 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-bz27r" Jul 13 14:47:58.847111 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.847059 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76979f657f-fm6rp" podStartSLOduration=3.84704196 podStartE2EDuration="3.84704196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:47:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:58.833914897 +0000 UTC m=+129.117764115" watchObservedRunningTime="2026-07-13 14:47:58.84704196 +0000 UTC m=+129.130891179" Jul 13 14:47:58.877503 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:58.877453 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-bz27r" podStartSLOduration=1.3401048549999999 podStartE2EDuration="20.877435294s" totalImagesPullingTime="19.537330439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:58.877219915 +0000 UTC m=+129.161069136" watchObservedRunningTime="2026-07-13 14:47:58.877435294 +0000 UTC m=+129.161284511" Jul 13 14:47:59.823071 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.822982 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76979f657f-fm6rp"] Jul 13 14:47:59.834284 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.834003 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4czr7" event={"ID":"3aae023a-9895-49c6-a9a0-b203e6404c24","Type":"ContainerStarted","Data":"cbf221df02160752d5455bd967e23f59fdb5cda82f4b95adb417c62194a349c8"} Jul 13 14:47:59.834284 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.834075 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4czr7" event={"ID":"3aae023a-9895-49c6-a9a0-b203e6404c24","Type":"ContainerStarted","Data":"21fbfcf642652de91266be9bd0cce5c4b6f844316999be548fd5aac5105e4350"} Jul 13 14:47:59.856494 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.856424 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b99bc7867-7slkf"] Jul 13 14:47:59.859509 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.857302 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4czr7" podStartSLOduration=3.457719623 podStartE2EDuration="11.857284584s" totalImagesPullingTime="8.309870206s" totalInitContainerRuntime="89.694755ms" isStatefulPod=true podCreationTimestamp="2026-07-13 14:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:47:59.857099931 +0000 UTC m=+130.140949160" watchObservedRunningTime="2026-07-13 14:47:59.857284584 +0000 UTC m=+130.141133802" Jul 13 14:47:59.888438 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.887648 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b99bc7867-7slkf"] Jul 13 14:47:59.888438 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.887797 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.000170 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.999707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57517b14-23fa-43f7-8e11-3a781d298ec8-console-serving-cert\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.000170 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.999766 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzb5d\" (UniqueName: \"kubernetes.io/projected/57517b14-23fa-43f7-8e11-3a781d298ec8-kube-api-access-wzb5d\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.000170 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.999841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-console-config\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.000170 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.999871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-oauth-serving-cert\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.000170 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.999920 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57517b14-23fa-43f7-8e11-3a781d298ec8-console-oauth-config\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.000170 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:47:59.999955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-trusted-ca-bundle\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.000170 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.000036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-service-ca\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.100573 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.100529 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzb5d\" (UniqueName: \"kubernetes.io/projected/57517b14-23fa-43f7-8e11-3a781d298ec8-kube-api-access-wzb5d\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.100765 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.100594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-console-config\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.100765 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.100621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-oauth-serving-cert\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.100765 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.100667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57517b14-23fa-43f7-8e11-3a781d298ec8-console-oauth-config\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.100765 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.100698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-trusted-ca-bundle\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.100765 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.100745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:48:00.101059 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.100779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-service-ca\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.101059 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.100831 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57517b14-23fa-43f7-8e11-3a781d298ec8-console-serving-cert\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.102924 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.101951 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-service-ca\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.102924 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.102238 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-oauth-serving-cert\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.102924 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.102749 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-console-config\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.103670 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.103583 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-trusted-ca-bundle\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.104060 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.104015 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57517b14-23fa-43f7-8e11-3a781d298ec8-console-oauth-config\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.104060 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.104038 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db0f7b6d-a74a-4e54-a9f2-9069e242a4e3-metrics-certs\") pod \"network-metrics-daemon-nh2nq\" (UID: \"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3\") " pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:48:00.104312 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.104292 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57517b14-23fa-43f7-8e11-3a781d298ec8-console-serving-cert\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.110758 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.110702 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzb5d\" (UniqueName: \"kubernetes.io/projected/57517b14-23fa-43f7-8e11-3a781d298ec8-kube-api-access-wzb5d\") pod \"console-6b99bc7867-7slkf\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.120858 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.120829 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2gzcz\"" Jul 13 14:48:00.128893 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.128869 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nh2nq" Jul 13 14:48:00.204988 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.204916 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:00.347407 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.346720 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77bbd4b67f-dlfnt"] Jul 13 14:48:00.390205 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.390178 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nh2nq"] Jul 13 14:48:00.465885 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.460690 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b99bc7867-7slkf"] Jul 13 14:48:00.840053 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.839906 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b99bc7867-7slkf" event={"ID":"57517b14-23fa-43f7-8e11-3a781d298ec8","Type":"ContainerStarted","Data":"ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c"} Jul 13 14:48:00.840053 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.839975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b99bc7867-7slkf" event={"ID":"57517b14-23fa-43f7-8e11-3a781d298ec8","Type":"ContainerStarted","Data":"df8549b659ae9cb63c1fa07cfbc12543ba6ab21ac4cd80dbf906f3dcf9bcdb34"} Jul 13 14:48:00.841411 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.841377 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nh2nq" event={"ID":"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3","Type":"ContainerStarted","Data":"8dfd20f47e4431ba98716a8a9478f9ae50fe84e382d0055a0b4be2e8d2cdb26b"} Jul 13 14:48:00.861470 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:00.861409 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b99bc7867-7slkf" podStartSLOduration=1.861388774 podStartE2EDuration="1.861388774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:48:00.859290087 +0000 UTC m=+131.143139311" watchObservedRunningTime="2026-07-13 14:48:00.861388774 +0000 UTC m=+131.145237992" Jul 13 14:48:01.851706 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:01.851614 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" event={"ID":"ade3f4e2-a136-4da9-9538-d2d271880738","Type":"ContainerStarted","Data":"c26dcd7e45556c744b688f6600864ac637fbfb30387e923366aa1f17e68b8b98"} Jul 13 14:48:02.858817 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:02.858782 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" event={"ID":"ade3f4e2-a136-4da9-9538-d2d271880738","Type":"ContainerStarted","Data":"38aa988b1b6f71cd8b142d84e1eab41dee5e95271bb5f4f5138a1da3b12bf2c7"} Jul 13 14:48:02.859292 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:02.858858 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" event={"ID":"ade3f4e2-a136-4da9-9538-d2d271880738","Type":"ContainerStarted","Data":"865e0849f88f626eac748dcc833d30e6e9d9914d2efb29abcc013ff0911b92b2"} Jul 13 14:48:03.873172 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:03.872869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nh2nq" event={"ID":"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3","Type":"ContainerStarted","Data":"eaf8dd9ccdcd85156f9dba4e57576ae939a7c2df5107ee60649c3eef85943e1e"} Jul 13 14:48:03.873172 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:03.872962 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nh2nq" event={"ID":"db0f7b6d-a74a-4e54-a9f2-9069e242a4e3","Type":"ContainerStarted","Data":"f0cdabad6927c5224ec5162138a5608db92b16d696a8b27adc92747e1e1506af"} Jul 13 14:48:03.875123 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:03.875095 2579 generic.go:356] "Generic (PLEG): container finished" podID="b378907a-7514-44fb-ad08-62c15acf4ee4" containerID="243aae85f218226c8580147cd5303b866e06025bd31d5e4dc581a0030c1089fe" exitCode=0 Jul 13 14:48:03.875249 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:03.875144 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b378907a-7514-44fb-ad08-62c15acf4ee4","Type":"ContainerDied","Data":"243aae85f218226c8580147cd5303b866e06025bd31d5e4dc581a0030c1089fe"} Jul 13 14:48:03.893743 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:03.893683 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nh2nq" podStartSLOduration=131.143434138 podStartE2EDuration="2m13.893662666s" totalImagesPullingTime="2.750228528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:48:03.891494964 +0000 UTC m=+134.175344183" watchObservedRunningTime="2026-07-13 14:48:03.893662666 +0000 UTC m=+134.177511882" Jul 13 14:48:04.891450 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:04.891410 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" event={"ID":"ade3f4e2-a136-4da9-9538-d2d271880738","Type":"ContainerStarted","Data":"e818211cc7f25988d6a0ab0a2313b3fcd4d69b437dc106e7e6e3ed38f8f0ed20"} Jul 13 14:48:04.892037 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:04.891500 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" event={"ID":"ade3f4e2-a136-4da9-9538-d2d271880738","Type":"ContainerStarted","Data":"6892efa2aff3426549ac972e25aec5232abed546cf1bb1195c03a83a0ebf4e98"} Jul 13 14:48:04.892037 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:04.891544 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" event={"ID":"ade3f4e2-a136-4da9-9538-d2d271880738","Type":"ContainerStarted","Data":"0564ad96add34d767c2802d2a9593d92673d416d2183cbc859c87d682284f86f"} Jul 13 14:48:04.892037 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:04.891794 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:48:04.921314 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:04.921211 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" podStartSLOduration=8.035889053 podStartE2EDuration="12.921194365s" totalImagesPullingTime="4.885305312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:47:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:48:04.919929923 +0000 UTC m=+135.203779142" watchObservedRunningTime="2026-07-13 14:48:04.921194365 +0000 UTC m=+135.205043581" Jul 13 14:48:05.477790 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:05.477748 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:48:08.914217 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:08.914138 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b378907a-7514-44fb-ad08-62c15acf4ee4","Type":"ContainerStarted","Data":"9130ef93e3ef3d256f46ab1105888c6b0315f31e0c15dd04460ee0d880fedea8"} Jul 13 14:48:08.914217 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:08.914201 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b378907a-7514-44fb-ad08-62c15acf4ee4","Type":"ContainerStarted","Data":"0ee88fa64913bf3d386257f652e9b05d7b36474298f6d1467d12990c08f76be7"} Jul 13 14:48:08.914621 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:08.914229 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b378907a-7514-44fb-ad08-62c15acf4ee4","Type":"ContainerStarted","Data":"95ebc10311d009a081a06ee17ada80039e1a159470c846539cb1e9ecbfa2a835"} Jul 13 14:48:08.914621 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:08.914255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b378907a-7514-44fb-ad08-62c15acf4ee4","Type":"ContainerStarted","Data":"3d20917eeb6f942df4f879d634f2ff0ea96a4c18938e6dcc7881378c892d03ac"} Jul 13 14:48:08.914621 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:08.914279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b378907a-7514-44fb-ad08-62c15acf4ee4","Type":"ContainerStarted","Data":"1c67cb1b33a4e62e7bf2ff9344476846d70aa7a8697f9d116b5ffb2406469041"} Jul 13 14:48:08.914621 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:08.914302 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b378907a-7514-44fb-ad08-62c15acf4ee4","Type":"ContainerStarted","Data":"45c889dd88ed4817ee22fc6fb3f1d639700ad98fc48a04ff395d44ad12b180f9"} Jul 13 14:48:08.948029 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:08.947967 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.039268769 podStartE2EDuration="13.947952747s" totalImagesPullingTime="8.883295196s" totalInitContainerRuntime="25.388782ms" isStatefulPod=false podCreationTimestamp="2026-07-13 14:47:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:48:08.946638718 +0000 UTC m=+139.230487972" watchObservedRunningTime="2026-07-13 14:48:08.947952747 +0000 UTC m=+139.231801964" Jul 13 14:48:10.205423 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:10.205392 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:10.205847 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:10.205438 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:10.210444 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:10.210418 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:10.553942 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:10.553845 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:48:10.904688 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:10.904663 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-696dcb9849-6nxjk" Jul 13 14:48:10.925689 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:10.925660 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:48:11.009971 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:11.009939 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6766b75fb5-fwqzr"] Jul 13 14:48:14.939300 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:14.939259 2579 generic.go:356] "Generic (PLEG): container finished" podID="86e0453b-1b4c-4edd-9cd5-ddff7ba0e932" containerID="b135366a146388f45cd77df3aec66e2d6b9e558eadc93869eeb51aecb379a150" exitCode=0 Jul 13 14:48:14.939694 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:14.939332 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" event={"ID":"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932","Type":"ContainerDied","Data":"b135366a146388f45cd77df3aec66e2d6b9e558eadc93869eeb51aecb379a150"} Jul 13 14:48:14.939737 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:14.939709 2579 scope.go:117] "RemoveContainer" containerID="b135366a146388f45cd77df3aec66e2d6b9e558eadc93869eeb51aecb379a150" Jul 13 14:48:15.885431 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:15.885391 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-94wgn_7285b985-9f19-4d1e-aa48-28b5fd21e53c/serve-healthcheck-canary/0.log" Jul 13 14:48:15.945609 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:15.945573 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-5xtgw" event={"ID":"86e0453b-1b4c-4edd-9cd5-ddff7ba0e932","Type":"ContainerStarted","Data":"2a9cae997e38ab6bb30f623f15517b844fd4cfdd6f7daad8e26b39689877cea5"} Jul 13 14:48:25.389860 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.389793 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" podUID="0989dede-a7f8-45af-9668-b778e5fbf86a" containerName="registry" containerID="cri-o://5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734" gracePeriod=30 Jul 13 14:48:25.680515 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.680481 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:48:25.741689 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.741658 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0989dede-a7f8-45af-9668-b778e5fbf86a-image-registry-private-configuration\") pod \"0989dede-a7f8-45af-9668-b778e5fbf86a\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " Jul 13 14:48:25.741877 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.741704 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-certificates\") pod \"0989dede-a7f8-45af-9668-b778e5fbf86a\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " Jul 13 14:48:25.741877 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.741721 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0989dede-a7f8-45af-9668-b778e5fbf86a-trusted-ca\") pod \"0989dede-a7f8-45af-9668-b778e5fbf86a\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " Jul 13 14:48:25.741877 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.741745 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-bound-sa-token\") pod \"0989dede-a7f8-45af-9668-b778e5fbf86a\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " Jul 13 14:48:25.741877 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.741768 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0989dede-a7f8-45af-9668-b778e5fbf86a-installation-pull-secrets\") pod \"0989dede-a7f8-45af-9668-b778e5fbf86a\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " Jul 13 14:48:25.741877 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.741806 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whgp2\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-kube-api-access-whgp2\") pod \"0989dede-a7f8-45af-9668-b778e5fbf86a\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " Jul 13 14:48:25.741877 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.741853 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls\") pod \"0989dede-a7f8-45af-9668-b778e5fbf86a\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " Jul 13 14:48:25.742187 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.741894 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0989dede-a7f8-45af-9668-b778e5fbf86a-ca-trust-extracted\") pod \"0989dede-a7f8-45af-9668-b778e5fbf86a\" (UID: \"0989dede-a7f8-45af-9668-b778e5fbf86a\") " Jul 13 14:48:25.742187 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.742162 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0989dede-a7f8-45af-9668-b778e5fbf86a" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:48:25.742284 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.742199 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0989dede-a7f8-45af-9668-b778e5fbf86a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0989dede-a7f8-45af-9668-b778e5fbf86a" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:48:25.744412 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.744379 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0989dede-a7f8-45af-9668-b778e5fbf86a" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:48:25.744638 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.744610 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0989dede-a7f8-45af-9668-b778e5fbf86a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0989dede-a7f8-45af-9668-b778e5fbf86a" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:48:25.744739 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.744681 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0989dede-a7f8-45af-9668-b778e5fbf86a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0989dede-a7f8-45af-9668-b778e5fbf86a" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:48:25.744739 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.744680 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-kube-api-access-whgp2" (OuterVolumeSpecName: "kube-api-access-whgp2") pod "0989dede-a7f8-45af-9668-b778e5fbf86a" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a"). InnerVolumeSpecName "kube-api-access-whgp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:48:25.744739 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.744733 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0989dede-a7f8-45af-9668-b778e5fbf86a" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:48:25.749972 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.749949 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0989dede-a7f8-45af-9668-b778e5fbf86a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0989dede-a7f8-45af-9668-b778e5fbf86a" (UID: "0989dede-a7f8-45af-9668-b778e5fbf86a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:48:25.842914 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.842872 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-tls\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:25.842914 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.842906 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0989dede-a7f8-45af-9668-b778e5fbf86a-ca-trust-extracted\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:25.842914 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.842918 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0989dede-a7f8-45af-9668-b778e5fbf86a-image-registry-private-configuration\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:25.843142 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.842928 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0989dede-a7f8-45af-9668-b778e5fbf86a-registry-certificates\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:25.843142 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.842937 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0989dede-a7f8-45af-9668-b778e5fbf86a-trusted-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:25.843142 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.842945 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-bound-sa-token\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:25.843142 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.842953 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0989dede-a7f8-45af-9668-b778e5fbf86a-installation-pull-secrets\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:25.843142 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.842963 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whgp2\" (UniqueName: \"kubernetes.io/projected/0989dede-a7f8-45af-9668-b778e5fbf86a-kube-api-access-whgp2\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:25.868807 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.868770 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76979f657f-fm6rp" podUID="dc66f947-247b-42df-af20-b119f6bf3138" containerName="console" containerID="cri-o://02a7a2e8890b6d2b9a483c99066b8d07fcdb08f5b660f62b1dbdd798082f9c8f" gracePeriod=15 Jul 13 14:48:25.987311 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.987280 2579 generic.go:356] "Generic (PLEG): container finished" podID="dc66f947-247b-42df-af20-b119f6bf3138" containerID="02a7a2e8890b6d2b9a483c99066b8d07fcdb08f5b660f62b1dbdd798082f9c8f" exitCode=0 Jul 13 14:48:25.987476 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.987379 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76979f657f-fm6rp" event={"ID":"dc66f947-247b-42df-af20-b119f6bf3138","Type":"ContainerDied","Data":"02a7a2e8890b6d2b9a483c99066b8d07fcdb08f5b660f62b1dbdd798082f9c8f"} Jul 13 14:48:25.988592 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.988570 2579 generic.go:356] "Generic (PLEG): container finished" podID="0989dede-a7f8-45af-9668-b778e5fbf86a" containerID="5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734" exitCode=0 Jul 13 14:48:25.988697 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.988615 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" Jul 13 14:48:25.988697 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.988618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" event={"ID":"0989dede-a7f8-45af-9668-b778e5fbf86a","Type":"ContainerDied","Data":"5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734"} Jul 13 14:48:25.988697 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.988653 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bbd4b67f-dlfnt" event={"ID":"0989dede-a7f8-45af-9668-b778e5fbf86a","Type":"ContainerDied","Data":"9dce8e7d69e21db16094d270216f39dafff0a2c09124906e8da795db7cf59330"} Jul 13 14:48:25.988697 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.988674 2579 scope.go:117] "RemoveContainer" containerID="5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734" Jul 13 14:48:25.997699 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.997676 2579 scope.go:117] "RemoveContainer" containerID="5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734" Jul 13 14:48:25.998039 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:48:25.998004 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734\": container with ID starting with 5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734 not found: ID does not exist" containerID="5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734" Jul 13 14:48:25.998148 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:25.998051 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734"} err="failed to get container status \"5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734\": rpc error: code = NotFound desc = could not find container \"5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734\": container with ID starting with 5febcb3e793f3fd74caf36de653cebbb2a5ba4b30f3539d0b3b66a0ae0485734 not found: ID does not exist" Jul 13 14:48:26.016218 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.016188 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77bbd4b67f-dlfnt"] Jul 13 14:48:26.020300 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.020272 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77bbd4b67f-dlfnt"] Jul 13 14:48:26.152591 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.152560 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:48:26.211708 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.211616 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0989dede-a7f8-45af-9668-b778e5fbf86a" path="/var/lib/kubelet/pods/0989dede-a7f8-45af-9668-b778e5fbf86a/volumes" Jul 13 14:48:26.245593 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.245565 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-trusted-ca-bundle\") pod \"dc66f947-247b-42df-af20-b119f6bf3138\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " Jul 13 14:48:26.245782 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.245603 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc66f947-247b-42df-af20-b119f6bf3138-console-serving-cert\") pod \"dc66f947-247b-42df-af20-b119f6bf3138\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " Jul 13 14:48:26.245782 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.245626 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc66f947-247b-42df-af20-b119f6bf3138-console-oauth-config\") pod \"dc66f947-247b-42df-af20-b119f6bf3138\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " Jul 13 14:48:26.245782 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.245646 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-oauth-serving-cert\") pod \"dc66f947-247b-42df-af20-b119f6bf3138\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " Jul 13 14:48:26.245782 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.245755 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-console-config\") pod \"dc66f947-247b-42df-af20-b119f6bf3138\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " Jul 13 14:48:26.246020 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.245842 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8m65\" (UniqueName: \"kubernetes.io/projected/dc66f947-247b-42df-af20-b119f6bf3138-kube-api-access-d8m65\") pod \"dc66f947-247b-42df-af20-b119f6bf3138\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " Jul 13 14:48:26.246020 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.245900 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-service-ca\") pod \"dc66f947-247b-42df-af20-b119f6bf3138\" (UID: \"dc66f947-247b-42df-af20-b119f6bf3138\") " Jul 13 14:48:26.246129 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.246066 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dc66f947-247b-42df-af20-b119f6bf3138" (UID: "dc66f947-247b-42df-af20-b119f6bf3138"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:48:26.246195 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.246122 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dc66f947-247b-42df-af20-b119f6bf3138" (UID: "dc66f947-247b-42df-af20-b119f6bf3138"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:48:26.246315 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.246291 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-trusted-ca-bundle\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:26.246315 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.246316 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-oauth-serving-cert\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:26.246521 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.246373 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-service-ca" (OuterVolumeSpecName: "service-ca") pod "dc66f947-247b-42df-af20-b119f6bf3138" (UID: "dc66f947-247b-42df-af20-b119f6bf3138"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:48:26.246656 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.246628 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-console-config" (OuterVolumeSpecName: "console-config") pod "dc66f947-247b-42df-af20-b119f6bf3138" (UID: "dc66f947-247b-42df-af20-b119f6bf3138"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:48:26.248202 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.248165 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc66f947-247b-42df-af20-b119f6bf3138-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dc66f947-247b-42df-af20-b119f6bf3138" (UID: "dc66f947-247b-42df-af20-b119f6bf3138"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:48:26.248316 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.248231 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc66f947-247b-42df-af20-b119f6bf3138-kube-api-access-d8m65" (OuterVolumeSpecName: "kube-api-access-d8m65") pod "dc66f947-247b-42df-af20-b119f6bf3138" (UID: "dc66f947-247b-42df-af20-b119f6bf3138"). InnerVolumeSpecName "kube-api-access-d8m65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:48:26.248316 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.248249 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc66f947-247b-42df-af20-b119f6bf3138-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dc66f947-247b-42df-af20-b119f6bf3138" (UID: "dc66f947-247b-42df-af20-b119f6bf3138"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:48:26.347476 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.347446 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-console-config\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:26.347476 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.347475 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8m65\" (UniqueName: \"kubernetes.io/projected/dc66f947-247b-42df-af20-b119f6bf3138-kube-api-access-d8m65\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:26.347701 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.347487 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc66f947-247b-42df-af20-b119f6bf3138-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:26.347701 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.347496 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc66f947-247b-42df-af20-b119f6bf3138-console-serving-cert\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:26.347701 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.347506 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc66f947-247b-42df-af20-b119f6bf3138-console-oauth-config\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:26.994383 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.994328 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76979f657f-fm6rp" event={"ID":"dc66f947-247b-42df-af20-b119f6bf3138","Type":"ContainerDied","Data":"a0c91350e75d3ab1d6aa4523ffdca54549cad96db6c880c7650a90c698455330"} Jul 13 14:48:26.994836 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.994413 2579 scope.go:117] "RemoveContainer" containerID="02a7a2e8890b6d2b9a483c99066b8d07fcdb08f5b660f62b1dbdd798082f9c8f" Jul 13 14:48:26.994836 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:26.994356 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76979f657f-fm6rp" Jul 13 14:48:27.018020 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:27.017993 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76979f657f-fm6rp"] Jul 13 14:48:27.022757 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:27.022732 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76979f657f-fm6rp"] Jul 13 14:48:28.206739 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:28.206709 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc66f947-247b-42df-af20-b119f6bf3138" path="/var/lib/kubelet/pods/dc66f947-247b-42df-af20-b119f6bf3138/volumes" Jul 13 14:48:36.032768 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.032731 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6766b75fb5-fwqzr" podUID="58420915-ab25-4c2e-9abb-09c8f4c3b820" containerName="console" containerID="cri-o://943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706" gracePeriod=15 Jul 13 14:48:36.301765 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.301678 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:48:36.437493 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.437461 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-trusted-ca-bundle\") pod \"58420915-ab25-4c2e-9abb-09c8f4c3b820\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " Jul 13 14:48:36.437493 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.437509 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-serving-cert\") pod \"58420915-ab25-4c2e-9abb-09c8f4c3b820\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " Jul 13 14:48:36.437742 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.437539 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-oauth-config\") pod \"58420915-ab25-4c2e-9abb-09c8f4c3b820\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " Jul 13 14:48:36.437742 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.437569 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9kjh\" (UniqueName: \"kubernetes.io/projected/58420915-ab25-4c2e-9abb-09c8f4c3b820-kube-api-access-c9kjh\") pod \"58420915-ab25-4c2e-9abb-09c8f4c3b820\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " Jul 13 14:48:36.437742 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.437599 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-service-ca\") pod \"58420915-ab25-4c2e-9abb-09c8f4c3b820\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " Jul 13 14:48:36.437742 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.437629 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-oauth-serving-cert\") pod \"58420915-ab25-4c2e-9abb-09c8f4c3b820\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " Jul 13 14:48:36.437742 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.437682 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-config\") pod \"58420915-ab25-4c2e-9abb-09c8f4c3b820\" (UID: \"58420915-ab25-4c2e-9abb-09c8f4c3b820\") " Jul 13 14:48:36.437988 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.437871 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "58420915-ab25-4c2e-9abb-09c8f4c3b820" (UID: "58420915-ab25-4c2e-9abb-09c8f4c3b820"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:48:36.438055 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.438036 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-service-ca" (OuterVolumeSpecName: "service-ca") pod "58420915-ab25-4c2e-9abb-09c8f4c3b820" (UID: "58420915-ab25-4c2e-9abb-09c8f4c3b820"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:48:36.438137 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.438112 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "58420915-ab25-4c2e-9abb-09c8f4c3b820" (UID: "58420915-ab25-4c2e-9abb-09c8f4c3b820"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:48:36.438250 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.438227 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-config" (OuterVolumeSpecName: "console-config") pod "58420915-ab25-4c2e-9abb-09c8f4c3b820" (UID: "58420915-ab25-4c2e-9abb-09c8f4c3b820"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:48:36.439869 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.439843 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58420915-ab25-4c2e-9abb-09c8f4c3b820-kube-api-access-c9kjh" (OuterVolumeSpecName: "kube-api-access-c9kjh") pod "58420915-ab25-4c2e-9abb-09c8f4c3b820" (UID: "58420915-ab25-4c2e-9abb-09c8f4c3b820"). InnerVolumeSpecName "kube-api-access-c9kjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:48:36.439967 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.439847 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "58420915-ab25-4c2e-9abb-09c8f4c3b820" (UID: "58420915-ab25-4c2e-9abb-09c8f4c3b820"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:48:36.439967 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.439929 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "58420915-ab25-4c2e-9abb-09c8f4c3b820" (UID: "58420915-ab25-4c2e-9abb-09c8f4c3b820"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:48:36.539128 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.539093 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-oauth-config\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:36.539128 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.539124 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9kjh\" (UniqueName: \"kubernetes.io/projected/58420915-ab25-4c2e-9abb-09c8f4c3b820-kube-api-access-c9kjh\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:36.539377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.539137 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:36.539377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.539151 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-oauth-serving-cert\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:36.539377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.539162 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-config\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:36.539377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.539174 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58420915-ab25-4c2e-9abb-09c8f4c3b820-trusted-ca-bundle\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:36.539377 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:36.539185 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58420915-ab25-4c2e-9abb-09c8f4c3b820-console-serving-cert\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:48:37.041056 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:37.041020 2579 generic.go:356] "Generic (PLEG): container finished" podID="58420915-ab25-4c2e-9abb-09c8f4c3b820" containerID="943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706" exitCode=0 Jul 13 14:48:37.041463 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:37.041071 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6766b75fb5-fwqzr" Jul 13 14:48:37.041463 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:37.041109 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6766b75fb5-fwqzr" event={"ID":"58420915-ab25-4c2e-9abb-09c8f4c3b820","Type":"ContainerDied","Data":"943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706"} Jul 13 14:48:37.041463 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:37.041161 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6766b75fb5-fwqzr" event={"ID":"58420915-ab25-4c2e-9abb-09c8f4c3b820","Type":"ContainerDied","Data":"cd3e2486293df86c3111b192f0c3ea67c439c784d65b27f8ecf83b4418b614c7"} Jul 13 14:48:37.041463 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:37.041189 2579 scope.go:117] "RemoveContainer" containerID="943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706" Jul 13 14:48:37.053580 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:37.053556 2579 scope.go:117] "RemoveContainer" containerID="943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706" Jul 13 14:48:37.053868 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:48:37.053847 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706\": container with ID starting with 943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706 not found: ID does not exist" containerID="943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706" Jul 13 14:48:37.053933 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:37.053876 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706"} err="failed to get container status \"943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706\": rpc error: code = NotFound desc = could not find container \"943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706\": container with ID starting with 943a63fe88349a58ca7dde1f9634ae70183664e6d561033046bc7db8da646706 not found: ID does not exist" Jul 13 14:48:37.066809 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:37.066782 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6766b75fb5-fwqzr"] Jul 13 14:48:37.073112 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:37.073086 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6766b75fb5-fwqzr"] Jul 13 14:48:38.205066 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:38.205028 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58420915-ab25-4c2e-9abb-09c8f4c3b820" path="/var/lib/kubelet/pods/58420915-ab25-4c2e-9abb-09c8f4c3b820/volumes" Jul 13 14:48:55.554215 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:55.554176 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:48:55.573689 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:55.573658 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:48:56.130945 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:48:56.130921 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 14:49:25.786454 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:25.786422 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b99bc7867-7slkf"] Jul 13 14:49:50.809219 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:50.809162 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b99bc7867-7slkf" podUID="57517b14-23fa-43f7-8e11-3a781d298ec8" containerName="console" containerID="cri-o://ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c" gracePeriod=15 Jul 13 14:49:50.922354 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:50.922312 2579 patch_prober.go:28] interesting pod/console-6b99bc7867-7slkf container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jul 13 14:49:50.922496 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:50.922399 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6b99bc7867-7slkf" podUID="57517b14-23fa-43f7-8e11-3a781d298ec8" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jul 13 14:49:51.057077 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.057050 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:49:51.158552 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.158517 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57517b14-23fa-43f7-8e11-3a781d298ec8-console-oauth-config\") pod \"57517b14-23fa-43f7-8e11-3a781d298ec8\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " Jul 13 14:49:51.158552 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.158556 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57517b14-23fa-43f7-8e11-3a781d298ec8-console-serving-cert\") pod \"57517b14-23fa-43f7-8e11-3a781d298ec8\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " Jul 13 14:49:51.158778 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.158575 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-console-config\") pod \"57517b14-23fa-43f7-8e11-3a781d298ec8\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " Jul 13 14:49:51.158778 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.158616 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-oauth-serving-cert\") pod \"57517b14-23fa-43f7-8e11-3a781d298ec8\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " Jul 13 14:49:51.158778 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.158653 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-trusted-ca-bundle\") pod \"57517b14-23fa-43f7-8e11-3a781d298ec8\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " Jul 13 14:49:51.158778 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.158691 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzb5d\" (UniqueName: \"kubernetes.io/projected/57517b14-23fa-43f7-8e11-3a781d298ec8-kube-api-access-wzb5d\") pod \"57517b14-23fa-43f7-8e11-3a781d298ec8\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " Jul 13 14:49:51.158778 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.158727 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-service-ca\") pod \"57517b14-23fa-43f7-8e11-3a781d298ec8\" (UID: \"57517b14-23fa-43f7-8e11-3a781d298ec8\") " Jul 13 14:49:51.159128 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.159094 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-console-config" (OuterVolumeSpecName: "console-config") pod "57517b14-23fa-43f7-8e11-3a781d298ec8" (UID: "57517b14-23fa-43f7-8e11-3a781d298ec8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:49:51.159260 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.159129 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "57517b14-23fa-43f7-8e11-3a781d298ec8" (UID: "57517b14-23fa-43f7-8e11-3a781d298ec8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:49:51.159260 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.159134 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "57517b14-23fa-43f7-8e11-3a781d298ec8" (UID: "57517b14-23fa-43f7-8e11-3a781d298ec8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:49:51.159260 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.159182 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-service-ca" (OuterVolumeSpecName: "service-ca") pod "57517b14-23fa-43f7-8e11-3a781d298ec8" (UID: "57517b14-23fa-43f7-8e11-3a781d298ec8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:49:51.160662 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.160636 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57517b14-23fa-43f7-8e11-3a781d298ec8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "57517b14-23fa-43f7-8e11-3a781d298ec8" (UID: "57517b14-23fa-43f7-8e11-3a781d298ec8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:49:51.160751 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.160734 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57517b14-23fa-43f7-8e11-3a781d298ec8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "57517b14-23fa-43f7-8e11-3a781d298ec8" (UID: "57517b14-23fa-43f7-8e11-3a781d298ec8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:49:51.160806 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.160791 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57517b14-23fa-43f7-8e11-3a781d298ec8-kube-api-access-wzb5d" (OuterVolumeSpecName: "kube-api-access-wzb5d") pod "57517b14-23fa-43f7-8e11-3a781d298ec8" (UID: "57517b14-23fa-43f7-8e11-3a781d298ec8"). InnerVolumeSpecName "kube-api-access-wzb5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:49:51.259504 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.259466 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-oauth-serving-cert\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:49:51.259504 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.259495 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-trusted-ca-bundle\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:49:51.259504 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.259504 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzb5d\" (UniqueName: \"kubernetes.io/projected/57517b14-23fa-43f7-8e11-3a781d298ec8-kube-api-access-wzb5d\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:49:51.259504 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.259513 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:49:51.259767 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.259522 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57517b14-23fa-43f7-8e11-3a781d298ec8-console-oauth-config\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:49:51.259767 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.259532 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57517b14-23fa-43f7-8e11-3a781d298ec8-console-serving-cert\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:49:51.259767 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.259540 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57517b14-23fa-43f7-8e11-3a781d298ec8-console-config\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:49:51.320482 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.320448 2579 generic.go:356] "Generic (PLEG): container finished" podID="57517b14-23fa-43f7-8e11-3a781d298ec8" containerID="ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c" exitCode=0 Jul 13 14:49:51.320636 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.320495 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b99bc7867-7slkf" Jul 13 14:49:51.320636 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.320541 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b99bc7867-7slkf" event={"ID":"57517b14-23fa-43f7-8e11-3a781d298ec8","Type":"ContainerDied","Data":"ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c"} Jul 13 14:49:51.320636 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.320598 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b99bc7867-7slkf" event={"ID":"57517b14-23fa-43f7-8e11-3a781d298ec8","Type":"ContainerDied","Data":"df8549b659ae9cb63c1fa07cfbc12543ba6ab21ac4cd80dbf906f3dcf9bcdb34"} Jul 13 14:49:51.320636 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.320624 2579 scope.go:117] "RemoveContainer" containerID="ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c" Jul 13 14:49:51.329118 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.329099 2579 scope.go:117] "RemoveContainer" containerID="ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c" Jul 13 14:49:51.329388 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:49:51.329373 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c\": container with ID starting with ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c not found: ID does not exist" containerID="ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c" Jul 13 14:49:51.329442 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.329398 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c"} err="failed to get container status \"ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c\": rpc error: code = NotFound desc = could not find container \"ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c\": container with ID starting with ac3568c461db422264aced13198126a2ea4e453ea693d2e3f9f5c24353033f6c not found: ID does not exist" Jul 13 14:49:51.342754 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.342727 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b99bc7867-7slkf"] Jul 13 14:49:51.350165 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:51.350138 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b99bc7867-7slkf"] Jul 13 14:49:52.205195 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:49:52.205153 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57517b14-23fa-43f7-8e11-3a781d298ec8" path="/var/lib/kubelet/pods/57517b14-23fa-43f7-8e11-3a781d298ec8/volumes" Jul 13 14:50:39.131715 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.131681 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd"] Jul 13 14:50:39.132256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.131988 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58420915-ab25-4c2e-9abb-09c8f4c3b820" containerName="console" Jul 13 14:50:39.132256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.131999 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="58420915-ab25-4c2e-9abb-09c8f4c3b820" containerName="console" Jul 13 14:50:39.132256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.132016 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc66f947-247b-42df-af20-b119f6bf3138" containerName="console" Jul 13 14:50:39.132256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.132022 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc66f947-247b-42df-af20-b119f6bf3138" containerName="console" Jul 13 14:50:39.132256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.132033 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57517b14-23fa-43f7-8e11-3a781d298ec8" containerName="console" Jul 13 14:50:39.132256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.132039 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="57517b14-23fa-43f7-8e11-3a781d298ec8" containerName="console" Jul 13 14:50:39.132256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.132048 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0989dede-a7f8-45af-9668-b778e5fbf86a" containerName="registry" Jul 13 14:50:39.132256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.132053 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0989dede-a7f8-45af-9668-b778e5fbf86a" containerName="registry" Jul 13 14:50:39.132256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.132096 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="57517b14-23fa-43f7-8e11-3a781d298ec8" containerName="console" Jul 13 14:50:39.132256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.132106 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc66f947-247b-42df-af20-b119f6bf3138" containerName="console" Jul 13 14:50:39.132256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.132112 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="58420915-ab25-4c2e-9abb-09c8f4c3b820" containerName="console" Jul 13 14:50:39.132256 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.132118 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0989dede-a7f8-45af-9668-b778e5fbf86a" containerName="registry" Jul 13 14:50:39.134146 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.134129 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd" Jul 13 14:50:39.136995 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.136975 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vb28j\"" Jul 13 14:50:39.137126 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.136975 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 14:50:39.138599 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.138582 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 14:50:39.144432 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.144407 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd"] Jul 13 14:50:39.215525 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.215494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/586dcc9a-77ee-4945-9e60-b3498a058cd0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m6zfd\" (UID: \"586dcc9a-77ee-4945-9e60-b3498a058cd0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd" Jul 13 14:50:39.215773 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.215710 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jjpj\" (UniqueName: \"kubernetes.io/projected/586dcc9a-77ee-4945-9e60-b3498a058cd0-kube-api-access-9jjpj\") pod \"cert-manager-cainjector-559cdd8c87-m6zfd\" (UID: \"586dcc9a-77ee-4945-9e60-b3498a058cd0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd" Jul 13 14:50:39.316930 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.316870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jjpj\" (UniqueName: \"kubernetes.io/projected/586dcc9a-77ee-4945-9e60-b3498a058cd0-kube-api-access-9jjpj\") pod \"cert-manager-cainjector-559cdd8c87-m6zfd\" (UID: \"586dcc9a-77ee-4945-9e60-b3498a058cd0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd" Jul 13 14:50:39.316930 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.316944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/586dcc9a-77ee-4945-9e60-b3498a058cd0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m6zfd\" (UID: \"586dcc9a-77ee-4945-9e60-b3498a058cd0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd" Jul 13 14:50:39.326694 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.326656 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/586dcc9a-77ee-4945-9e60-b3498a058cd0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m6zfd\" (UID: \"586dcc9a-77ee-4945-9e60-b3498a058cd0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd" Jul 13 14:50:39.326823 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.326720 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jjpj\" (UniqueName: \"kubernetes.io/projected/586dcc9a-77ee-4945-9e60-b3498a058cd0-kube-api-access-9jjpj\") pod \"cert-manager-cainjector-559cdd8c87-m6zfd\" (UID: \"586dcc9a-77ee-4945-9e60-b3498a058cd0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd" Jul 13 14:50:39.459815 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.459740 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd" Jul 13 14:50:39.585088 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:39.585060 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd"] Jul 13 14:50:39.587761 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:50:39.587727 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod586dcc9a_77ee_4945_9e60_b3498a058cd0.slice/crio-58b66b6b279d15495c03b246bab3ace4c32beef063d3c11b5df18e3d7e2f5b8f WatchSource:0}: Error finding container 58b66b6b279d15495c03b246bab3ace4c32beef063d3c11b5df18e3d7e2f5b8f: Status 404 returned error can't find the container with id 58b66b6b279d15495c03b246bab3ace4c32beef063d3c11b5df18e3d7e2f5b8f Jul 13 14:50:40.515283 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:40.515238 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd" event={"ID":"586dcc9a-77ee-4945-9e60-b3498a058cd0","Type":"ContainerStarted","Data":"58b66b6b279d15495c03b246bab3ace4c32beef063d3c11b5df18e3d7e2f5b8f"} Jul 13 14:50:43.529681 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:43.529640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd" event={"ID":"586dcc9a-77ee-4945-9e60-b3498a058cd0","Type":"ContainerStarted","Data":"e3644a2c3a1a1faf3a814266a45c35467d1c71e066dd2962fb8241630a9f65a7"} Jul 13 14:50:43.547237 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:43.547177 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zfd" podStartSLOduration=1.2774516519999999 podStartE2EDuration="4.547160683s" totalImagesPullingTime="3.269709031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:50:43.546109011 +0000 UTC m=+293.829958230" watchObservedRunningTime="2026-07-13 14:50:43.547160683 +0000 UTC m=+293.831009900" Jul 13 14:50:50.148574 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:50.148542 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 14:50:50.149328 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:50.149300 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 14:50:50.156600 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:50:50.156575 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 14:51:09.428533 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.428502 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l"] Jul 13 14:51:09.433158 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.433138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.437562 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.437535 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 14:51:09.437848 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.437826 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 14:51:09.438043 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.437876 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 14:51:09.438291 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.438268 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-knj5m\"" Jul 13 14:51:09.438646 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.438624 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 14:51:09.457248 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.457217 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l"] Jul 13 14:51:09.572981 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.572937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a298642-2cb0-4152-aa36-e64718da5f2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.573160 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.572992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a298642-2cb0-4152-aa36-e64718da5f2a-manifests\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.573160 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.573019 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfc5c\" (UniqueName: \"kubernetes.io/projected/2a298642-2cb0-4152-aa36-e64718da5f2a-kube-api-access-bfc5c\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.573233 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.573147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a298642-2cb0-4152-aa36-e64718da5f2a-tmp\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.573233 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.573188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a298642-2cb0-4152-aa36-e64718da5f2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.673723 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.673683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a298642-2cb0-4152-aa36-e64718da5f2a-tmp\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.673906 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.673731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a298642-2cb0-4152-aa36-e64718da5f2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.673906 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.673774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a298642-2cb0-4152-aa36-e64718da5f2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.673906 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.673801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a298642-2cb0-4152-aa36-e64718da5f2a-manifests\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.673906 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.673827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfc5c\" (UniqueName: \"kubernetes.io/projected/2a298642-2cb0-4152-aa36-e64718da5f2a-kube-api-access-bfc5c\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.674298 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.674244 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a298642-2cb0-4152-aa36-e64718da5f2a-manifests\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.676182 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.676153 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a298642-2cb0-4152-aa36-e64718da5f2a-tmp\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.676616 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.676595 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a298642-2cb0-4152-aa36-e64718da5f2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.676710 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.676595 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a298642-2cb0-4152-aa36-e64718da5f2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.682955 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.682898 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfc5c\" (UniqueName: \"kubernetes.io/projected/2a298642-2cb0-4152-aa36-e64718da5f2a-kube-api-access-bfc5c\") pod \"opendatahub-operator-controller-manager-6496967d77-bm88l\" (UID: \"2a298642-2cb0-4152-aa36-e64718da5f2a\") " pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.744815 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.744777 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:09.878263 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.878230 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l"] Jul 13 14:51:09.882126 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:51:09.882100 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a298642_2cb0_4152_aa36_e64718da5f2a.slice/crio-48dae815a90c2a6ec6f7da246a2a651c7371d86ed70bd68230fb4f7857633190 WatchSource:0}: Error finding container 48dae815a90c2a6ec6f7da246a2a651c7371d86ed70bd68230fb4f7857633190: Status 404 returned error can't find the container with id 48dae815a90c2a6ec6f7da246a2a651c7371d86ed70bd68230fb4f7857633190 Jul 13 14:51:09.884043 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:09.884021 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 14:51:10.634700 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:10.634653 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" event={"ID":"2a298642-2cb0-4152-aa36-e64718da5f2a","Type":"ContainerStarted","Data":"48dae815a90c2a6ec6f7da246a2a651c7371d86ed70bd68230fb4f7857633190"} Jul 13 14:51:13.649218 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:13.649179 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" event={"ID":"2a298642-2cb0-4152-aa36-e64718da5f2a","Type":"ContainerStarted","Data":"df38ecc50bb72f8627a2166c7964f457f04fa3ade0df36f42ea0a11593290b81"} Jul 13 14:51:14.654727 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:14.654692 2579 generic.go:356] "Generic (PLEG): container finished" podID="2a298642-2cb0-4152-aa36-e64718da5f2a" containerID="df38ecc50bb72f8627a2166c7964f457f04fa3ade0df36f42ea0a11593290b81" exitCode=0 Jul 13 14:51:14.655116 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:14.654759 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" event={"ID":"2a298642-2cb0-4152-aa36-e64718da5f2a","Type":"ContainerDied","Data":"df38ecc50bb72f8627a2166c7964f457f04fa3ade0df36f42ea0a11593290b81"} Jul 13 14:51:17.668239 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:17.668198 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" event={"ID":"2a298642-2cb0-4152-aa36-e64718da5f2a","Type":"ContainerStarted","Data":"4274a1f78eda214bbe1f60734f053926ec70a296237dbf017edf6e8a140a5322"} Jul 13 14:51:17.668644 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:17.668372 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:17.695299 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:17.695249 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" podStartSLOduration=2.407982051 podStartE2EDuration="8.695234141s" totalImagesPullingTime="5.282090351s" totalInitContainerRuntime="1.005161739s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:51:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:51:17.694780499 +0000 UTC m=+327.978629718" watchObservedRunningTime="2026-07-13 14:51:17.695234141 +0000 UTC m=+327.979083357" Jul 13 14:51:28.674819 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:28.674784 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6496967d77-bm88l" Jul 13 14:51:39.768090 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.768051 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22"] Jul 13 14:51:39.778554 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.778522 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.781875 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.781841 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 13 14:51:39.781875 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.781842 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 14:51:39.782057 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.781841 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 13 14:51:39.782057 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.781845 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 14:51:39.782237 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.782219 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 13 14:51:39.782290 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.782280 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 14:51:39.783174 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.783155 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8wjbt\"" Jul 13 14:51:39.791845 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.791812 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22"] Jul 13 14:51:39.818579 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.818544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7022f291-a695-427a-b621-13f23623d858-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.818579 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.818583 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7022f291-a695-427a-b621-13f23623d858-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.818782 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.818612 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7022f291-a695-427a-b621-13f23623d858-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.818782 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.818702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7022f291-a695-427a-b621-13f23623d858-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.818782 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.818742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7022f291-a695-427a-b621-13f23623d858-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.818782 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.818760 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjdz4\" (UniqueName: \"kubernetes.io/projected/7022f291-a695-427a-b621-13f23623d858-kube-api-access-cjdz4\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.818930 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.818809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7022f291-a695-427a-b621-13f23623d858-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.919937 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.919895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7022f291-a695-427a-b621-13f23623d858-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.919937 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.919945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7022f291-a695-427a-b621-13f23623d858-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.920188 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.919977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7022f291-a695-427a-b621-13f23623d858-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.920188 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.920020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7022f291-a695-427a-b621-13f23623d858-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.920188 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.920058 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7022f291-a695-427a-b621-13f23623d858-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.920188 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.920080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjdz4\" (UniqueName: \"kubernetes.io/projected/7022f291-a695-427a-b621-13f23623d858-kube-api-access-cjdz4\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.920188 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.920114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7022f291-a695-427a-b621-13f23623d858-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.921166 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.921134 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7022f291-a695-427a-b621-13f23623d858-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.922589 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.922545 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7022f291-a695-427a-b621-13f23623d858-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.922859 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.922839 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7022f291-a695-427a-b621-13f23623d858-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.922931 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.922873 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7022f291-a695-427a-b621-13f23623d858-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.922977 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.922947 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7022f291-a695-427a-b621-13f23623d858-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.929960 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.929930 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7022f291-a695-427a-b621-13f23623d858-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:39.930114 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:39.930092 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjdz4\" (UniqueName: \"kubernetes.io/projected/7022f291-a695-427a-b621-13f23623d858-kube-api-access-cjdz4\") pod \"istiod-openshift-gateway-94bb8fbfd-64s22\" (UID: \"7022f291-a695-427a-b621-13f23623d858\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:40.087626 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:40.087534 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:40.227774 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:40.227744 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22"] Jul 13 14:51:40.231201 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:51:40.231172 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7022f291_a695_427a_b621_13f23623d858.slice/crio-9053dc03547ad300e96bee4ebe774e81bef4f3a36c77a6a4caead8db508fd5be WatchSource:0}: Error finding container 9053dc03547ad300e96bee4ebe774e81bef4f3a36c77a6a4caead8db508fd5be: Status 404 returned error can't find the container with id 9053dc03547ad300e96bee4ebe774e81bef4f3a36c77a6a4caead8db508fd5be Jul 13 14:51:40.761689 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:40.761649 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" event={"ID":"7022f291-a695-427a-b621-13f23623d858","Type":"ContainerStarted","Data":"9053dc03547ad300e96bee4ebe774e81bef4f3a36c77a6a4caead8db508fd5be"} Jul 13 14:51:41.230297 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.230261 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m"] Jul 13 14:51:41.235791 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.235769 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.239139 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.239107 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 14:51:41.240976 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.240541 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 14:51:41.240976 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.240543 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 14:51:41.240976 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.240820 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:51:41.241157 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.241009 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 14:51:41.241244 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.241212 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gz7nt\"" Jul 13 14:51:41.247799 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.247775 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m"] Jul 13 14:51:41.333702 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.333671 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ef5fe11-1d11-4bed-a45d-260b3ca15bb0-metrics-cert\") pod \"lws-controller-manager-d4d649b46-fm85m\" (UID: \"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0\") " pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.333900 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.333730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fh99\" (UniqueName: \"kubernetes.io/projected/4ef5fe11-1d11-4bed-a45d-260b3ca15bb0-kube-api-access-2fh99\") pod \"lws-controller-manager-d4d649b46-fm85m\" (UID: \"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0\") " pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.333900 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.333811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ef5fe11-1d11-4bed-a45d-260b3ca15bb0-manager-config\") pod \"lws-controller-manager-d4d649b46-fm85m\" (UID: \"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0\") " pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.333900 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.333880 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ef5fe11-1d11-4bed-a45d-260b3ca15bb0-cert\") pod \"lws-controller-manager-d4d649b46-fm85m\" (UID: \"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0\") " pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.434827 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.434793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ef5fe11-1d11-4bed-a45d-260b3ca15bb0-cert\") pod \"lws-controller-manager-d4d649b46-fm85m\" (UID: \"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0\") " pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.435006 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.434868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ef5fe11-1d11-4bed-a45d-260b3ca15bb0-metrics-cert\") pod \"lws-controller-manager-d4d649b46-fm85m\" (UID: \"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0\") " pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.435006 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.434913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fh99\" (UniqueName: \"kubernetes.io/projected/4ef5fe11-1d11-4bed-a45d-260b3ca15bb0-kube-api-access-2fh99\") pod \"lws-controller-manager-d4d649b46-fm85m\" (UID: \"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0\") " pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.435006 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.434953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ef5fe11-1d11-4bed-a45d-260b3ca15bb0-manager-config\") pod \"lws-controller-manager-d4d649b46-fm85m\" (UID: \"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0\") " pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.435845 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.435800 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ef5fe11-1d11-4bed-a45d-260b3ca15bb0-manager-config\") pod \"lws-controller-manager-d4d649b46-fm85m\" (UID: \"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0\") " pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.437634 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.437601 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ef5fe11-1d11-4bed-a45d-260b3ca15bb0-cert\") pod \"lws-controller-manager-d4d649b46-fm85m\" (UID: \"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0\") " pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.437839 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.437821 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ef5fe11-1d11-4bed-a45d-260b3ca15bb0-metrics-cert\") pod \"lws-controller-manager-d4d649b46-fm85m\" (UID: \"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0\") " pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.446796 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.446774 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fh99\" (UniqueName: \"kubernetes.io/projected/4ef5fe11-1d11-4bed-a45d-260b3ca15bb0-kube-api-access-2fh99\") pod \"lws-controller-manager-d4d649b46-fm85m\" (UID: \"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0\") " pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.549456 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.549370 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:41.707309 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.707246 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m"] Jul 13 14:51:41.709980 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:51:41.709952 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef5fe11_1d11_4bed_a45d_260b3ca15bb0.slice/crio-f129ff8ac5c955daa7d231e24ce3d0943a4664d32b27eac6d1b52cd95c7284d7 WatchSource:0}: Error finding container f129ff8ac5c955daa7d231e24ce3d0943a4664d32b27eac6d1b52cd95c7284d7: Status 404 returned error can't find the container with id f129ff8ac5c955daa7d231e24ce3d0943a4664d32b27eac6d1b52cd95c7284d7 Jul 13 14:51:41.767418 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:41.767383 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" event={"ID":"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0","Type":"ContainerStarted","Data":"f129ff8ac5c955daa7d231e24ce3d0943a4664d32b27eac6d1b52cd95c7284d7"} Jul 13 14:51:42.738142 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:42.738096 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 14:51:42.738511 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:42.738185 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 14:51:43.780166 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:43.780131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" event={"ID":"7022f291-a695-427a-b621-13f23623d858","Type":"ContainerStarted","Data":"74eeebf5f94870c75f31d612e44491a45c21e0f451b6e218a5bc504a2ea2a075"} Jul 13 14:51:43.780640 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:43.780329 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:43.782074 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:43.782043 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" Jul 13 14:51:43.808891 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:43.808828 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-64s22" podStartSLOduration=2.304210985 podStartE2EDuration="4.808806282s" totalImagesPullingTime="2.504595297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:51:43.80629147 +0000 UTC m=+354.090140689" watchObservedRunningTime="2026-07-13 14:51:43.808806282 +0000 UTC m=+354.092655503" Jul 13 14:51:44.785788 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:44.785747 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" event={"ID":"4ef5fe11-1d11-4bed-a45d-260b3ca15bb0","Type":"ContainerStarted","Data":"edcaa83389c1b96eda823cb0afd8c0245ea6e3aa7c71ce81ec1b51338b16537c"} Jul 13 14:51:44.786219 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:44.786011 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:51:44.824452 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:44.824398 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" podStartSLOduration=0.945617591 podStartE2EDuration="3.824378836s" totalImagesPullingTime="2.878761245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:51:44.82213378 +0000 UTC m=+355.105982997" watchObservedRunningTime="2026-07-13 14:51:44.824378836 +0000 UTC m=+355.108228053" Jul 13 14:51:55.792808 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:51:55.792777 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d4d649b46-fm85m" Jul 13 14:53:35.687162 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:35.687130 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j"] Jul 13 14:53:35.690518 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:35.690501 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j" Jul 13 14:53:35.694607 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:35.694579 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 14:53:35.695867 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:35.695845 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5mq4g\"" Jul 13 14:53:35.695960 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:35.695851 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 14:53:35.703475 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:35.703450 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j"] Jul 13 14:53:35.791742 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:35.791704 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zn4z\" (UniqueName: \"kubernetes.io/projected/36b9d459-50da-4cda-a914-d28075cb6089-kube-api-access-5zn4z\") pod \"limitador-operator-controller-manager-859d7b78bd-h4q7j\" (UID: \"36b9d459-50da-4cda-a914-d28075cb6089\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j" Jul 13 14:53:35.892813 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:35.892781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zn4z\" (UniqueName: \"kubernetes.io/projected/36b9d459-50da-4cda-a914-d28075cb6089-kube-api-access-5zn4z\") pod \"limitador-operator-controller-manager-859d7b78bd-h4q7j\" (UID: \"36b9d459-50da-4cda-a914-d28075cb6089\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j" Jul 13 14:53:35.903574 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:35.903546 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zn4z\" (UniqueName: \"kubernetes.io/projected/36b9d459-50da-4cda-a914-d28075cb6089-kube-api-access-5zn4z\") pod \"limitador-operator-controller-manager-859d7b78bd-h4q7j\" (UID: \"36b9d459-50da-4cda-a914-d28075cb6089\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j" Jul 13 14:53:36.002220 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:36.002115 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j" Jul 13 14:53:36.131913 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:36.131888 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j"] Jul 13 14:53:36.134036 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:53:36.134005 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b9d459_50da_4cda_a914_d28075cb6089.slice/crio-3ddc2f147ba0db887402cddc2b154aeb483e90835b59f85a5cf35fc1fcebde9d WatchSource:0}: Error finding container 3ddc2f147ba0db887402cddc2b154aeb483e90835b59f85a5cf35fc1fcebde9d: Status 404 returned error can't find the container with id 3ddc2f147ba0db887402cddc2b154aeb483e90835b59f85a5cf35fc1fcebde9d Jul 13 14:53:36.264636 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:36.264554 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j" event={"ID":"36b9d459-50da-4cda-a914-d28075cb6089","Type":"ContainerStarted","Data":"3ddc2f147ba0db887402cddc2b154aeb483e90835b59f85a5cf35fc1fcebde9d"} Jul 13 14:53:39.279767 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:39.279724 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j" event={"ID":"36b9d459-50da-4cda-a914-d28075cb6089","Type":"ContainerStarted","Data":"459701c55b9827c07d1f864bdb59e4db9939bc77d63c52b56a9ddfbc1f7f2934"} Jul 13 14:53:39.280133 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:39.279869 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j" Jul 13 14:53:39.299639 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:39.299589 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j" podStartSLOduration=1.630092417 podStartE2EDuration="4.299575068s" totalImagesPullingTime="2.669482651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:39.297370796 +0000 UTC m=+469.581220004" watchObservedRunningTime="2026-07-13 14:53:39.299575068 +0000 UTC m=+469.583424285" Jul 13 14:53:50.286155 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:53:50.286125 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h4q7j" Jul 13 14:54:49.076539 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.076442 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-dsqzf"] Jul 13 14:54:49.079855 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.079832 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-dsqzf" Jul 13 14:54:49.082477 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.082452 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bcwkk\"" Jul 13 14:54:49.082613 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.082595 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 13 14:54:49.087066 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.087040 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-dsqzf"] Jul 13 14:54:49.210906 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.210863 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hshfd\" (UniqueName: \"kubernetes.io/projected/bdd6c496-7cf9-4596-a262-1ad1e610c87e-kube-api-access-hshfd\") pod \"postgres-69fb4594cf-dsqzf\" (UID: \"bdd6c496-7cf9-4596-a262-1ad1e610c87e\") " pod="opendatahub/postgres-69fb4594cf-dsqzf" Jul 13 14:54:49.211079 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.210962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bdd6c496-7cf9-4596-a262-1ad1e610c87e-data\") pod \"postgres-69fb4594cf-dsqzf\" (UID: \"bdd6c496-7cf9-4596-a262-1ad1e610c87e\") " pod="opendatahub/postgres-69fb4594cf-dsqzf" Jul 13 14:54:49.312416 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.312379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bdd6c496-7cf9-4596-a262-1ad1e610c87e-data\") pod \"postgres-69fb4594cf-dsqzf\" (UID: \"bdd6c496-7cf9-4596-a262-1ad1e610c87e\") " pod="opendatahub/postgres-69fb4594cf-dsqzf" Jul 13 14:54:49.312606 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.312468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hshfd\" (UniqueName: \"kubernetes.io/projected/bdd6c496-7cf9-4596-a262-1ad1e610c87e-kube-api-access-hshfd\") pod \"postgres-69fb4594cf-dsqzf\" (UID: \"bdd6c496-7cf9-4596-a262-1ad1e610c87e\") " pod="opendatahub/postgres-69fb4594cf-dsqzf" Jul 13 14:54:49.312887 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.312862 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bdd6c496-7cf9-4596-a262-1ad1e610c87e-data\") pod \"postgres-69fb4594cf-dsqzf\" (UID: \"bdd6c496-7cf9-4596-a262-1ad1e610c87e\") " pod="opendatahub/postgres-69fb4594cf-dsqzf" Jul 13 14:54:49.321759 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.321737 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hshfd\" (UniqueName: \"kubernetes.io/projected/bdd6c496-7cf9-4596-a262-1ad1e610c87e-kube-api-access-hshfd\") pod \"postgres-69fb4594cf-dsqzf\" (UID: \"bdd6c496-7cf9-4596-a262-1ad1e610c87e\") " pod="opendatahub/postgres-69fb4594cf-dsqzf" Jul 13 14:54:49.393281 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.393249 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-dsqzf" Jul 13 14:54:49.522103 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.522066 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-dsqzf"] Jul 13 14:54:49.524373 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:54:49.524329 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd6c496_7cf9_4596_a262_1ad1e610c87e.slice/crio-3b8cc3cac2ad6d18d23271cbec6016f2ed5cbbd8aa579f96e5fcf845587876d4 WatchSource:0}: Error finding container 3b8cc3cac2ad6d18d23271cbec6016f2ed5cbbd8aa579f96e5fcf845587876d4: Status 404 returned error can't find the container with id 3b8cc3cac2ad6d18d23271cbec6016f2ed5cbbd8aa579f96e5fcf845587876d4 Jul 13 14:54:49.582971 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:49.582931 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-dsqzf" event={"ID":"bdd6c496-7cf9-4596-a262-1ad1e610c87e","Type":"ContainerStarted","Data":"3b8cc3cac2ad6d18d23271cbec6016f2ed5cbbd8aa579f96e5fcf845587876d4"} Jul 13 14:54:54.427524 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:54.427501 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 13 14:54:54.610224 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:54.610192 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-dsqzf" event={"ID":"bdd6c496-7cf9-4596-a262-1ad1e610c87e","Type":"ContainerStarted","Data":"7736c50a630a29c5a1be0e7ea2997275f69fada8933c86dc9429ddb6118f4017"} Jul 13 14:54:54.610405 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:54.610275 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-dsqzf" Jul 13 14:54:54.629021 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:54:54.628971 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-dsqzf" podStartSLOduration=0.730206062 podStartE2EDuration="5.628956896s" totalImagesPullingTime="4.898750834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:54:54.628372538 +0000 UTC m=+544.912221752" watchObservedRunningTime="2026-07-13 14:54:54.628956896 +0000 UTC m=+544.912806112" Jul 13 14:55:00.647282 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:00.647250 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-dsqzf" Jul 13 14:55:10.993502 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:10.993462 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c9774f97c-f65vp"] Jul 13 14:55:11.013714 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.013675 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c9774f97c-f65vp"] Jul 13 14:55:11.013861 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.013830 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c9774f97c-f65vp" Jul 13 14:55:11.018378 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.018351 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nc5d4\"" Jul 13 14:55:11.019026 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.019001 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 13 14:55:11.019543 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.019528 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 13 14:55:11.170559 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.170518 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d9474b7d6-256jc"] Jul 13 14:55:11.173450 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.173425 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d9474b7d6-256jc" Jul 13 14:55:11.194592 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.194562 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d9474b7d6-256jc"] Jul 13 14:55:11.207163 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.207132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb204f8b-24f4-406b-9be3-82b73335dde7-webhook-cert\") pod \"maas-controller-c9774f97c-f65vp\" (UID: \"fb204f8b-24f4-406b-9be3-82b73335dde7\") " pod="opendatahub/maas-controller-c9774f97c-f65vp" Jul 13 14:55:11.207367 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.207254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh8kx\" (UniqueName: \"kubernetes.io/projected/fb204f8b-24f4-406b-9be3-82b73335dde7-kube-api-access-dh8kx\") pod \"maas-controller-c9774f97c-f65vp\" (UID: \"fb204f8b-24f4-406b-9be3-82b73335dde7\") " pod="opendatahub/maas-controller-c9774f97c-f65vp" Jul 13 14:55:11.308501 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.308407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8878z\" (UniqueName: \"kubernetes.io/projected/329ab989-9828-4265-933d-d4abbf74c132-kube-api-access-8878z\") pod \"maas-controller-5d9474b7d6-256jc\" (UID: \"329ab989-9828-4265-933d-d4abbf74c132\") " pod="opendatahub/maas-controller-5d9474b7d6-256jc" Jul 13 14:55:11.308501 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.308474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/329ab989-9828-4265-933d-d4abbf74c132-webhook-cert\") pod \"maas-controller-5d9474b7d6-256jc\" (UID: \"329ab989-9828-4265-933d-d4abbf74c132\") " pod="opendatahub/maas-controller-5d9474b7d6-256jc" Jul 13 14:55:11.308686 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.308507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh8kx\" (UniqueName: \"kubernetes.io/projected/fb204f8b-24f4-406b-9be3-82b73335dde7-kube-api-access-dh8kx\") pod \"maas-controller-c9774f97c-f65vp\" (UID: \"fb204f8b-24f4-406b-9be3-82b73335dde7\") " pod="opendatahub/maas-controller-c9774f97c-f65vp" Jul 13 14:55:11.308686 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.308562 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb204f8b-24f4-406b-9be3-82b73335dde7-webhook-cert\") pod \"maas-controller-c9774f97c-f65vp\" (UID: \"fb204f8b-24f4-406b-9be3-82b73335dde7\") " pod="opendatahub/maas-controller-c9774f97c-f65vp" Jul 13 14:55:11.310957 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.310921 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb204f8b-24f4-406b-9be3-82b73335dde7-webhook-cert\") pod \"maas-controller-c9774f97c-f65vp\" (UID: \"fb204f8b-24f4-406b-9be3-82b73335dde7\") " pod="opendatahub/maas-controller-c9774f97c-f65vp" Jul 13 14:55:11.318078 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.318055 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh8kx\" (UniqueName: \"kubernetes.io/projected/fb204f8b-24f4-406b-9be3-82b73335dde7-kube-api-access-dh8kx\") pod \"maas-controller-c9774f97c-f65vp\" (UID: \"fb204f8b-24f4-406b-9be3-82b73335dde7\") " pod="opendatahub/maas-controller-c9774f97c-f65vp" Jul 13 14:55:11.327891 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.327870 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c9774f97c-f65vp" Jul 13 14:55:11.410083 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.410015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8878z\" (UniqueName: \"kubernetes.io/projected/329ab989-9828-4265-933d-d4abbf74c132-kube-api-access-8878z\") pod \"maas-controller-5d9474b7d6-256jc\" (UID: \"329ab989-9828-4265-933d-d4abbf74c132\") " pod="opendatahub/maas-controller-5d9474b7d6-256jc" Jul 13 14:55:11.410231 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.410144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/329ab989-9828-4265-933d-d4abbf74c132-webhook-cert\") pod \"maas-controller-5d9474b7d6-256jc\" (UID: \"329ab989-9828-4265-933d-d4abbf74c132\") " pod="opendatahub/maas-controller-5d9474b7d6-256jc" Jul 13 14:55:11.412924 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.412899 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/329ab989-9828-4265-933d-d4abbf74c132-webhook-cert\") pod \"maas-controller-5d9474b7d6-256jc\" (UID: \"329ab989-9828-4265-933d-d4abbf74c132\") " pod="opendatahub/maas-controller-5d9474b7d6-256jc" Jul 13 14:55:11.420316 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.420283 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8878z\" (UniqueName: \"kubernetes.io/projected/329ab989-9828-4265-933d-d4abbf74c132-kube-api-access-8878z\") pod \"maas-controller-5d9474b7d6-256jc\" (UID: \"329ab989-9828-4265-933d-d4abbf74c132\") " pod="opendatahub/maas-controller-5d9474b7d6-256jc" Jul 13 14:55:11.458288 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.458257 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c9774f97c-f65vp"] Jul 13 14:55:11.460912 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:55:11.460884 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb204f8b_24f4_406b_9be3_82b73335dde7.slice/crio-7596b1e9e10a95df9a1574c6353a27b948db05cdd7d1870d287d20e1b109d50d WatchSource:0}: Error finding container 7596b1e9e10a95df9a1574c6353a27b948db05cdd7d1870d287d20e1b109d50d: Status 404 returned error can't find the container with id 7596b1e9e10a95df9a1574c6353a27b948db05cdd7d1870d287d20e1b109d50d Jul 13 14:55:11.483261 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.483233 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d9474b7d6-256jc" Jul 13 14:55:11.615871 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.615843 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d9474b7d6-256jc"] Jul 13 14:55:11.617749 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:55:11.617726 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329ab989_9828_4265_933d_d4abbf74c132.slice/crio-08a3dcf20126cd99716fffa5b8b28f3e3236cdadc09cdcb470c42902319a14c3 WatchSource:0}: Error finding container 08a3dcf20126cd99716fffa5b8b28f3e3236cdadc09cdcb470c42902319a14c3: Status 404 returned error can't find the container with id 08a3dcf20126cd99716fffa5b8b28f3e3236cdadc09cdcb470c42902319a14c3 Jul 13 14:55:11.694481 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.694444 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d9474b7d6-256jc" event={"ID":"329ab989-9828-4265-933d-d4abbf74c132","Type":"ContainerStarted","Data":"08a3dcf20126cd99716fffa5b8b28f3e3236cdadc09cdcb470c42902319a14c3"} Jul 13 14:55:11.695612 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:11.695584 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c9774f97c-f65vp" event={"ID":"fb204f8b-24f4-406b-9be3-82b73335dde7","Type":"ContainerStarted","Data":"7596b1e9e10a95df9a1574c6353a27b948db05cdd7d1870d287d20e1b109d50d"} Jul 13 14:55:14.715458 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:14.715423 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c9774f97c-f65vp" event={"ID":"fb204f8b-24f4-406b-9be3-82b73335dde7","Type":"ContainerStarted","Data":"64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e"} Jul 13 14:55:14.715928 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:14.715512 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c9774f97c-f65vp" Jul 13 14:55:14.716996 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:14.716969 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d9474b7d6-256jc" event={"ID":"329ab989-9828-4265-933d-d4abbf74c132","Type":"ContainerStarted","Data":"63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34"} Jul 13 14:55:14.717096 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:14.717026 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d9474b7d6-256jc" Jul 13 14:55:14.733512 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:14.733455 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c9774f97c-f65vp" podStartSLOduration=2.513513631 podStartE2EDuration="4.733437807s" totalImagesPullingTime="2.219924176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:55:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:55:14.731719608 +0000 UTC m=+565.015568823" watchObservedRunningTime="2026-07-13 14:55:14.733437807 +0000 UTC m=+565.017287025" Jul 13 14:55:14.750585 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:14.750527 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d9474b7d6-256jc" podStartSLOduration=1.677047805 podStartE2EDuration="3.750507349s" totalImagesPullingTime="2.073459544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:55:14.749507001 +0000 UTC m=+565.033356219" watchObservedRunningTime="2026-07-13 14:55:14.750507349 +0000 UTC m=+565.034356566" Jul 13 14:55:25.727248 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:25.727213 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d9474b7d6-256jc" Jul 13 14:55:25.727704 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:25.727309 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c9774f97c-f65vp" Jul 13 14:55:25.797964 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:25.797934 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c9774f97c-f65vp"] Jul 13 14:55:25.798164 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:25.798138 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c9774f97c-f65vp" podUID="fb204f8b-24f4-406b-9be3-82b73335dde7" containerName="manager" containerID="cri-o://64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e" gracePeriod=30 Jul 13 14:55:26.040522 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.040497 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c9774f97c-f65vp" Jul 13 14:55:26.124177 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.124136 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb204f8b-24f4-406b-9be3-82b73335dde7-webhook-cert\") pod \"fb204f8b-24f4-406b-9be3-82b73335dde7\" (UID: \"fb204f8b-24f4-406b-9be3-82b73335dde7\") " Jul 13 14:55:26.124375 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.124196 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh8kx\" (UniqueName: \"kubernetes.io/projected/fb204f8b-24f4-406b-9be3-82b73335dde7-kube-api-access-dh8kx\") pod \"fb204f8b-24f4-406b-9be3-82b73335dde7\" (UID: \"fb204f8b-24f4-406b-9be3-82b73335dde7\") " Jul 13 14:55:26.126432 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.126401 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb204f8b-24f4-406b-9be3-82b73335dde7-kube-api-access-dh8kx" (OuterVolumeSpecName: "kube-api-access-dh8kx") pod "fb204f8b-24f4-406b-9be3-82b73335dde7" (UID: "fb204f8b-24f4-406b-9be3-82b73335dde7"). InnerVolumeSpecName "kube-api-access-dh8kx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:55:26.126545 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.126403 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb204f8b-24f4-406b-9be3-82b73335dde7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fb204f8b-24f4-406b-9be3-82b73335dde7" (UID: "fb204f8b-24f4-406b-9be3-82b73335dde7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:55:26.224944 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.224915 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb204f8b-24f4-406b-9be3-82b73335dde7-webhook-cert\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:55:26.224944 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.224941 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh8kx\" (UniqueName: \"kubernetes.io/projected/fb204f8b-24f4-406b-9be3-82b73335dde7-kube-api-access-dh8kx\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:55:26.769609 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.769576 2579 generic.go:356] "Generic (PLEG): container finished" podID="fb204f8b-24f4-406b-9be3-82b73335dde7" containerID="64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e" exitCode=0 Jul 13 14:55:26.770014 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.769619 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c9774f97c-f65vp" event={"ID":"fb204f8b-24f4-406b-9be3-82b73335dde7","Type":"ContainerDied","Data":"64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e"} Jul 13 14:55:26.770014 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.769632 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c9774f97c-f65vp" Jul 13 14:55:26.770014 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.769693 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c9774f97c-f65vp" event={"ID":"fb204f8b-24f4-406b-9be3-82b73335dde7","Type":"ContainerDied","Data":"7596b1e9e10a95df9a1574c6353a27b948db05cdd7d1870d287d20e1b109d50d"} Jul 13 14:55:26.770014 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.769715 2579 scope.go:117] "RemoveContainer" containerID="64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e" Jul 13 14:55:26.777885 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.777868 2579 scope.go:117] "RemoveContainer" containerID="64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e" Jul 13 14:55:26.778167 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:55:26.778141 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e\": container with ID starting with 64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e not found: ID does not exist" containerID="64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e" Jul 13 14:55:26.778242 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.778176 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e"} err="failed to get container status \"64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e\": rpc error: code = NotFound desc = could not find container \"64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e\": container with ID starting with 64fa59f8f0bd0e98449bc47bb976f577e118ceff50e9aab74b34f0bc940bc88e not found: ID does not exist" Jul 13 14:55:26.788373 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.788328 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c9774f97c-f65vp"] Jul 13 14:55:26.790926 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:26.790901 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c9774f97c-f65vp"] Jul 13 14:55:28.206831 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:28.206798 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb204f8b-24f4-406b-9be3-82b73335dde7" path="/var/lib/kubelet/pods/fb204f8b-24f4-406b-9be3-82b73335dde7/volumes" Jul 13 14:55:45.989576 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:45.989506 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-55f6645595-f6c74"] Jul 13 14:55:45.990160 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:45.989995 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb204f8b-24f4-406b-9be3-82b73335dde7" containerName="manager" Jul 13 14:55:45.990160 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:45.990015 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb204f8b-24f4-406b-9be3-82b73335dde7" containerName="manager" Jul 13 14:55:45.990160 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:45.990133 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb204f8b-24f4-406b-9be3-82b73335dde7" containerName="manager" Jul 13 14:55:45.993161 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:45.993140 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:45.996164 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:45.996145 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 13 14:55:45.996164 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:45.996155 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9vf7z\"" Jul 13 14:55:46.004678 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:46.004652 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-55f6645595-f6c74"] Jul 13 14:55:46.099028 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:46.098994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1f770c4-a7ae-4be7-a128-1ef10ca4a241-openshift-service-ca\") pod \"maas-api-55f6645595-f6c74\" (UID: \"c1f770c4-a7ae-4be7-a128-1ef10ca4a241\") " pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:46.099206 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:46.099066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1f770c4-a7ae-4be7-a128-1ef10ca4a241-maas-api-tls\") pod \"maas-api-55f6645595-f6c74\" (UID: \"c1f770c4-a7ae-4be7-a128-1ef10ca4a241\") " pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:46.099206 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:46.099152 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjhxg\" (UniqueName: \"kubernetes.io/projected/c1f770c4-a7ae-4be7-a128-1ef10ca4a241-kube-api-access-rjhxg\") pod \"maas-api-55f6645595-f6c74\" (UID: \"c1f770c4-a7ae-4be7-a128-1ef10ca4a241\") " pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:46.200134 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:46.200101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1f770c4-a7ae-4be7-a128-1ef10ca4a241-maas-api-tls\") pod \"maas-api-55f6645595-f6c74\" (UID: \"c1f770c4-a7ae-4be7-a128-1ef10ca4a241\") " pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:46.200314 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:46.200162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjhxg\" (UniqueName: \"kubernetes.io/projected/c1f770c4-a7ae-4be7-a128-1ef10ca4a241-kube-api-access-rjhxg\") pod \"maas-api-55f6645595-f6c74\" (UID: \"c1f770c4-a7ae-4be7-a128-1ef10ca4a241\") " pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:46.200314 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:46.200198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1f770c4-a7ae-4be7-a128-1ef10ca4a241-openshift-service-ca\") pod \"maas-api-55f6645595-f6c74\" (UID: \"c1f770c4-a7ae-4be7-a128-1ef10ca4a241\") " pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:46.200314 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:55:46.200265 2579 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 13 14:55:46.200456 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:55:46.200368 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f770c4-a7ae-4be7-a128-1ef10ca4a241-maas-api-tls podName:c1f770c4-a7ae-4be7-a128-1ef10ca4a241 nodeName:}" failed. No retries permitted until 2026-07-13 14:55:46.700330896 +0000 UTC m=+596.984180107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c1f770c4-a7ae-4be7-a128-1ef10ca4a241-maas-api-tls") pod "maas-api-55f6645595-f6c74" (UID: "c1f770c4-a7ae-4be7-a128-1ef10ca4a241") : secret "maas-api-serving-cert" not found Jul 13 14:55:46.200866 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:46.200850 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1f770c4-a7ae-4be7-a128-1ef10ca4a241-openshift-service-ca\") pod \"maas-api-55f6645595-f6c74\" (UID: \"c1f770c4-a7ae-4be7-a128-1ef10ca4a241\") " pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:46.213595 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:46.213563 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjhxg\" (UniqueName: \"kubernetes.io/projected/c1f770c4-a7ae-4be7-a128-1ef10ca4a241-kube-api-access-rjhxg\") pod \"maas-api-55f6645595-f6c74\" (UID: \"c1f770c4-a7ae-4be7-a128-1ef10ca4a241\") " pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:46.704556 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:46.704519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1f770c4-a7ae-4be7-a128-1ef10ca4a241-maas-api-tls\") pod \"maas-api-55f6645595-f6c74\" (UID: \"c1f770c4-a7ae-4be7-a128-1ef10ca4a241\") " pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:46.706911 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:46.706888 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1f770c4-a7ae-4be7-a128-1ef10ca4a241-maas-api-tls\") pod \"maas-api-55f6645595-f6c74\" (UID: \"c1f770c4-a7ae-4be7-a128-1ef10ca4a241\") " pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:46.903684 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:46.903643 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:47.041745 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:47.041720 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-55f6645595-f6c74"] Jul 13 14:55:47.043964 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:55:47.043931 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f770c4_a7ae_4be7_a128_1ef10ca4a241.slice/crio-7bc7c2177d8ee32d4733aee275cabc83fdce4eb521ea9a0fda224ea76f39a899 WatchSource:0}: Error finding container 7bc7c2177d8ee32d4733aee275cabc83fdce4eb521ea9a0fda224ea76f39a899: Status 404 returned error can't find the container with id 7bc7c2177d8ee32d4733aee275cabc83fdce4eb521ea9a0fda224ea76f39a899 Jul 13 14:55:47.865199 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:47.865163 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-55f6645595-f6c74" event={"ID":"c1f770c4-a7ae-4be7-a128-1ef10ca4a241","Type":"ContainerStarted","Data":"7bc7c2177d8ee32d4733aee275cabc83fdce4eb521ea9a0fda224ea76f39a899"} Jul 13 14:55:49.874986 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:49.874939 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-55f6645595-f6c74" event={"ID":"c1f770c4-a7ae-4be7-a128-1ef10ca4a241","Type":"ContainerStarted","Data":"ee2017cee621cfa8ef8d74dc871d50760fe667d598bd6248799a06993750c22b"} Jul 13 14:55:49.875405 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:49.875044 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:55:49.893960 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:49.893908 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-55f6645595-f6c74" podStartSLOduration=2.632922634 podStartE2EDuration="4.893892418s" totalImagesPullingTime="2.260969784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:55:49.893509935 +0000 UTC m=+600.177359153" watchObservedRunningTime="2026-07-13 14:55:49.893892418 +0000 UTC m=+600.177741634" Jul 13 14:55:50.178558 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:50.178455 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 14:55:50.179975 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:50.179950 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 14:55:55.885164 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:55:55.885136 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-55f6645595-f6c74" Jul 13 14:56:32.594330 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.594295 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd"] Jul 13 14:56:32.598589 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.598567 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.603494 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.603473 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8467h\"" Jul 13 14:56:32.603625 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.603523 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 14:56:32.603807 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.603790 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 14:56:32.603807 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.603795 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 13 14:56:32.609664 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.609643 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd"] Jul 13 14:56:32.682577 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.682544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4cae382-e512-44ca-be40-0bc51b22a58a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.682764 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.682591 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4cae382-e512-44ca-be40-0bc51b22a58a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.682764 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.682686 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4cae382-e512-44ca-be40-0bc51b22a58a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.682854 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.682777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cae382-e512-44ca-be40-0bc51b22a58a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.682854 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.682848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4cae382-e512-44ca-be40-0bc51b22a58a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.682928 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.682874 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww4st\" (UniqueName: \"kubernetes.io/projected/f4cae382-e512-44ca-be40-0bc51b22a58a-kube-api-access-ww4st\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.783466 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.783428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cae382-e512-44ca-be40-0bc51b22a58a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.783660 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.783489 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4cae382-e512-44ca-be40-0bc51b22a58a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.783660 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.783510 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww4st\" (UniqueName: \"kubernetes.io/projected/f4cae382-e512-44ca-be40-0bc51b22a58a-kube-api-access-ww4st\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.783660 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.783546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4cae382-e512-44ca-be40-0bc51b22a58a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.783660 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.783567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4cae382-e512-44ca-be40-0bc51b22a58a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.783660 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.783595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4cae382-e512-44ca-be40-0bc51b22a58a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.783947 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.783919 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4cae382-e512-44ca-be40-0bc51b22a58a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.783947 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.783935 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4cae382-e512-44ca-be40-0bc51b22a58a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.784021 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.783986 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4cae382-e512-44ca-be40-0bc51b22a58a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.785788 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.785770 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4cae382-e512-44ca-be40-0bc51b22a58a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.786054 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.786039 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4cae382-e512-44ca-be40-0bc51b22a58a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.795626 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.795599 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww4st\" (UniqueName: \"kubernetes.io/projected/f4cae382-e512-44ca-be40-0bc51b22a58a-kube-api-access-ww4st\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-klcgd\" (UID: \"f4cae382-e512-44ca-be40-0bc51b22a58a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:32.912985 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:32.912943 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:33.053223 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:33.053193 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd"] Jul 13 14:56:33.055423 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:56:33.055398 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4cae382_e512_44ca_be40_0bc51b22a58a.slice/crio-31c7d20d10b6725e498039c1819b3b0051e48f92e8481e8bb1c8a37e64cfccda WatchSource:0}: Error finding container 31c7d20d10b6725e498039c1819b3b0051e48f92e8481e8bb1c8a37e64cfccda: Status 404 returned error can't find the container with id 31c7d20d10b6725e498039c1819b3b0051e48f92e8481e8bb1c8a37e64cfccda Jul 13 14:56:33.056778 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:33.056760 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 14:56:33.067235 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:33.067208 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" event={"ID":"f4cae382-e512-44ca-be40-0bc51b22a58a","Type":"ContainerStarted","Data":"31c7d20d10b6725e498039c1819b3b0051e48f92e8481e8bb1c8a37e64cfccda"} Jul 13 14:56:35.076954 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:35.076917 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" event={"ID":"f4cae382-e512-44ca-be40-0bc51b22a58a","Type":"ContainerStarted","Data":"af27e91d2b175023d1f69ac268eaeabf1d9f373fc02b2b89471115b256f720f6"} Jul 13 14:56:35.100310 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:35.100260 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" podStartSLOduration=2.050772884 podStartE2EDuration="3.10024476s" totalImagesPullingTime="1.049471876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:56:35.098123091 +0000 UTC m=+645.381972309" watchObservedRunningTime="2026-07-13 14:56:35.10024476 +0000 UTC m=+645.384093977" Jul 13 14:56:42.913693 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:42.913651 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:42.914183 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:42.913724 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:42.926271 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:42.926243 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:56:43.122863 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:56:43.122832 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-klcgd" Jul 13 14:59:01.967235 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:01.967201 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d9474b7d6-256jc"] Jul 13 14:59:01.967808 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:01.967480 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5d9474b7d6-256jc" podUID="329ab989-9828-4265-933d-d4abbf74c132" containerName="manager" containerID="cri-o://63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34" gracePeriod=30 Jul 13 14:59:02.215804 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.215776 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d9474b7d6-256jc" Jul 13 14:59:02.328879 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.328785 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8878z\" (UniqueName: \"kubernetes.io/projected/329ab989-9828-4265-933d-d4abbf74c132-kube-api-access-8878z\") pod \"329ab989-9828-4265-933d-d4abbf74c132\" (UID: \"329ab989-9828-4265-933d-d4abbf74c132\") " Jul 13 14:59:02.328879 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.328848 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/329ab989-9828-4265-933d-d4abbf74c132-webhook-cert\") pod \"329ab989-9828-4265-933d-d4abbf74c132\" (UID: \"329ab989-9828-4265-933d-d4abbf74c132\") " Jul 13 14:59:02.330986 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.330956 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/329ab989-9828-4265-933d-d4abbf74c132-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "329ab989-9828-4265-933d-d4abbf74c132" (UID: "329ab989-9828-4265-933d-d4abbf74c132"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:59:02.330986 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.330969 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/329ab989-9828-4265-933d-d4abbf74c132-kube-api-access-8878z" (OuterVolumeSpecName: "kube-api-access-8878z") pod "329ab989-9828-4265-933d-d4abbf74c132" (UID: "329ab989-9828-4265-933d-d4abbf74c132"). InnerVolumeSpecName "kube-api-access-8878z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:59:02.429625 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.429583 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/329ab989-9828-4265-933d-d4abbf74c132-webhook-cert\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:59:02.429625 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.429618 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8878z\" (UniqueName: \"kubernetes.io/projected/329ab989-9828-4265-933d-d4abbf74c132-kube-api-access-8878z\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 14:59:02.751222 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.751188 2579 generic.go:356] "Generic (PLEG): container finished" podID="329ab989-9828-4265-933d-d4abbf74c132" containerID="63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34" exitCode=0 Jul 13 14:59:02.751409 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.751230 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d9474b7d6-256jc" Jul 13 14:59:02.751409 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.751235 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d9474b7d6-256jc" event={"ID":"329ab989-9828-4265-933d-d4abbf74c132","Type":"ContainerDied","Data":"63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34"} Jul 13 14:59:02.751409 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.751279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d9474b7d6-256jc" event={"ID":"329ab989-9828-4265-933d-d4abbf74c132","Type":"ContainerDied","Data":"08a3dcf20126cd99716fffa5b8b28f3e3236cdadc09cdcb470c42902319a14c3"} Jul 13 14:59:02.751409 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.751300 2579 scope.go:117] "RemoveContainer" containerID="63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34" Jul 13 14:59:02.760225 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.760206 2579 scope.go:117] "RemoveContainer" containerID="63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34" Jul 13 14:59:02.760519 ip-10-0-133-95 kubenswrapper[2579]: E0713 14:59:02.760501 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34\": container with ID starting with 63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34 not found: ID does not exist" containerID="63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34" Jul 13 14:59:02.760567 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.760530 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34"} err="failed to get container status \"63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34\": rpc error: code = NotFound desc = could not find container \"63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34\": container with ID starting with 63ef5c92cdffb9d7d7c01cfc6e2dc0367dd7b536d08c6850fad07cc72f591c34 not found: ID does not exist" Jul 13 14:59:02.774066 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.774040 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d9474b7d6-256jc"] Jul 13 14:59:02.778126 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:02.778102 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d9474b7d6-256jc"] Jul 13 14:59:03.584155 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.584119 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d9474b7d6-vpwbb"] Jul 13 14:59:03.584559 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.584517 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="329ab989-9828-4265-933d-d4abbf74c132" containerName="manager" Jul 13 14:59:03.584559 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.584530 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="329ab989-9828-4265-933d-d4abbf74c132" containerName="manager" Jul 13 14:59:03.584627 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.584594 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="329ab989-9828-4265-933d-d4abbf74c132" containerName="manager" Jul 13 14:59:03.587730 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.587710 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" Jul 13 14:59:03.591716 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.591696 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 13 14:59:03.591873 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.591715 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 13 14:59:03.591873 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.591724 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nc5d4\"" Jul 13 14:59:03.598476 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.598451 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d9474b7d6-vpwbb"] Jul 13 14:59:03.640588 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.640547 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebf96e7a-c817-41f2-bea1-f7363fc190c8-webhook-cert\") pod \"maas-controller-5d9474b7d6-vpwbb\" (UID: \"ebf96e7a-c817-41f2-bea1-f7363fc190c8\") " pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" Jul 13 14:59:03.640824 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.640606 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb9mq\" (UniqueName: \"kubernetes.io/projected/ebf96e7a-c817-41f2-bea1-f7363fc190c8-kube-api-access-wb9mq\") pod \"maas-controller-5d9474b7d6-vpwbb\" (UID: \"ebf96e7a-c817-41f2-bea1-f7363fc190c8\") " pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" Jul 13 14:59:03.741086 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.741045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebf96e7a-c817-41f2-bea1-f7363fc190c8-webhook-cert\") pod \"maas-controller-5d9474b7d6-vpwbb\" (UID: \"ebf96e7a-c817-41f2-bea1-f7363fc190c8\") " pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" Jul 13 14:59:03.741255 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.741102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb9mq\" (UniqueName: \"kubernetes.io/projected/ebf96e7a-c817-41f2-bea1-f7363fc190c8-kube-api-access-wb9mq\") pod \"maas-controller-5d9474b7d6-vpwbb\" (UID: \"ebf96e7a-c817-41f2-bea1-f7363fc190c8\") " pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" Jul 13 14:59:03.743621 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.743597 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebf96e7a-c817-41f2-bea1-f7363fc190c8-webhook-cert\") pod \"maas-controller-5d9474b7d6-vpwbb\" (UID: \"ebf96e7a-c817-41f2-bea1-f7363fc190c8\") " pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" Jul 13 14:59:03.750238 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.750212 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb9mq\" (UniqueName: \"kubernetes.io/projected/ebf96e7a-c817-41f2-bea1-f7363fc190c8-kube-api-access-wb9mq\") pod \"maas-controller-5d9474b7d6-vpwbb\" (UID: \"ebf96e7a-c817-41f2-bea1-f7363fc190c8\") " pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" Jul 13 14:59:03.897902 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:03.897866 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" Jul 13 14:59:04.035451 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:04.035427 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d9474b7d6-vpwbb"] Jul 13 14:59:04.037663 ip-10-0-133-95 kubenswrapper[2579]: W0713 14:59:04.037637 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf96e7a_c817_41f2_bea1_f7363fc190c8.slice/crio-0fed3539ed3446da6b6bf1b8b85e7a2cb40306f3551ef9db03dcb5f22167b25e WatchSource:0}: Error finding container 0fed3539ed3446da6b6bf1b8b85e7a2cb40306f3551ef9db03dcb5f22167b25e: Status 404 returned error can't find the container with id 0fed3539ed3446da6b6bf1b8b85e7a2cb40306f3551ef9db03dcb5f22167b25e Jul 13 14:59:04.211257 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:04.211165 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="329ab989-9828-4265-933d-d4abbf74c132" path="/var/lib/kubelet/pods/329ab989-9828-4265-933d-d4abbf74c132/volumes" Jul 13 14:59:04.763436 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:04.763315 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" event={"ID":"ebf96e7a-c817-41f2-bea1-f7363fc190c8","Type":"ContainerStarted","Data":"da1506e0f50f6158edcae86d401b3fb4ed2366f234bbe85990dc341b4bd75f4d"} Jul 13 14:59:04.763436 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:04.763413 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" event={"ID":"ebf96e7a-c817-41f2-bea1-f7363fc190c8","Type":"ContainerStarted","Data":"0fed3539ed3446da6b6bf1b8b85e7a2cb40306f3551ef9db03dcb5f22167b25e"} Jul 13 14:59:04.763829 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:04.763462 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" Jul 13 14:59:04.783454 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:04.783407 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" podStartSLOduration=1.3170404150000001 podStartE2EDuration="1.783391122s" totalImagesPullingTime="466.350707ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:59:04.781947451 +0000 UTC m=+795.065796669" watchObservedRunningTime="2026-07-13 14:59:04.783391122 +0000 UTC m=+795.067240339" Jul 13 14:59:15.774904 ip-10-0-133-95 kubenswrapper[2579]: I0713 14:59:15.774822 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d9474b7d6-vpwbb" Jul 13 15:00:50.207402 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:00:50.207317 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 15:00:50.209418 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:00:50.209396 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 15:05:50.234597 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:05:50.234571 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 15:05:50.238017 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:05:50.237985 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 15:10:50.261237 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:10:50.261200 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 15:10:50.266450 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:10:50.266429 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 15:11:56.521629 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.521596 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt"] Jul 13 15:11:56.525084 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.525060 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:11:56.528253 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.528228 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-c4b04a32-serving-cert\"" Jul 13 15:11:56.536505 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.536478 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt"] Jul 13 15:11:56.599048 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.599007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-openshift-service-ca\") pod \"maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt\" (UID: \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\") " pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:11:56.599048 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.599050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-maas-api-tls\") pod \"maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt\" (UID: \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\") " pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:11:56.599263 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.599089 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ttvq\" (UniqueName: \"kubernetes.io/projected/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-kube-api-access-9ttvq\") pod \"maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt\" (UID: \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\") " pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:11:56.700448 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.700409 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-openshift-service-ca\") pod \"maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt\" (UID: \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\") " pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:11:56.700646 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.700456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-maas-api-tls\") pod \"maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt\" (UID: \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\") " pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:11:56.700646 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.700518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ttvq\" (UniqueName: \"kubernetes.io/projected/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-kube-api-access-9ttvq\") pod \"maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt\" (UID: \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\") " pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:11:56.701244 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.701218 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-openshift-service-ca\") pod \"maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt\" (UID: \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\") " pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:11:56.703583 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.703551 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-maas-api-tls\") pod \"maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt\" (UID: \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\") " pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:11:56.716544 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.716512 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ttvq\" (UniqueName: \"kubernetes.io/projected/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-kube-api-access-9ttvq\") pod \"maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt\" (UID: \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\") " pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:11:56.836268 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.836181 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:11:56.976032 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.976007 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt"] Jul 13 15:11:56.978560 ip-10-0-133-95 kubenswrapper[2579]: W0713 15:11:56.978526 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa2689d_e351_4ad9_9f3b_bae4ec8dc715.slice/crio-d7ba55358797f05d08ba8728b60d988b744def1c965f1b7e96fdbffe99caebaf WatchSource:0}: Error finding container d7ba55358797f05d08ba8728b60d988b744def1c965f1b7e96fdbffe99caebaf: Status 404 returned error can't find the container with id d7ba55358797f05d08ba8728b60d988b744def1c965f1b7e96fdbffe99caebaf Jul 13 15:11:56.979884 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:56.979863 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 15:11:57.200379 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:57.200329 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" event={"ID":"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715","Type":"ContainerStarted","Data":"d7ba55358797f05d08ba8728b60d988b744def1c965f1b7e96fdbffe99caebaf"} Jul 13 15:11:58.206912 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:58.206879 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:11:58.207276 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:58.206927 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" event={"ID":"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715","Type":"ContainerStarted","Data":"34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f"} Jul 13 15:11:58.231429 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:11:58.231377 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" podStartSLOduration=1.584507959 podStartE2EDuration="2.231360072s" totalImagesPullingTime="646.852113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:11:58.22849235 +0000 UTC m=+1568.512341569" watchObservedRunningTime="2026-07-13 15:11:58.231360072 +0000 UTC m=+1568.515209282" Jul 13 15:12:02.264708 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.264671 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt"] Jul 13 15:12:02.265287 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.264869 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" podUID="eaa2689d-e351-4ad9-9f3b-bae4ec8dc715" containerName="maas-api" containerID="cri-o://34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f" gracePeriod=30 Jul 13 15:12:02.271138 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.271113 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:12:02.517592 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.517526 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:12:02.654805 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.654764 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-maas-api-tls\") pod \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\" (UID: \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\") " Jul 13 15:12:02.654998 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.654813 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ttvq\" (UniqueName: \"kubernetes.io/projected/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-kube-api-access-9ttvq\") pod \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\" (UID: \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\") " Jul 13 15:12:02.654998 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.654859 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-openshift-service-ca\") pod \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\" (UID: \"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715\") " Jul 13 15:12:02.655300 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.655261 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eaa2689d-e351-4ad9-9f3b-bae4ec8dc715" (UID: "eaa2689d-e351-4ad9-9f3b-bae4ec8dc715"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:12:02.656968 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.656939 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-kube-api-access-9ttvq" (OuterVolumeSpecName: "kube-api-access-9ttvq") pod "eaa2689d-e351-4ad9-9f3b-bae4ec8dc715" (UID: "eaa2689d-e351-4ad9-9f3b-bae4ec8dc715"). InnerVolumeSpecName "kube-api-access-9ttvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:12:02.657059 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.656996 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eaa2689d-e351-4ad9-9f3b-bae4ec8dc715" (UID: "eaa2689d-e351-4ad9-9f3b-bae4ec8dc715"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:12:02.756292 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.756254 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-maas-api-tls\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:12:02.756292 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.756283 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ttvq\" (UniqueName: \"kubernetes.io/projected/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-kube-api-access-9ttvq\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:12:02.756292 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:02.756293 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715-openshift-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:12:03.237315 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:03.237282 2579 generic.go:356] "Generic (PLEG): container finished" podID="eaa2689d-e351-4ad9-9f3b-bae4ec8dc715" containerID="34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f" exitCode=0 Jul 13 15:12:03.237524 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:03.237324 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" Jul 13 15:12:03.237524 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:03.237373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" event={"ID":"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715","Type":"ContainerDied","Data":"34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f"} Jul 13 15:12:03.237524 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:03.237434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt" event={"ID":"eaa2689d-e351-4ad9-9f3b-bae4ec8dc715","Type":"ContainerDied","Data":"d7ba55358797f05d08ba8728b60d988b744def1c965f1b7e96fdbffe99caebaf"} Jul 13 15:12:03.237524 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:03.237463 2579 scope.go:117] "RemoveContainer" containerID="34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f" Jul 13 15:12:03.246474 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:03.246454 2579 scope.go:117] "RemoveContainer" containerID="34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f" Jul 13 15:12:03.246760 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:12:03.246742 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f\": container with ID starting with 34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f not found: ID does not exist" containerID="34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f" Jul 13 15:12:03.246811 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:03.246770 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f"} err="failed to get container status \"34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f\": rpc error: code = NotFound desc = could not find container \"34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f\": container with ID starting with 34d2daaf7ab14a468dca9b7b3bff51f05e235f7b2a85f36847659b5566385e2f not found: ID does not exist" Jul 13 15:12:03.263655 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:03.263627 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt"] Jul 13 15:12:03.269820 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:03.269799 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-c4b04a32-7947c56b75-zg6tt"] Jul 13 15:12:04.206664 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:04.206628 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaa2689d-e351-4ad9-9f3b-bae4ec8dc715" path="/var/lib/kubelet/pods/eaa2689d-e351-4ad9-9f3b-bae4ec8dc715/volumes" Jul 13 15:12:10.355688 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.355652 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n"] Jul 13 15:12:10.356215 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.356196 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaa2689d-e351-4ad9-9f3b-bae4ec8dc715" containerName="maas-api" Jul 13 15:12:10.356257 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.356220 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaa2689d-e351-4ad9-9f3b-bae4ec8dc715" containerName="maas-api" Jul 13 15:12:10.356378 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.356330 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaa2689d-e351-4ad9-9f3b-bae4ec8dc715" containerName="maas-api" Jul 13 15:12:10.360851 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.360830 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:10.366359 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.366320 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-a9109dfb-serving-cert\"" Jul 13 15:12:10.373294 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.373260 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n"] Jul 13 15:12:10.421414 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.421381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stlrf\" (UniqueName: \"kubernetes.io/projected/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-kube-api-access-stlrf\") pod \"maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n\" (UID: \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\") " pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:10.421584 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.421456 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-openshift-service-ca\") pod \"maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n\" (UID: \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\") " pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:10.421584 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.421535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-maas-api-tls\") pod \"maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n\" (UID: \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\") " pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:10.522788 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.522752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-openshift-service-ca\") pod \"maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n\" (UID: \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\") " pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:10.522967 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.522819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-maas-api-tls\") pod \"maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n\" (UID: \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\") " pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:10.522967 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.522864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stlrf\" (UniqueName: \"kubernetes.io/projected/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-kube-api-access-stlrf\") pod \"maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n\" (UID: \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\") " pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:10.523406 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.523382 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-openshift-service-ca\") pod \"maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n\" (UID: \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\") " pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:10.525252 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.525234 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-maas-api-tls\") pod \"maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n\" (UID: \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\") " pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:10.546093 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.546065 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stlrf\" (UniqueName: \"kubernetes.io/projected/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-kube-api-access-stlrf\") pod \"maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n\" (UID: \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\") " pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:10.672257 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.672175 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:10.829767 ip-10-0-133-95 kubenswrapper[2579]: W0713 15:12:10.829736 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51bfb08_5e80_4eb4_895c_4c6529ce6db6.slice/crio-8fa0625136687a54084f7f0a724206961ca596565a060393fa7e186f4639b294 WatchSource:0}: Error finding container 8fa0625136687a54084f7f0a724206961ca596565a060393fa7e186f4639b294: Status 404 returned error can't find the container with id 8fa0625136687a54084f7f0a724206961ca596565a060393fa7e186f4639b294 Jul 13 15:12:10.842043 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:10.841733 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n"] Jul 13 15:12:11.273965 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:11.273932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" event={"ID":"b51bfb08-5e80-4eb4-895c-4c6529ce6db6","Type":"ContainerStarted","Data":"8fa0625136687a54084f7f0a724206961ca596565a060393fa7e186f4639b294"} Jul 13 15:12:12.280242 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:12.280213 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" event={"ID":"b51bfb08-5e80-4eb4-895c-4c6529ce6db6","Type":"ContainerStarted","Data":"e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8"} Jul 13 15:12:12.280720 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:12.280283 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:15.873169 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:15.873105 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" podStartSLOduration=5.301671918 podStartE2EDuration="5.873082078s" totalImagesPullingTime="571.41016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:12:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:12:12.3267511 +0000 UTC m=+1582.610600336" watchObservedRunningTime="2026-07-13 15:12:15.873082078 +0000 UTC m=+1586.156931296" Jul 13 15:12:15.874478 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:15.874459 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n"] Jul 13 15:12:15.874639 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:15.874621 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" podUID="b51bfb08-5e80-4eb4-895c-4c6529ce6db6" containerName="maas-api" containerID="cri-o://e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8" gracePeriod=30 Jul 13 15:12:16.120936 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.120911 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:16.279259 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.279172 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stlrf\" (UniqueName: \"kubernetes.io/projected/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-kube-api-access-stlrf\") pod \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\" (UID: \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\") " Jul 13 15:12:16.279259 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.279210 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-maas-api-tls\") pod \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\" (UID: \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\") " Jul 13 15:12:16.279470 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.279292 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-openshift-service-ca\") pod \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\" (UID: \"b51bfb08-5e80-4eb4-895c-4c6529ce6db6\") " Jul 13 15:12:16.279674 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.279641 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b51bfb08-5e80-4eb4-895c-4c6529ce6db6" (UID: "b51bfb08-5e80-4eb4-895c-4c6529ce6db6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:12:16.281326 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.281307 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b51bfb08-5e80-4eb4-895c-4c6529ce6db6" (UID: "b51bfb08-5e80-4eb4-895c-4c6529ce6db6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:12:16.281440 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.281425 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-kube-api-access-stlrf" (OuterVolumeSpecName: "kube-api-access-stlrf") pod "b51bfb08-5e80-4eb4-895c-4c6529ce6db6" (UID: "b51bfb08-5e80-4eb4-895c-4c6529ce6db6"). InnerVolumeSpecName "kube-api-access-stlrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:12:16.298123 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.298088 2579 generic.go:356] "Generic (PLEG): container finished" podID="b51bfb08-5e80-4eb4-895c-4c6529ce6db6" containerID="e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8" exitCode=0 Jul 13 15:12:16.298292 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.298133 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" Jul 13 15:12:16.298292 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.298173 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" event={"ID":"b51bfb08-5e80-4eb4-895c-4c6529ce6db6","Type":"ContainerDied","Data":"e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8"} Jul 13 15:12:16.298292 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.298230 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n" event={"ID":"b51bfb08-5e80-4eb4-895c-4c6529ce6db6","Type":"ContainerDied","Data":"8fa0625136687a54084f7f0a724206961ca596565a060393fa7e186f4639b294"} Jul 13 15:12:16.298292 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.298260 2579 scope.go:117] "RemoveContainer" containerID="e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8" Jul 13 15:12:16.306921 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.306901 2579 scope.go:117] "RemoveContainer" containerID="e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8" Jul 13 15:12:16.307178 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:12:16.307160 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8\": container with ID starting with e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8 not found: ID does not exist" containerID="e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8" Jul 13 15:12:16.307221 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.307187 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8"} err="failed to get container status \"e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8\": rpc error: code = NotFound desc = could not find container \"e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8\": container with ID starting with e1c630d14967e31939e4732b8d99d9aac56d2171fa412d07350e4842cf5e4fa8 not found: ID does not exist" Jul 13 15:12:16.322953 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.322923 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n"] Jul 13 15:12:16.331328 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.331298 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-a9109dfb-775f5d5dd4-dgd6n"] Jul 13 15:12:16.380757 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.380722 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-openshift-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:12:16.380757 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.380749 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stlrf\" (UniqueName: \"kubernetes.io/projected/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-kube-api-access-stlrf\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:12:16.380757 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:16.380760 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b51bfb08-5e80-4eb4-895c-4c6529ce6db6-maas-api-tls\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:12:18.206348 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:18.206300 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b51bfb08-5e80-4eb4-895c-4c6529ce6db6" path="/var/lib/kubelet/pods/b51bfb08-5e80-4eb4-895c-4c6529ce6db6/volumes" Jul 13 15:12:29.419516 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.419478 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww"] Jul 13 15:12:29.419898 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.419839 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b51bfb08-5e80-4eb4-895c-4c6529ce6db6" containerName="maas-api" Jul 13 15:12:29.419898 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.419851 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b51bfb08-5e80-4eb4-895c-4c6529ce6db6" containerName="maas-api" Jul 13 15:12:29.419977 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.419910 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b51bfb08-5e80-4eb4-895c-4c6529ce6db6" containerName="maas-api" Jul 13 15:12:29.422871 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.422851 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:29.425943 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.425924 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-851a047e-serving-cert\"" Jul 13 15:12:29.432612 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.432584 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww"] Jul 13 15:12:29.506743 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.506708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmsnb\" (UniqueName: \"kubernetes.io/projected/2dd3ca14-cfae-4eaf-b949-c21472330f34-kube-api-access-cmsnb\") pod \"maas-api-e2e-derive-851a047e-76d9765c6b-9xrww\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:29.506927 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.506760 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dd3ca14-cfae-4eaf-b949-c21472330f34-maas-api-tls\") pod \"maas-api-e2e-derive-851a047e-76d9765c6b-9xrww\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:29.506927 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.506809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dd3ca14-cfae-4eaf-b949-c21472330f34-openshift-service-ca\") pod \"maas-api-e2e-derive-851a047e-76d9765c6b-9xrww\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:29.607486 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.607450 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dd3ca14-cfae-4eaf-b949-c21472330f34-maas-api-tls\") pod \"maas-api-e2e-derive-851a047e-76d9765c6b-9xrww\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:29.607649 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.607516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dd3ca14-cfae-4eaf-b949-c21472330f34-openshift-service-ca\") pod \"maas-api-e2e-derive-851a047e-76d9765c6b-9xrww\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:29.607649 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.607559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmsnb\" (UniqueName: \"kubernetes.io/projected/2dd3ca14-cfae-4eaf-b949-c21472330f34-kube-api-access-cmsnb\") pod \"maas-api-e2e-derive-851a047e-76d9765c6b-9xrww\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:29.607649 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:12:29.607584 2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-851a047e-serving-cert: secret "maas-api-e2e-derive-851a047e-serving-cert" not found Jul 13 15:12:29.607767 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:12:29.607663 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dd3ca14-cfae-4eaf-b949-c21472330f34-maas-api-tls podName:2dd3ca14-cfae-4eaf-b949-c21472330f34 nodeName:}" failed. No retries permitted until 2026-07-13 15:12:30.107645943 +0000 UTC m=+1600.391495140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2dd3ca14-cfae-4eaf-b949-c21472330f34-maas-api-tls") pod "maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" (UID: "2dd3ca14-cfae-4eaf-b949-c21472330f34") : secret "maas-api-e2e-derive-851a047e-serving-cert" not found Jul 13 15:12:29.608147 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.608128 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dd3ca14-cfae-4eaf-b949-c21472330f34-openshift-service-ca\") pod \"maas-api-e2e-derive-851a047e-76d9765c6b-9xrww\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:29.620459 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:29.620431 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmsnb\" (UniqueName: \"kubernetes.io/projected/2dd3ca14-cfae-4eaf-b949-c21472330f34-kube-api-access-cmsnb\") pod \"maas-api-e2e-derive-851a047e-76d9765c6b-9xrww\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:30.111398 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:30.111359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dd3ca14-cfae-4eaf-b949-c21472330f34-maas-api-tls\") pod \"maas-api-e2e-derive-851a047e-76d9765c6b-9xrww\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:30.113828 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:30.113808 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dd3ca14-cfae-4eaf-b949-c21472330f34-maas-api-tls\") pod \"maas-api-e2e-derive-851a047e-76d9765c6b-9xrww\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:30.336666 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:30.336627 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:30.479037 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:30.479009 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww"] Jul 13 15:12:30.480937 ip-10-0-133-95 kubenswrapper[2579]: W0713 15:12:30.480910 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd3ca14_cfae_4eaf_b949_c21472330f34.slice/crio-2a56269317bc7921a83702bb128cb2dab1c106f19d7939acc450f382b25c2e8a WatchSource:0}: Error finding container 2a56269317bc7921a83702bb128cb2dab1c106f19d7939acc450f382b25c2e8a: Status 404 returned error can't find the container with id 2a56269317bc7921a83702bb128cb2dab1c106f19d7939acc450f382b25c2e8a Jul 13 15:12:31.370417 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:31.370384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" event={"ID":"2dd3ca14-cfae-4eaf-b949-c21472330f34","Type":"ContainerStarted","Data":"ee9bcf548a3e112e02b25734ca9976993ee44a940bee813ab2852dd8756e2c36"} Jul 13 15:12:31.370587 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:31.370435 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" event={"ID":"2dd3ca14-cfae-4eaf-b949-c21472330f34","Type":"ContainerStarted","Data":"2a56269317bc7921a83702bb128cb2dab1c106f19d7939acc450f382b25c2e8a"} Jul 13 15:12:31.370587 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:31.370508 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:31.396094 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:31.396040 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" podStartSLOduration=2.092391637 podStartE2EDuration="2.39602066s" totalImagesPullingTime="303.629023ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:12:31.395449999 +0000 UTC m=+1601.679299217" watchObservedRunningTime="2026-07-13 15:12:31.39602066 +0000 UTC m=+1601.679869878" Jul 13 15:12:34.157722 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.157692 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww"] Jul 13 15:12:34.158272 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.157921 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" podUID="2dd3ca14-cfae-4eaf-b949-c21472330f34" containerName="maas-api" containerID="cri-o://ee9bcf548a3e112e02b25734ca9976993ee44a940bee813ab2852dd8756e2c36" gracePeriod=30 Jul 13 15:12:34.385594 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.385568 2579 generic.go:356] "Generic (PLEG): container finished" podID="2dd3ca14-cfae-4eaf-b949-c21472330f34" containerID="ee9bcf548a3e112e02b25734ca9976993ee44a940bee813ab2852dd8756e2c36" exitCode=0 Jul 13 15:12:34.385679 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.385644 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" event={"ID":"2dd3ca14-cfae-4eaf-b949-c21472330f34","Type":"ContainerDied","Data":"ee9bcf548a3e112e02b25734ca9976993ee44a940bee813ab2852dd8756e2c36"} Jul 13 15:12:34.404610 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.404585 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:34.451134 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.451066 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dd3ca14-cfae-4eaf-b949-c21472330f34-openshift-service-ca\") pod \"2dd3ca14-cfae-4eaf-b949-c21472330f34\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " Jul 13 15:12:34.451262 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.451155 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmsnb\" (UniqueName: \"kubernetes.io/projected/2dd3ca14-cfae-4eaf-b949-c21472330f34-kube-api-access-cmsnb\") pod \"2dd3ca14-cfae-4eaf-b949-c21472330f34\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " Jul 13 15:12:34.451262 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.451190 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dd3ca14-cfae-4eaf-b949-c21472330f34-maas-api-tls\") pod \"2dd3ca14-cfae-4eaf-b949-c21472330f34\" (UID: \"2dd3ca14-cfae-4eaf-b949-c21472330f34\") " Jul 13 15:12:34.451482 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.451455 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dd3ca14-cfae-4eaf-b949-c21472330f34-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2dd3ca14-cfae-4eaf-b949-c21472330f34" (UID: "2dd3ca14-cfae-4eaf-b949-c21472330f34"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:12:34.453271 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.453239 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd3ca14-cfae-4eaf-b949-c21472330f34-kube-api-access-cmsnb" (OuterVolumeSpecName: "kube-api-access-cmsnb") pod "2dd3ca14-cfae-4eaf-b949-c21472330f34" (UID: "2dd3ca14-cfae-4eaf-b949-c21472330f34"). InnerVolumeSpecName "kube-api-access-cmsnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:12:34.453394 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.453246 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dd3ca14-cfae-4eaf-b949-c21472330f34-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2dd3ca14-cfae-4eaf-b949-c21472330f34" (UID: "2dd3ca14-cfae-4eaf-b949-c21472330f34"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:12:34.552583 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.552547 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dd3ca14-cfae-4eaf-b949-c21472330f34-maas-api-tls\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:12:34.552583 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.552576 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dd3ca14-cfae-4eaf-b949-c21472330f34-openshift-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:12:34.552583 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:34.552586 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmsnb\" (UniqueName: \"kubernetes.io/projected/2dd3ca14-cfae-4eaf-b949-c21472330f34-kube-api-access-cmsnb\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:12:35.391696 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:35.391671 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" Jul 13 15:12:35.392087 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:35.391666 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww" event={"ID":"2dd3ca14-cfae-4eaf-b949-c21472330f34","Type":"ContainerDied","Data":"2a56269317bc7921a83702bb128cb2dab1c106f19d7939acc450f382b25c2e8a"} Jul 13 15:12:35.392087 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:35.391814 2579 scope.go:117] "RemoveContainer" containerID="ee9bcf548a3e112e02b25734ca9976993ee44a940bee813ab2852dd8756e2c36" Jul 13 15:12:35.420924 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:35.420885 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww"] Jul 13 15:12:35.428330 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:35.428299 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-851a047e-76d9765c6b-9xrww"] Jul 13 15:12:36.207630 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:12:36.207593 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dd3ca14-cfae-4eaf-b949-c21472330f34" path="/var/lib/kubelet/pods/2dd3ca14-cfae-4eaf-b949-c21472330f34/volumes" Jul 13 15:14:22.935477 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:22.935259 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6"] Jul 13 15:14:22.936855 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:22.936828 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd3ca14-cfae-4eaf-b949-c21472330f34" containerName="maas-api" Jul 13 15:14:22.937002 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:22.936991 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd3ca14-cfae-4eaf-b949-c21472330f34" containerName="maas-api" Jul 13 15:14:22.937284 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:22.937271 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd3ca14-cfae-4eaf-b949-c21472330f34" containerName="maas-api" Jul 13 15:14:22.942937 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:22.942910 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:22.946234 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:22.946213 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-0a904fe5-serving-cert\"" Jul 13 15:14:22.953221 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:22.953123 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6"] Jul 13 15:14:23.017435 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:23.017398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9f4z\" (UniqueName: \"kubernetes.io/projected/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-kube-api-access-p9f4z\") pod \"maas-api-e2e-mt-0a904fe5-84756847f7-smnq6\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:23.017616 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:23.017449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-openshift-service-ca\") pod \"maas-api-e2e-mt-0a904fe5-84756847f7-smnq6\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:23.017616 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:23.017514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-maas-api-tls\") pod \"maas-api-e2e-mt-0a904fe5-84756847f7-smnq6\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:23.118569 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:23.118537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9f4z\" (UniqueName: \"kubernetes.io/projected/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-kube-api-access-p9f4z\") pod \"maas-api-e2e-mt-0a904fe5-84756847f7-smnq6\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:23.118569 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:23.118580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-openshift-service-ca\") pod \"maas-api-e2e-mt-0a904fe5-84756847f7-smnq6\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:23.118821 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:23.118599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-maas-api-tls\") pod \"maas-api-e2e-mt-0a904fe5-84756847f7-smnq6\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:23.118821 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:14:23.118739 2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-0a904fe5-serving-cert: secret "maas-api-e2e-mt-0a904fe5-serving-cert" not found Jul 13 15:14:23.118821 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:14:23.118807 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-maas-api-tls podName:1aa8c2a9-d646-4ff1-9545-149d4c5b37e1 nodeName:}" failed. No retries permitted until 2026-07-13 15:14:23.618790372 +0000 UTC m=+1713.902639569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-maas-api-tls") pod "maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" (UID: "1aa8c2a9-d646-4ff1-9545-149d4c5b37e1") : secret "maas-api-e2e-mt-0a904fe5-serving-cert" not found Jul 13 15:14:23.119159 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:23.119138 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-openshift-service-ca\") pod \"maas-api-e2e-mt-0a904fe5-84756847f7-smnq6\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:23.131083 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:23.131057 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9f4z\" (UniqueName: \"kubernetes.io/projected/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-kube-api-access-p9f4z\") pod \"maas-api-e2e-mt-0a904fe5-84756847f7-smnq6\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:23.623041 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:23.622998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-maas-api-tls\") pod \"maas-api-e2e-mt-0a904fe5-84756847f7-smnq6\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:23.623234 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:14:23.623146 2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-0a904fe5-serving-cert: secret "maas-api-e2e-mt-0a904fe5-serving-cert" not found Jul 13 15:14:23.623234 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:14:23.623220 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-maas-api-tls podName:1aa8c2a9-d646-4ff1-9545-149d4c5b37e1 nodeName:}" failed. No retries permitted until 2026-07-13 15:14:24.623204979 +0000 UTC m=+1714.907054174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-maas-api-tls") pod "maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" (UID: "1aa8c2a9-d646-4ff1-9545-149d4c5b37e1") : secret "maas-api-e2e-mt-0a904fe5-serving-cert" not found Jul 13 15:14:24.632446 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:24.632391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-maas-api-tls\") pod \"maas-api-e2e-mt-0a904fe5-84756847f7-smnq6\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:24.634803 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:24.634782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-maas-api-tls\") pod \"maas-api-e2e-mt-0a904fe5-84756847f7-smnq6\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:24.754815 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:24.754781 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:24.891493 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:24.891409 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6"] Jul 13 15:14:24.894758 ip-10-0-133-95 kubenswrapper[2579]: W0713 15:14:24.894724 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa8c2a9_d646_4ff1_9545_149d4c5b37e1.slice/crio-d09ef0ae9a44b6d71c9118a2b612620ccd0b50193b9cf0e99aa74bca97b7ce3a WatchSource:0}: Error finding container d09ef0ae9a44b6d71c9118a2b612620ccd0b50193b9cf0e99aa74bca97b7ce3a: Status 404 returned error can't find the container with id d09ef0ae9a44b6d71c9118a2b612620ccd0b50193b9cf0e99aa74bca97b7ce3a Jul 13 15:14:25.884860 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:25.884836 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" event={"ID":"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1","Type":"ContainerStarted","Data":"d09ef0ae9a44b6d71c9118a2b612620ccd0b50193b9cf0e99aa74bca97b7ce3a"} Jul 13 15:14:26.890710 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:26.890670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" event={"ID":"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1","Type":"ContainerStarted","Data":"91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a"} Jul 13 15:14:26.891131 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:26.890784 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:26.912270 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:26.912223 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" podStartSLOduration=3.928972917 podStartE2EDuration="4.912207886s" totalImagesPullingTime="983.234969ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:14:26.909703243 +0000 UTC m=+1717.193552462" watchObservedRunningTime="2026-07-13 15:14:26.912207886 +0000 UTC m=+1717.196057102" Jul 13 15:14:32.900393 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:32.900332 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:36.163682 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.163646 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6"] Jul 13 15:14:36.168161 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.165776 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" podUID="1aa8c2a9-d646-4ff1-9545-149d4c5b37e1" containerName="maas-api" containerID="cri-o://91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a" gracePeriod=30 Jul 13 15:14:36.415054 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.414989 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:36.541480 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.541446 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-maas-api-tls\") pod \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " Jul 13 15:14:36.541649 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.541490 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-openshift-service-ca\") pod \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " Jul 13 15:14:36.541649 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.541530 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9f4z\" (UniqueName: \"kubernetes.io/projected/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-kube-api-access-p9f4z\") pod \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\" (UID: \"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1\") " Jul 13 15:14:36.541933 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.541896 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1aa8c2a9-d646-4ff1-9545-149d4c5b37e1" (UID: "1aa8c2a9-d646-4ff1-9545-149d4c5b37e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:14:36.543735 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.543700 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1aa8c2a9-d646-4ff1-9545-149d4c5b37e1" (UID: "1aa8c2a9-d646-4ff1-9545-149d4c5b37e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:14:36.543850 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.543736 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-kube-api-access-p9f4z" (OuterVolumeSpecName: "kube-api-access-p9f4z") pod "1aa8c2a9-d646-4ff1-9545-149d4c5b37e1" (UID: "1aa8c2a9-d646-4ff1-9545-149d4c5b37e1"). InnerVolumeSpecName "kube-api-access-p9f4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:14:36.642529 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.642488 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-openshift-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:14:36.642529 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.642522 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9f4z\" (UniqueName: \"kubernetes.io/projected/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-kube-api-access-p9f4z\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:14:36.642529 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.642532 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1-maas-api-tls\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:14:36.936214 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.936176 2579 generic.go:356] "Generic (PLEG): container finished" podID="1aa8c2a9-d646-4ff1-9545-149d4c5b37e1" containerID="91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a" exitCode=0 Jul 13 15:14:36.936441 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.936225 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" Jul 13 15:14:36.936441 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.936252 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" event={"ID":"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1","Type":"ContainerDied","Data":"91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a"} Jul 13 15:14:36.936441 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.936304 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6" event={"ID":"1aa8c2a9-d646-4ff1-9545-149d4c5b37e1","Type":"ContainerDied","Data":"d09ef0ae9a44b6d71c9118a2b612620ccd0b50193b9cf0e99aa74bca97b7ce3a"} Jul 13 15:14:36.936441 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.936324 2579 scope.go:117] "RemoveContainer" containerID="91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a" Jul 13 15:14:36.945949 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.945931 2579 scope.go:117] "RemoveContainer" containerID="91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a" Jul 13 15:14:36.946199 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:14:36.946181 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a\": container with ID starting with 91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a not found: ID does not exist" containerID="91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a" Jul 13 15:14:36.946252 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.946209 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a"} err="failed to get container status \"91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a\": rpc error: code = NotFound desc = could not find container \"91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a\": container with ID starting with 91bc86c76d8bb357f34275a19f9322bf9ce1bc43840ac6eef82d49e36e0dfe0a not found: ID does not exist" Jul 13 15:14:36.960545 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.960512 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6"] Jul 13 15:14:36.965215 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:36.965191 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-0a904fe5-84756847f7-smnq6"] Jul 13 15:14:38.206317 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:14:38.206286 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aa8c2a9-d646-4ff1-9545-149d4c5b37e1" path="/var/lib/kubelet/pods/1aa8c2a9-d646-4ff1-9545-149d4c5b37e1/volumes" Jul 13 15:15:08.057086 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.057050 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt"] Jul 13 15:15:08.057708 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.057479 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa8c2a9-d646-4ff1-9545-149d4c5b37e1" containerName="maas-api" Jul 13 15:15:08.057708 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.057492 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa8c2a9-d646-4ff1-9545-149d4c5b37e1" containerName="maas-api" Jul 13 15:15:08.057708 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.057573 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aa8c2a9-d646-4ff1-9545-149d4c5b37e1" containerName="maas-api" Jul 13 15:15:08.060430 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.060408 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:08.071536 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.071504 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-59ce9939-serving-cert\"" Jul 13 15:15:08.081333 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.081303 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt"] Jul 13 15:15:08.118953 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.118910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-maas-api-tls\") pod \"maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt\" (UID: \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\") " pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:08.119139 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.118981 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgmqg\" (UniqueName: \"kubernetes.io/projected/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-kube-api-access-bgmqg\") pod \"maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt\" (UID: \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\") " pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:08.119139 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.119025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-openshift-service-ca\") pod \"maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt\" (UID: \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\") " pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:08.220036 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.220004 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-openshift-service-ca\") pod \"maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt\" (UID: \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\") " pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:08.220211 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.220143 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-maas-api-tls\") pod \"maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt\" (UID: \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\") " pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:08.220211 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.220183 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgmqg\" (UniqueName: \"kubernetes.io/projected/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-kube-api-access-bgmqg\") pod \"maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt\" (UID: \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\") " pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:08.220659 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.220635 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-openshift-service-ca\") pod \"maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt\" (UID: \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\") " pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:08.222720 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.222692 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-maas-api-tls\") pod \"maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt\" (UID: \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\") " pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:08.230769 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.230744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgmqg\" (UniqueName: \"kubernetes.io/projected/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-kube-api-access-bgmqg\") pod \"maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt\" (UID: \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\") " pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:08.372919 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.372886 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:08.542785 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:08.542754 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt"] Jul 13 15:15:08.544165 ip-10-0-133-95 kubenswrapper[2579]: W0713 15:15:08.544139 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6a3163_a644_4437_aaeb_fc2e6bb2e1d5.slice/crio-9908b266ca05e517d72b598bc7d634780613808e7c8d53582cafe05719574ca5 WatchSource:0}: Error finding container 9908b266ca05e517d72b598bc7d634780613808e7c8d53582cafe05719574ca5: Status 404 returned error can't find the container with id 9908b266ca05e517d72b598bc7d634780613808e7c8d53582cafe05719574ca5 Jul 13 15:15:09.085994 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:09.085956 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" event={"ID":"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5","Type":"ContainerStarted","Data":"5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396"} Jul 13 15:15:09.086438 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:09.086009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" event={"ID":"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5","Type":"ContainerStarted","Data":"9908b266ca05e517d72b598bc7d634780613808e7c8d53582cafe05719574ca5"} Jul 13 15:15:09.086438 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:09.086074 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:09.113069 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:09.113017 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" podStartSLOduration=0.731468787 podStartE2EDuration="1.113002755s" totalImagesPullingTime="381.533968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:15:09.112745216 +0000 UTC m=+1759.396594434" watchObservedRunningTime="2026-07-13 15:15:09.113002755 +0000 UTC m=+1759.396851972" Jul 13 15:15:15.096086 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:15.096058 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:50.292360 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:50.292234 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 15:15:50.298616 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:50.297365 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 15:15:50.784710 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:50.784679 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt"] Jul 13 15:15:50.784892 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:50.784869 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" podUID="7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5" containerName="maas-api" containerID="cri-o://5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396" gracePeriod=30 Jul 13 15:15:51.028516 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.028488 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:51.099916 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.099890 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-maas-api-tls\") pod \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\" (UID: \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\") " Jul 13 15:15:51.100071 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.099981 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgmqg\" (UniqueName: \"kubernetes.io/projected/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-kube-api-access-bgmqg\") pod \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\" (UID: \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\") " Jul 13 15:15:51.100071 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.100000 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-openshift-service-ca\") pod \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\" (UID: \"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5\") " Jul 13 15:15:51.100432 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.100406 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5" (UID: "7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:15:51.101961 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.101935 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5" (UID: "7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:15:51.102071 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.101989 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-kube-api-access-bgmqg" (OuterVolumeSpecName: "kube-api-access-bgmqg") pod "7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5" (UID: "7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5"). InnerVolumeSpecName "kube-api-access-bgmqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:15:51.201524 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.201489 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-maas-api-tls\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:15:51.201524 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.201521 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgmqg\" (UniqueName: \"kubernetes.io/projected/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-kube-api-access-bgmqg\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:15:51.201524 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.201532 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5-openshift-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:15:51.271625 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.271585 2579 generic.go:356] "Generic (PLEG): container finished" podID="7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5" containerID="5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396" exitCode=0 Jul 13 15:15:51.271844 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.271633 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" Jul 13 15:15:51.271844 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.271657 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" event={"ID":"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5","Type":"ContainerDied","Data":"5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396"} Jul 13 15:15:51.271844 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.271700 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt" event={"ID":"7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5","Type":"ContainerDied","Data":"9908b266ca05e517d72b598bc7d634780613808e7c8d53582cafe05719574ca5"} Jul 13 15:15:51.271844 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.271719 2579 scope.go:117] "RemoveContainer" containerID="5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396" Jul 13 15:15:51.281316 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.281297 2579 scope.go:117] "RemoveContainer" containerID="5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396" Jul 13 15:15:51.281649 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:15:51.281629 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396\": container with ID starting with 5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396 not found: ID does not exist" containerID="5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396" Jul 13 15:15:51.281711 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.281659 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396"} err="failed to get container status \"5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396\": rpc error: code = NotFound desc = could not find container \"5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396\": container with ID starting with 5ba1d76f5538533e667cbc82816f41a19bd39e516a9f3b6270e882fff60f7396 not found: ID does not exist" Jul 13 15:15:51.298012 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.297973 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt"] Jul 13 15:15:51.303534 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:51.303507 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-59ce9939-59cdcbb8d7-6xrnt"] Jul 13 15:15:52.206943 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:15:52.206901 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5" path="/var/lib/kubelet/pods/7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5/volumes" Jul 13 15:17:52.842485 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:52.842453 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv"] Jul 13 15:17:52.843013 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:52.842990 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5" containerName="maas-api" Jul 13 15:17:52.843089 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:52.843016 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5" containerName="maas-api" Jul 13 15:17:52.843132 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:52.843122 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c6a3163-a644-4437-aaeb-fc2e6bb2e1d5" containerName="maas-api" Jul 13 15:17:52.845869 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:52.845852 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:17:52.848938 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:52.848915 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-d5c92a-serving-cert\"" Jul 13 15:17:52.861968 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:52.861936 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv"] Jul 13 15:17:53.001118 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.001075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f343a5be-cec6-4ad5-944d-9752eb411930-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv\" (UID: \"f343a5be-cec6-4ad5-944d-9752eb411930\") " pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:17:53.001298 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.001157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gknrr\" (UniqueName: \"kubernetes.io/projected/f343a5be-cec6-4ad5-944d-9752eb411930-kube-api-access-gknrr\") pod \"maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv\" (UID: \"f343a5be-cec6-4ad5-944d-9752eb411930\") " pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:17:53.001298 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.001178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f343a5be-cec6-4ad5-944d-9752eb411930-maas-api-tls\") pod \"maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv\" (UID: \"f343a5be-cec6-4ad5-944d-9752eb411930\") " pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:17:53.101939 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.101906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gknrr\" (UniqueName: \"kubernetes.io/projected/f343a5be-cec6-4ad5-944d-9752eb411930-kube-api-access-gknrr\") pod \"maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv\" (UID: \"f343a5be-cec6-4ad5-944d-9752eb411930\") " pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:17:53.102088 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.101945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f343a5be-cec6-4ad5-944d-9752eb411930-maas-api-tls\") pod \"maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv\" (UID: \"f343a5be-cec6-4ad5-944d-9752eb411930\") " pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:17:53.102088 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.101998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f343a5be-cec6-4ad5-944d-9752eb411930-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv\" (UID: \"f343a5be-cec6-4ad5-944d-9752eb411930\") " pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:17:53.102638 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.102609 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f343a5be-cec6-4ad5-944d-9752eb411930-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv\" (UID: \"f343a5be-cec6-4ad5-944d-9752eb411930\") " pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:17:53.104322 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.104303 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f343a5be-cec6-4ad5-944d-9752eb411930-maas-api-tls\") pod \"maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv\" (UID: \"f343a5be-cec6-4ad5-944d-9752eb411930\") " pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:17:53.112932 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.112910 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gknrr\" (UniqueName: \"kubernetes.io/projected/f343a5be-cec6-4ad5-944d-9752eb411930-kube-api-access-gknrr\") pod \"maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv\" (UID: \"f343a5be-cec6-4ad5-944d-9752eb411930\") " pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:17:53.156100 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.156063 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:17:53.299588 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.299562 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv"] Jul 13 15:17:53.301387 ip-10-0-133-95 kubenswrapper[2579]: W0713 15:17:53.301356 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf343a5be_cec6_4ad5_944d_9752eb411930.slice/crio-7d452b255f97d71397b9b47b96bb6e332b98f658f642dad7e1cd1496102b3a63 WatchSource:0}: Error finding container 7d452b255f97d71397b9b47b96bb6e332b98f658f642dad7e1cd1496102b3a63: Status 404 returned error can't find the container with id 7d452b255f97d71397b9b47b96bb6e332b98f658f642dad7e1cd1496102b3a63 Jul 13 15:17:53.302829 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.302810 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 15:17:53.822411 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:53.822373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" event={"ID":"f343a5be-cec6-4ad5-944d-9752eb411930","Type":"ContainerStarted","Data":"7d452b255f97d71397b9b47b96bb6e332b98f658f642dad7e1cd1496102b3a63"} Jul 13 15:17:54.827890 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:54.827857 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" event={"ID":"f343a5be-cec6-4ad5-944d-9752eb411930","Type":"ContainerStarted","Data":"a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a"} Jul 13 15:17:54.828374 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:54.828010 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:17:54.859097 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:17:54.859041 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" podStartSLOduration=2.348194946 podStartE2EDuration="2.85902272s" totalImagesPullingTime="510.827774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:17:54.855357498 +0000 UTC m=+1925.139206706" watchObservedRunningTime="2026-07-13 15:17:54.85902272 +0000 UTC m=+1925.142871937" Jul 13 15:18:00.839091 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:00.839058 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:18:00.880149 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:00.880101 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr"] Jul 13 15:18:00.884023 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:00.883991 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:00.892673 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:00.890943 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-3dcb39-serving-cert\"" Jul 13 15:18:00.898330 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:00.898267 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr"] Jul 13 15:18:00.968184 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:00.968136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:00.968390 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:00.968255 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-maas-api-tls\") pod \"maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:00.968390 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:00.968366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49w4\" (UniqueName: \"kubernetes.io/projected/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-kube-api-access-k49w4\") pod \"maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:01.069540 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:01.069494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-maas-api-tls\") pod \"maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:01.069715 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:01.069568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49w4\" (UniqueName: \"kubernetes.io/projected/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-kube-api-access-k49w4\") pod \"maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:01.069715 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:18:01.069645 2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-3dcb39-serving-cert: secret "maas-api-e2e-inf-b-3dcb39-serving-cert" not found Jul 13 15:18:01.069715 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:18:01.069714 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-maas-api-tls podName:cb5c91d1-8e7e-4be8-8157-d0a19d1cb866 nodeName:}" failed. No retries permitted until 2026-07-13 15:18:01.569696956 +0000 UTC m=+1931.853546152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-maas-api-tls") pod "maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" (UID: "cb5c91d1-8e7e-4be8-8157-d0a19d1cb866") : secret "maas-api-e2e-inf-b-3dcb39-serving-cert" not found Jul 13 15:18:01.069827 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:01.069731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:01.070366 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:01.070320 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:01.081791 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:01.081761 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49w4\" (UniqueName: \"kubernetes.io/projected/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-kube-api-access-k49w4\") pod \"maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:01.572813 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:01.572780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-maas-api-tls\") pod \"maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:01.575597 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:01.575575 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-maas-api-tls\") pod \"maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:01.805448 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:01.805414 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:01.952644 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:01.952620 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr"] Jul 13 15:18:01.954736 ip-10-0-133-95 kubenswrapper[2579]: W0713 15:18:01.954708 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5c91d1_8e7e_4be8_8157_d0a19d1cb866.slice/crio-54a12d84e1f629d619889a6be2d3f4ed4d3dcfe3a15d9f30e7be10cf52890da1 WatchSource:0}: Error finding container 54a12d84e1f629d619889a6be2d3f4ed4d3dcfe3a15d9f30e7be10cf52890da1: Status 404 returned error can't find the container with id 54a12d84e1f629d619889a6be2d3f4ed4d3dcfe3a15d9f30e7be10cf52890da1 Jul 13 15:18:02.868954 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:02.868906 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" event={"ID":"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866","Type":"ContainerStarted","Data":"512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7"} Jul 13 15:18:02.869107 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:02.868963 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" event={"ID":"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866","Type":"ContainerStarted","Data":"54a12d84e1f629d619889a6be2d3f4ed4d3dcfe3a15d9f30e7be10cf52890da1"} Jul 13 15:18:02.869107 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:02.869037 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:02.907676 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:02.907627 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" podStartSLOduration=2.5490517759999998 podStartE2EDuration="2.907610537s" totalImagesPullingTime="358.558761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:18:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:18:02.907067342 +0000 UTC m=+1933.190916560" watchObservedRunningTime="2026-07-13 15:18:02.907610537 +0000 UTC m=+1933.191459754" Jul 13 15:18:08.880272 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:08.880239 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:18:50.802904 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:50.802823 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv"] Jul 13 15:18:50.803468 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:50.803025 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" podUID="f343a5be-cec6-4ad5-944d-9752eb411930" containerName="maas-api" containerID="cri-o://a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a" gracePeriod=30 Jul 13 15:18:50.833305 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:50.833268 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" podUID="f343a5be-cec6-4ad5-944d-9752eb411930" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.38:8443/health\": dial tcp 10.132.0.38:8443: connect: connection refused" Jul 13 15:18:51.057609 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.057545 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:18:51.093785 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.093749 2579 generic.go:356] "Generic (PLEG): container finished" podID="f343a5be-cec6-4ad5-944d-9752eb411930" containerID="a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a" exitCode=0 Jul 13 15:18:51.093785 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.093792 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" event={"ID":"f343a5be-cec6-4ad5-944d-9752eb411930","Type":"ContainerDied","Data":"a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a"} Jul 13 15:18:51.094028 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.093797 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" Jul 13 15:18:51.094028 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.093837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv" event={"ID":"f343a5be-cec6-4ad5-944d-9752eb411930","Type":"ContainerDied","Data":"7d452b255f97d71397b9b47b96bb6e332b98f658f642dad7e1cd1496102b3a63"} Jul 13 15:18:51.094028 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.093861 2579 scope.go:117] "RemoveContainer" containerID="a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a" Jul 13 15:18:51.102714 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.102690 2579 scope.go:117] "RemoveContainer" containerID="a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a" Jul 13 15:18:51.103017 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:18:51.103000 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a\": container with ID starting with a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a not found: ID does not exist" containerID="a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a" Jul 13 15:18:51.103082 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.103025 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a"} err="failed to get container status \"a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a\": rpc error: code = NotFound desc = could not find container \"a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a\": container with ID starting with a24e2e77d596886aa4ba0cdc0736852795541e2b00a6587fea2653805005b63a not found: ID does not exist" Jul 13 15:18:51.117982 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.117952 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f343a5be-cec6-4ad5-944d-9752eb411930-maas-api-tls\") pod \"f343a5be-cec6-4ad5-944d-9752eb411930\" (UID: \"f343a5be-cec6-4ad5-944d-9752eb411930\") " Jul 13 15:18:51.118152 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.118016 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f343a5be-cec6-4ad5-944d-9752eb411930-openshift-service-ca\") pod \"f343a5be-cec6-4ad5-944d-9752eb411930\" (UID: \"f343a5be-cec6-4ad5-944d-9752eb411930\") " Jul 13 15:18:51.118152 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.118040 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gknrr\" (UniqueName: \"kubernetes.io/projected/f343a5be-cec6-4ad5-944d-9752eb411930-kube-api-access-gknrr\") pod \"f343a5be-cec6-4ad5-944d-9752eb411930\" (UID: \"f343a5be-cec6-4ad5-944d-9752eb411930\") " Jul 13 15:18:51.118423 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.118401 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f343a5be-cec6-4ad5-944d-9752eb411930-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f343a5be-cec6-4ad5-944d-9752eb411930" (UID: "f343a5be-cec6-4ad5-944d-9752eb411930"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:18:51.120070 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.120044 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f343a5be-cec6-4ad5-944d-9752eb411930-kube-api-access-gknrr" (OuterVolumeSpecName: "kube-api-access-gknrr") pod "f343a5be-cec6-4ad5-944d-9752eb411930" (UID: "f343a5be-cec6-4ad5-944d-9752eb411930"). InnerVolumeSpecName "kube-api-access-gknrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:18:51.120173 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.120119 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f343a5be-cec6-4ad5-944d-9752eb411930-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f343a5be-cec6-4ad5-944d-9752eb411930" (UID: "f343a5be-cec6-4ad5-944d-9752eb411930"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:18:51.219368 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.219310 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gknrr\" (UniqueName: \"kubernetes.io/projected/f343a5be-cec6-4ad5-944d-9752eb411930-kube-api-access-gknrr\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:18:51.219368 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.219360 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f343a5be-cec6-4ad5-944d-9752eb411930-maas-api-tls\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:18:51.219368 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.219369 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f343a5be-cec6-4ad5-944d-9752eb411930-openshift-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:18:51.417771 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.417739 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv"] Jul 13 15:18:51.423104 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:51.423079 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-d5c92a-b866fc6bc-z2fsv"] Jul 13 15:18:52.206600 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:18:52.206564 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f343a5be-cec6-4ad5-944d-9752eb411930" path="/var/lib/kubelet/pods/f343a5be-cec6-4ad5-944d-9752eb411930/volumes" Jul 13 15:19:34.234776 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:34.234741 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr"] Jul 13 15:19:34.235299 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:34.234981 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" podUID="cb5c91d1-8e7e-4be8-8157-d0a19d1cb866" containerName="maas-api" containerID="cri-o://512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7" gracePeriod=30 Jul 13 15:19:34.682212 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:34.682186 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:19:34.788846 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:34.788768 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-maas-api-tls\") pod \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " Jul 13 15:19:34.788846 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:34.788821 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-openshift-service-ca\") pod \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " Jul 13 15:19:34.789029 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:34.788906 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k49w4\" (UniqueName: \"kubernetes.io/projected/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-kube-api-access-k49w4\") pod \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\" (UID: \"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866\") " Jul 13 15:19:34.789214 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:34.789186 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cb5c91d1-8e7e-4be8-8157-d0a19d1cb866" (UID: "cb5c91d1-8e7e-4be8-8157-d0a19d1cb866"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:19:34.791005 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:34.790968 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cb5c91d1-8e7e-4be8-8157-d0a19d1cb866" (UID: "cb5c91d1-8e7e-4be8-8157-d0a19d1cb866"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:19:34.791115 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:34.791093 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-kube-api-access-k49w4" (OuterVolumeSpecName: "kube-api-access-k49w4") pod "cb5c91d1-8e7e-4be8-8157-d0a19d1cb866" (UID: "cb5c91d1-8e7e-4be8-8157-d0a19d1cb866"). InnerVolumeSpecName "kube-api-access-k49w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:19:34.890411 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:34.890369 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k49w4\" (UniqueName: \"kubernetes.io/projected/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-kube-api-access-k49w4\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:19:34.890411 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:34.890403 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-maas-api-tls\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:19:34.890411 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:34.890415 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866-openshift-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:19:35.296314 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:35.296278 2579 generic.go:356] "Generic (PLEG): container finished" podID="cb5c91d1-8e7e-4be8-8157-d0a19d1cb866" containerID="512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7" exitCode=0 Jul 13 15:19:35.296778 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:35.296322 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" Jul 13 15:19:35.296778 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:35.296334 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" event={"ID":"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866","Type":"ContainerDied","Data":"512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7"} Jul 13 15:19:35.296778 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:35.296404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr" event={"ID":"cb5c91d1-8e7e-4be8-8157-d0a19d1cb866","Type":"ContainerDied","Data":"54a12d84e1f629d619889a6be2d3f4ed4d3dcfe3a15d9f30e7be10cf52890da1"} Jul 13 15:19:35.296778 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:35.296425 2579 scope.go:117] "RemoveContainer" containerID="512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7" Jul 13 15:19:35.307734 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:35.307709 2579 scope.go:117] "RemoveContainer" containerID="512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7" Jul 13 15:19:35.308033 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:19:35.308011 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7\": container with ID starting with 512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7 not found: ID does not exist" containerID="512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7" Jul 13 15:19:35.308086 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:35.308044 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7"} err="failed to get container status \"512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7\": rpc error: code = NotFound desc = could not find container \"512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7\": container with ID starting with 512284edb1142cfb7d7f36a91bde7881a40764bec32002ba9ea931fb27f3a3f7 not found: ID does not exist" Jul 13 15:19:35.321986 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:35.321960 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr"] Jul 13 15:19:35.326736 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:35.326714 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-3dcb39-7486b9ccc4-k6wkr"] Jul 13 15:19:36.206537 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:36.206502 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb5c91d1-8e7e-4be8-8157-d0a19d1cb866" path="/var/lib/kubelet/pods/cb5c91d1-8e7e-4be8-8157-d0a19d1cb866/volumes" Jul 13 15:19:45.272783 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.272748 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb"] Jul 13 15:19:45.273385 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.273366 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb5c91d1-8e7e-4be8-8157-d0a19d1cb866" containerName="maas-api" Jul 13 15:19:45.273385 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.273387 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb5c91d1-8e7e-4be8-8157-d0a19d1cb866" containerName="maas-api" Jul 13 15:19:45.273886 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.273430 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f343a5be-cec6-4ad5-944d-9752eb411930" containerName="maas-api" Jul 13 15:19:45.273886 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.273439 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f343a5be-cec6-4ad5-944d-9752eb411930" containerName="maas-api" Jul 13 15:19:45.273886 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.273530 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f343a5be-cec6-4ad5-944d-9752eb411930" containerName="maas-api" Jul 13 15:19:45.273886 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.273547 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb5c91d1-8e7e-4be8-8157-d0a19d1cb866" containerName="maas-api" Jul 13 15:19:45.278062 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.278042 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:45.280833 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.280813 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-425f46-serving-cert\"" Jul 13 15:19:45.282979 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.282956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbhff\" (UniqueName: \"kubernetes.io/projected/8fa023a7-075b-4d3e-b499-3410b14f9c20-kube-api-access-kbhff\") pod \"maas-api-e2e-api-a-425f46-d897fc455-2sxrb\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:45.283108 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.283048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa023a7-075b-4d3e-b499-3410b14f9c20-maas-api-tls\") pod \"maas-api-e2e-api-a-425f46-d897fc455-2sxrb\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:45.283108 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.283084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa023a7-075b-4d3e-b499-3410b14f9c20-openshift-service-ca\") pod \"maas-api-e2e-api-a-425f46-d897fc455-2sxrb\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:45.287116 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.287091 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb"] Jul 13 15:19:45.384066 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.384035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa023a7-075b-4d3e-b499-3410b14f9c20-maas-api-tls\") pod \"maas-api-e2e-api-a-425f46-d897fc455-2sxrb\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:45.384066 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.384071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa023a7-075b-4d3e-b499-3410b14f9c20-openshift-service-ca\") pod \"maas-api-e2e-api-a-425f46-d897fc455-2sxrb\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:45.384334 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.384120 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbhff\" (UniqueName: \"kubernetes.io/projected/8fa023a7-075b-4d3e-b499-3410b14f9c20-kube-api-access-kbhff\") pod \"maas-api-e2e-api-a-425f46-d897fc455-2sxrb\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:45.384334 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:19:45.384232 2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-425f46-serving-cert: secret "maas-api-e2e-api-a-425f46-serving-cert" not found Jul 13 15:19:45.384334 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:19:45.384325 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fa023a7-075b-4d3e-b499-3410b14f9c20-maas-api-tls podName:8fa023a7-075b-4d3e-b499-3410b14f9c20 nodeName:}" failed. No retries permitted until 2026-07-13 15:19:45.884302553 +0000 UTC m=+2036.168151768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8fa023a7-075b-4d3e-b499-3410b14f9c20-maas-api-tls") pod "maas-api-e2e-api-a-425f46-d897fc455-2sxrb" (UID: "8fa023a7-075b-4d3e-b499-3410b14f9c20") : secret "maas-api-e2e-api-a-425f46-serving-cert" not found Jul 13 15:19:45.384781 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.384759 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa023a7-075b-4d3e-b499-3410b14f9c20-openshift-service-ca\") pod \"maas-api-e2e-api-a-425f46-d897fc455-2sxrb\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:45.401460 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.401436 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbhff\" (UniqueName: \"kubernetes.io/projected/8fa023a7-075b-4d3e-b499-3410b14f9c20-kube-api-access-kbhff\") pod \"maas-api-e2e-api-a-425f46-d897fc455-2sxrb\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:45.888418 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.888381 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa023a7-075b-4d3e-b499-3410b14f9c20-maas-api-tls\") pod \"maas-api-e2e-api-a-425f46-d897fc455-2sxrb\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:45.890780 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.890751 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa023a7-075b-4d3e-b499-3410b14f9c20-maas-api-tls\") pod \"maas-api-e2e-api-a-425f46-d897fc455-2sxrb\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:45.891581 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:45.891563 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:46.022884 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:46.022860 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb"] Jul 13 15:19:46.024968 ip-10-0-133-95 kubenswrapper[2579]: W0713 15:19:46.024938 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa023a7_075b_4d3e_b499_3410b14f9c20.slice/crio-58da06db30b20a2a5721b4d01e49886ce5832ba233dbffe7771c26126b0c4bc7 WatchSource:0}: Error finding container 58da06db30b20a2a5721b4d01e49886ce5832ba233dbffe7771c26126b0c4bc7: Status 404 returned error can't find the container with id 58da06db30b20a2a5721b4d01e49886ce5832ba233dbffe7771c26126b0c4bc7 Jul 13 15:19:46.345941 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:46.345852 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" event={"ID":"8fa023a7-075b-4d3e-b499-3410b14f9c20","Type":"ContainerStarted","Data":"58da06db30b20a2a5721b4d01e49886ce5832ba233dbffe7771c26126b0c4bc7"} Jul 13 15:19:47.352517 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:47.352478 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" event={"ID":"8fa023a7-075b-4d3e-b499-3410b14f9c20","Type":"ContainerStarted","Data":"5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956"} Jul 13 15:19:47.352955 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:47.352625 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:47.373155 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:47.373095 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" podStartSLOduration=1.907821521 podStartE2EDuration="2.373078985s" totalImagesPullingTime="465.257464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:19:47.371004008 +0000 UTC m=+2037.654853225" watchObservedRunningTime="2026-07-13 15:19:47.373078985 +0000 UTC m=+2037.656928201" Jul 13 15:19:53.356359 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.356301 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j"] Jul 13 15:19:53.361374 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.361331 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:53.362694 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.362670 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:19:53.364441 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.364420 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-0ac978-serving-cert\"" Jul 13 15:19:53.374275 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.374246 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j"] Jul 13 15:19:53.457770 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.457730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-maas-api-tls\") pod \"maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:53.457963 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.457902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-openshift-service-ca\") pod \"maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:53.457963 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.457941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72dv4\" (UniqueName: \"kubernetes.io/projected/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-kube-api-access-72dv4\") pod \"maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:53.559449 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.559405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72dv4\" (UniqueName: \"kubernetes.io/projected/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-kube-api-access-72dv4\") pod \"maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:53.559616 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.559531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-maas-api-tls\") pod \"maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:53.559616 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.559584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-openshift-service-ca\") pod \"maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:53.559796 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:19:53.559772 2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-0ac978-serving-cert: secret "maas-api-e2e-api-b-0ac978-serving-cert" not found Jul 13 15:19:53.559915 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:19:53.559905 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-maas-api-tls podName:bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f nodeName:}" failed. No retries permitted until 2026-07-13 15:19:54.059882394 +0000 UTC m=+2044.343731603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-maas-api-tls") pod "maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" (UID: "bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f") : secret "maas-api-e2e-api-b-0ac978-serving-cert" not found Jul 13 15:19:53.560304 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.560285 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-openshift-service-ca\") pod \"maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:53.570588 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:53.570562 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72dv4\" (UniqueName: \"kubernetes.io/projected/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-kube-api-access-72dv4\") pod \"maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:54.065709 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:54.065674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-maas-api-tls\") pod \"maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:54.068032 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:54.068013 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-maas-api-tls\") pod \"maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:54.272179 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:54.272148 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:54.412955 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:54.412732 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j"] Jul 13 15:19:54.415267 ip-10-0-133-95 kubenswrapper[2579]: W0713 15:19:54.415230 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb56d8bc_8e95_4fdb_b0c7_ded6d89bdf8f.slice/crio-de2eec896203dc9a6395e66a46204ca89602dd3b0494b51ee677fe9b3fbd9696 WatchSource:0}: Error finding container de2eec896203dc9a6395e66a46204ca89602dd3b0494b51ee677fe9b3fbd9696: Status 404 returned error can't find the container with id de2eec896203dc9a6395e66a46204ca89602dd3b0494b51ee677fe9b3fbd9696 Jul 13 15:19:55.391558 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:55.391515 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" event={"ID":"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f","Type":"ContainerStarted","Data":"17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55"} Jul 13 15:19:55.391558 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:55.391566 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" event={"ID":"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f","Type":"ContainerStarted","Data":"de2eec896203dc9a6395e66a46204ca89602dd3b0494b51ee677fe9b3fbd9696"} Jul 13 15:19:55.391831 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:55.391651 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:19:55.413920 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:19:55.413867 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" podStartSLOduration=2.001967718 podStartE2EDuration="2.413851675s" totalImagesPullingTime="411.883957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:19:55.41260747 +0000 UTC m=+2045.696456699" watchObservedRunningTime="2026-07-13 15:19:55.413851675 +0000 UTC m=+2045.697700891" Jul 13 15:20:01.403266 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:01.403234 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:20:07.136624 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.136581 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb"] Jul 13 15:20:07.137070 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.136858 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" podUID="8fa023a7-075b-4d3e-b499-3410b14f9c20" containerName="maas-api" containerID="cri-o://5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956" gracePeriod=30 Jul 13 15:20:07.384664 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.384633 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:20:07.450851 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.448712 2579 generic.go:356] "Generic (PLEG): container finished" podID="8fa023a7-075b-4d3e-b499-3410b14f9c20" containerID="5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956" exitCode=0 Jul 13 15:20:07.450851 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.448777 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" event={"ID":"8fa023a7-075b-4d3e-b499-3410b14f9c20","Type":"ContainerDied","Data":"5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956"} Jul 13 15:20:07.450851 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.448827 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" event={"ID":"8fa023a7-075b-4d3e-b499-3410b14f9c20","Type":"ContainerDied","Data":"58da06db30b20a2a5721b4d01e49886ce5832ba233dbffe7771c26126b0c4bc7"} Jul 13 15:20:07.450851 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.448855 2579 scope.go:117] "RemoveContainer" containerID="5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956" Jul 13 15:20:07.450851 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.449006 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb" Jul 13 15:20:07.459284 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.459262 2579 scope.go:117] "RemoveContainer" containerID="5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956" Jul 13 15:20:07.459616 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:20:07.459590 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956\": container with ID starting with 5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956 not found: ID does not exist" containerID="5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956" Jul 13 15:20:07.459683 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.459624 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956"} err="failed to get container status \"5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956\": rpc error: code = NotFound desc = could not find container \"5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956\": container with ID starting with 5502d850cc8b76dc1584a301c436cf6c9514bc918fb41edb33d26726d4879956 not found: ID does not exist" Jul 13 15:20:07.494969 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.494936 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbhff\" (UniqueName: \"kubernetes.io/projected/8fa023a7-075b-4d3e-b499-3410b14f9c20-kube-api-access-kbhff\") pod \"8fa023a7-075b-4d3e-b499-3410b14f9c20\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " Jul 13 15:20:07.495116 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.495039 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa023a7-075b-4d3e-b499-3410b14f9c20-maas-api-tls\") pod \"8fa023a7-075b-4d3e-b499-3410b14f9c20\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " Jul 13 15:20:07.495156 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.495122 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa023a7-075b-4d3e-b499-3410b14f9c20-openshift-service-ca\") pod \"8fa023a7-075b-4d3e-b499-3410b14f9c20\" (UID: \"8fa023a7-075b-4d3e-b499-3410b14f9c20\") " Jul 13 15:20:07.495538 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.495507 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fa023a7-075b-4d3e-b499-3410b14f9c20-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8fa023a7-075b-4d3e-b499-3410b14f9c20" (UID: "8fa023a7-075b-4d3e-b499-3410b14f9c20"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:20:07.497528 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.497509 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fa023a7-075b-4d3e-b499-3410b14f9c20-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8fa023a7-075b-4d3e-b499-3410b14f9c20" (UID: "8fa023a7-075b-4d3e-b499-3410b14f9c20"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:20:07.497595 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.497535 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fa023a7-075b-4d3e-b499-3410b14f9c20-kube-api-access-kbhff" (OuterVolumeSpecName: "kube-api-access-kbhff") pod "8fa023a7-075b-4d3e-b499-3410b14f9c20" (UID: "8fa023a7-075b-4d3e-b499-3410b14f9c20"). InnerVolumeSpecName "kube-api-access-kbhff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:20:07.596275 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.596237 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbhff\" (UniqueName: \"kubernetes.io/projected/8fa023a7-075b-4d3e-b499-3410b14f9c20-kube-api-access-kbhff\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:20:07.596275 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.596269 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fa023a7-075b-4d3e-b499-3410b14f9c20-maas-api-tls\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:20:07.596275 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.596279 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fa023a7-075b-4d3e-b499-3410b14f9c20-openshift-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:20:07.775074 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.775040 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb"] Jul 13 15:20:07.782485 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:07.782457 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-425f46-d897fc455-2sxrb"] Jul 13 15:20:08.206087 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:08.206053 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fa023a7-075b-4d3e-b499-3410b14f9c20" path="/var/lib/kubelet/pods/8fa023a7-075b-4d3e-b499-3410b14f9c20/volumes" Jul 13 15:20:15.082004 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.081924 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j"] Jul 13 15:20:15.082413 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.082194 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" podUID="bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f" containerName="maas-api" containerID="cri-o://17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55" gracePeriod=30 Jul 13 15:20:15.333877 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.333814 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:20:15.469151 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.469110 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72dv4\" (UniqueName: \"kubernetes.io/projected/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-kube-api-access-72dv4\") pod \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " Jul 13 15:20:15.469151 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.469153 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-maas-api-tls\") pod \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " Jul 13 15:20:15.469380 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.469200 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-openshift-service-ca\") pod \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\" (UID: \"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f\") " Jul 13 15:20:15.469665 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.469641 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f" (UID: "bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:20:15.471275 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.471253 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f" (UID: "bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:20:15.471358 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.471257 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-kube-api-access-72dv4" (OuterVolumeSpecName: "kube-api-access-72dv4") pod "bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f" (UID: "bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f"). InnerVolumeSpecName "kube-api-access-72dv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:20:15.486595 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.486566 2579 generic.go:356] "Generic (PLEG): container finished" podID="bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f" containerID="17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55" exitCode=0 Jul 13 15:20:15.486749 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.486617 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" event={"ID":"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f","Type":"ContainerDied","Data":"17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55"} Jul 13 15:20:15.486749 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.486625 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" Jul 13 15:20:15.486749 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.486658 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j" event={"ID":"bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f","Type":"ContainerDied","Data":"de2eec896203dc9a6395e66a46204ca89602dd3b0494b51ee677fe9b3fbd9696"} Jul 13 15:20:15.486749 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.486679 2579 scope.go:117] "RemoveContainer" containerID="17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55" Jul 13 15:20:15.495432 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.495413 2579 scope.go:117] "RemoveContainer" containerID="17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55" Jul 13 15:20:15.495681 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:20:15.495661 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55\": container with ID starting with 17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55 not found: ID does not exist" containerID="17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55" Jul 13 15:20:15.495755 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.495689 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55"} err="failed to get container status \"17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55\": rpc error: code = NotFound desc = could not find container \"17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55\": container with ID starting with 17cc0bd0fda972e8df44e979fd48a5282c1224d3acc2fa68b03794effd012c55 not found: ID does not exist" Jul 13 15:20:15.509882 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.509854 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j"] Jul 13 15:20:15.514706 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.514681 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-0ac978-5f999fc75f-zpw5j"] Jul 13 15:20:15.569750 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.569720 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-openshift-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:20:15.569750 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.569747 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72dv4\" (UniqueName: \"kubernetes.io/projected/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-kube-api-access-72dv4\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:20:15.569935 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:15.569759 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f-maas-api-tls\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:20:16.207088 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:16.207056 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f" path="/var/lib/kubelet/pods/bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f/volumes" Jul 13 15:20:25.637254 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.637215 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62"] Jul 13 15:20:25.637809 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.637792 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f" containerName="maas-api" Jul 13 15:20:25.637867 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.637813 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f" containerName="maas-api" Jul 13 15:20:25.637867 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.637832 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fa023a7-075b-4d3e-b499-3410b14f9c20" containerName="maas-api" Jul 13 15:20:25.637867 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.637840 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fa023a7-075b-4d3e-b499-3410b14f9c20" containerName="maas-api" Jul 13 15:20:25.638013 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.637922 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb56d8bc-8e95-4fdb-b0c7-ded6d89bdf8f" containerName="maas-api" Jul 13 15:20:25.638013 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.637932 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fa023a7-075b-4d3e-b499-3410b14f9c20" containerName="maas-api" Jul 13 15:20:25.641318 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.641297 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:25.644091 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.644063 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-0a6921-serving-cert\"" Jul 13 15:20:25.651885 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.651851 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62"] Jul 13 15:20:25.758528 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.758490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd93df27-63cc-42dd-a061-0aa66f695b8c-maas-api-tls\") pod \"maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:25.758718 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.758535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd93df27-63cc-42dd-a061-0aa66f695b8c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:25.758718 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.758559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl5pj\" (UniqueName: \"kubernetes.io/projected/cd93df27-63cc-42dd-a061-0aa66f695b8c-kube-api-access-cl5pj\") pod \"maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:25.859141 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.859099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd93df27-63cc-42dd-a061-0aa66f695b8c-maas-api-tls\") pod \"maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:25.859352 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.859150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd93df27-63cc-42dd-a061-0aa66f695b8c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:25.859352 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.859176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl5pj\" (UniqueName: \"kubernetes.io/projected/cd93df27-63cc-42dd-a061-0aa66f695b8c-kube-api-access-cl5pj\") pod \"maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:25.859352 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:20:25.859253 2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-0a6921-serving-cert: secret "maas-api-e2e-shared-a-0a6921-serving-cert" not found Jul 13 15:20:25.859352 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:20:25.859320 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd93df27-63cc-42dd-a061-0aa66f695b8c-maas-api-tls podName:cd93df27-63cc-42dd-a061-0aa66f695b8c nodeName:}" failed. No retries permitted until 2026-07-13 15:20:26.359301954 +0000 UTC m=+2076.643151152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cd93df27-63cc-42dd-a061-0aa66f695b8c-maas-api-tls") pod "maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" (UID: "cd93df27-63cc-42dd-a061-0aa66f695b8c") : secret "maas-api-e2e-shared-a-0a6921-serving-cert" not found Jul 13 15:20:25.859896 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.859872 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd93df27-63cc-42dd-a061-0aa66f695b8c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:25.869418 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:25.869396 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl5pj\" (UniqueName: \"kubernetes.io/projected/cd93df27-63cc-42dd-a061-0aa66f695b8c-kube-api-access-cl5pj\") pod \"maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:26.364655 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:26.364613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd93df27-63cc-42dd-a061-0aa66f695b8c-maas-api-tls\") pod \"maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:26.367191 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:26.367158 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd93df27-63cc-42dd-a061-0aa66f695b8c-maas-api-tls\") pod \"maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:26.554754 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:26.554723 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:26.691927 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:26.691901 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62"] Jul 13 15:20:26.694143 ip-10-0-133-95 kubenswrapper[2579]: W0713 15:20:26.694114 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd93df27_63cc_42dd_a061_0aa66f695b8c.slice/crio-eff6a603e8381408133bbf32b71c9f1607e7895ad4b5e5ce90610435dfa3566a WatchSource:0}: Error finding container eff6a603e8381408133bbf32b71c9f1607e7895ad4b5e5ce90610435dfa3566a: Status 404 returned error can't find the container with id eff6a603e8381408133bbf32b71c9f1607e7895ad4b5e5ce90610435dfa3566a Jul 13 15:20:27.550902 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:27.550862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" event={"ID":"cd93df27-63cc-42dd-a061-0aa66f695b8c","Type":"ContainerStarted","Data":"ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3"} Jul 13 15:20:27.551095 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:27.550925 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" event={"ID":"cd93df27-63cc-42dd-a061-0aa66f695b8c","Type":"ContainerStarted","Data":"eff6a603e8381408133bbf32b71c9f1607e7895ad4b5e5ce90610435dfa3566a"} Jul 13 15:20:27.551095 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:27.551051 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:27.573784 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:27.573718 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" podStartSLOduration=1.93511224 podStartE2EDuration="2.573693579s" totalImagesPullingTime="638.581339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:20:27.571630593 +0000 UTC m=+2077.855479814" watchObservedRunningTime="2026-07-13 15:20:27.573693579 +0000 UTC m=+2077.857542801" Jul 13 15:20:33.560955 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.560918 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:20:33.697769 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.697730 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z"] Jul 13 15:20:33.701884 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.701862 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:33.704681 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.704660 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-215a0a-serving-cert\"" Jul 13 15:20:33.714557 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.714533 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z"] Jul 13 15:20:33.732761 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.732730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cljd6\" (UniqueName: \"kubernetes.io/projected/72c914a4-fe24-4cf9-8844-939645ee6799-kube-api-access-cljd6\") pod \"maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z\" (UID: \"72c914a4-fe24-4cf9-8844-939645ee6799\") " pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:33.732981 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.732821 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72c914a4-fe24-4cf9-8844-939645ee6799-maas-api-tls\") pod \"maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z\" (UID: \"72c914a4-fe24-4cf9-8844-939645ee6799\") " pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:33.732981 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.732888 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c914a4-fe24-4cf9-8844-939645ee6799-openshift-service-ca\") pod \"maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z\" (UID: \"72c914a4-fe24-4cf9-8844-939645ee6799\") " pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:33.833818 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.833716 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72c914a4-fe24-4cf9-8844-939645ee6799-maas-api-tls\") pod \"maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z\" (UID: \"72c914a4-fe24-4cf9-8844-939645ee6799\") " pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:33.833818 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.833782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c914a4-fe24-4cf9-8844-939645ee6799-openshift-service-ca\") pod \"maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z\" (UID: \"72c914a4-fe24-4cf9-8844-939645ee6799\") " pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:33.834065 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.833831 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cljd6\" (UniqueName: \"kubernetes.io/projected/72c914a4-fe24-4cf9-8844-939645ee6799-kube-api-access-cljd6\") pod \"maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z\" (UID: \"72c914a4-fe24-4cf9-8844-939645ee6799\") " pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:33.834590 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.834564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c914a4-fe24-4cf9-8844-939645ee6799-openshift-service-ca\") pod \"maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z\" (UID: \"72c914a4-fe24-4cf9-8844-939645ee6799\") " pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:33.836216 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.836192 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72c914a4-fe24-4cf9-8844-939645ee6799-maas-api-tls\") pod \"maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z\" (UID: \"72c914a4-fe24-4cf9-8844-939645ee6799\") " pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:33.844016 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:33.843993 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cljd6\" (UniqueName: \"kubernetes.io/projected/72c914a4-fe24-4cf9-8844-939645ee6799-kube-api-access-cljd6\") pod \"maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z\" (UID: \"72c914a4-fe24-4cf9-8844-939645ee6799\") " pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:34.013196 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:34.013157 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:34.156179 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:34.156152 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z"] Jul 13 15:20:34.158599 ip-10-0-133-95 kubenswrapper[2579]: W0713 15:20:34.158572 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c914a4_fe24_4cf9_8844_939645ee6799.slice/crio-025765227d7df63c6c9578d83dded1ecd5e382026f14ad728be5f580ee4d276b WatchSource:0}: Error finding container 025765227d7df63c6c9578d83dded1ecd5e382026f14ad728be5f580ee4d276b: Status 404 returned error can't find the container with id 025765227d7df63c6c9578d83dded1ecd5e382026f14ad728be5f580ee4d276b Jul 13 15:20:34.583526 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:34.583450 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" event={"ID":"72c914a4-fe24-4cf9-8844-939645ee6799","Type":"ContainerStarted","Data":"025765227d7df63c6c9578d83dded1ecd5e382026f14ad728be5f580ee4d276b"} Jul 13 15:20:35.589528 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:35.589496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" event={"ID":"72c914a4-fe24-4cf9-8844-939645ee6799","Type":"ContainerStarted","Data":"5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd"} Jul 13 15:20:35.590021 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:35.589594 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:35.610819 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:35.610763 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" podStartSLOduration=2.184467096 podStartE2EDuration="2.610745335s" totalImagesPullingTime="426.278239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:20:35.609110282 +0000 UTC m=+2085.892959512" watchObservedRunningTime="2026-07-13 15:20:35.610745335 +0000 UTC m=+2085.894594552" Jul 13 15:20:41.599979 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:41.599947 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:20:50.326029 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:50.325901 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 15:20:50.340862 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:20:50.330548 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 15:25:50.353719 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:25:50.353687 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 15:25:50.360415 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:25:50.360394 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h8xdx_ccd01179-7f16-4d02-8647-4395aa09e576/ovn-acl-logging/0.log" Jul 13 15:26:03.130601 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:03.130568 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62"] Jul 13 15:26:03.131058 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:03.130756 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" podUID="cd93df27-63cc-42dd-a061-0aa66f695b8c" containerName="maas-api" containerID="cri-o://ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3" gracePeriod=30 Jul 13 15:26:03.375903 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:03.375876 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:26:03.477217 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:03.477119 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd93df27-63cc-42dd-a061-0aa66f695b8c-openshift-service-ca\") pod \"cd93df27-63cc-42dd-a061-0aa66f695b8c\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " Jul 13 15:26:03.477217 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:03.477162 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl5pj\" (UniqueName: \"kubernetes.io/projected/cd93df27-63cc-42dd-a061-0aa66f695b8c-kube-api-access-cl5pj\") pod \"cd93df27-63cc-42dd-a061-0aa66f695b8c\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " Jul 13 15:26:03.477217 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:03.477214 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd93df27-63cc-42dd-a061-0aa66f695b8c-maas-api-tls\") pod \"cd93df27-63cc-42dd-a061-0aa66f695b8c\" (UID: \"cd93df27-63cc-42dd-a061-0aa66f695b8c\") " Jul 13 15:26:03.477527 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:03.477503 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd93df27-63cc-42dd-a061-0aa66f695b8c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cd93df27-63cc-42dd-a061-0aa66f695b8c" (UID: "cd93df27-63cc-42dd-a061-0aa66f695b8c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:26:03.479323 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:03.479293 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd93df27-63cc-42dd-a061-0aa66f695b8c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cd93df27-63cc-42dd-a061-0aa66f695b8c" (UID: "cd93df27-63cc-42dd-a061-0aa66f695b8c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:26:03.479455 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:03.479365 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd93df27-63cc-42dd-a061-0aa66f695b8c-kube-api-access-cl5pj" (OuterVolumeSpecName: "kube-api-access-cl5pj") pod "cd93df27-63cc-42dd-a061-0aa66f695b8c" (UID: "cd93df27-63cc-42dd-a061-0aa66f695b8c"). InnerVolumeSpecName "kube-api-access-cl5pj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:26:03.578271 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:03.578229 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd93df27-63cc-42dd-a061-0aa66f695b8c-openshift-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:26:03.578271 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:03.578262 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl5pj\" (UniqueName: \"kubernetes.io/projected/cd93df27-63cc-42dd-a061-0aa66f695b8c-kube-api-access-cl5pj\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:26:03.578271 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:03.578274 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd93df27-63cc-42dd-a061-0aa66f695b8c-maas-api-tls\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:26:04.103645 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:04.103614 2579 generic.go:356] "Generic (PLEG): container finished" podID="cd93df27-63cc-42dd-a061-0aa66f695b8c" containerID="ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3" exitCode=0 Jul 13 15:26:04.103877 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:04.103654 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" Jul 13 15:26:04.103877 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:04.103714 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" event={"ID":"cd93df27-63cc-42dd-a061-0aa66f695b8c","Type":"ContainerDied","Data":"ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3"} Jul 13 15:26:04.103877 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:04.103793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62" event={"ID":"cd93df27-63cc-42dd-a061-0aa66f695b8c","Type":"ContainerDied","Data":"eff6a603e8381408133bbf32b71c9f1607e7895ad4b5e5ce90610435dfa3566a"} Jul 13 15:26:04.103877 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:04.103826 2579 scope.go:117] "RemoveContainer" containerID="ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3" Jul 13 15:26:04.112900 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:04.112883 2579 scope.go:117] "RemoveContainer" containerID="ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3" Jul 13 15:26:04.113167 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:26:04.113148 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3\": container with ID starting with ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3 not found: ID does not exist" containerID="ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3" Jul 13 15:26:04.113276 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:04.113180 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3"} err="failed to get container status \"ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3\": rpc error: code = NotFound desc = could not find container \"ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3\": container with ID starting with ec36fce71d14e3e19e430d2d9a834c68643e2e724fe509bdcf7ad8f534db7af3 not found: ID does not exist" Jul 13 15:26:04.128704 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:04.128665 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62"] Jul 13 15:26:04.133518 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:04.133486 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0a6921-84c656d95b-ngm62"] Jul 13 15:26:04.206132 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:04.206094 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd93df27-63cc-42dd-a061-0aa66f695b8c" path="/var/lib/kubelet/pods/cd93df27-63cc-42dd-a061-0aa66f695b8c/volumes" Jul 13 15:26:46.915438 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:46.915393 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z"] Jul 13 15:26:46.916010 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:46.915671 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" podUID="72c914a4-fe24-4cf9-8844-939645ee6799" containerName="maas-api" containerID="cri-o://5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd" gracePeriod=30 Jul 13 15:26:47.164119 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.164091 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:26:47.248990 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.248899 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cljd6\" (UniqueName: \"kubernetes.io/projected/72c914a4-fe24-4cf9-8844-939645ee6799-kube-api-access-cljd6\") pod \"72c914a4-fe24-4cf9-8844-939645ee6799\" (UID: \"72c914a4-fe24-4cf9-8844-939645ee6799\") " Jul 13 15:26:47.248990 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.248944 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c914a4-fe24-4cf9-8844-939645ee6799-openshift-service-ca\") pod \"72c914a4-fe24-4cf9-8844-939645ee6799\" (UID: \"72c914a4-fe24-4cf9-8844-939645ee6799\") " Jul 13 15:26:47.248990 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.248980 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72c914a4-fe24-4cf9-8844-939645ee6799-maas-api-tls\") pod \"72c914a4-fe24-4cf9-8844-939645ee6799\" (UID: \"72c914a4-fe24-4cf9-8844-939645ee6799\") " Jul 13 15:26:47.249380 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.249322 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72c914a4-fe24-4cf9-8844-939645ee6799-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "72c914a4-fe24-4cf9-8844-939645ee6799" (UID: "72c914a4-fe24-4cf9-8844-939645ee6799"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:26:47.251119 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.251093 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72c914a4-fe24-4cf9-8844-939645ee6799-kube-api-access-cljd6" (OuterVolumeSpecName: "kube-api-access-cljd6") pod "72c914a4-fe24-4cf9-8844-939645ee6799" (UID: "72c914a4-fe24-4cf9-8844-939645ee6799"). InnerVolumeSpecName "kube-api-access-cljd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:26:47.251212 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.251189 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72c914a4-fe24-4cf9-8844-939645ee6799-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "72c914a4-fe24-4cf9-8844-939645ee6799" (UID: "72c914a4-fe24-4cf9-8844-939645ee6799"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:26:47.305866 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.305832 2579 generic.go:356] "Generic (PLEG): container finished" podID="72c914a4-fe24-4cf9-8844-939645ee6799" containerID="5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd" exitCode=0 Jul 13 15:26:47.305866 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.305871 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" event={"ID":"72c914a4-fe24-4cf9-8844-939645ee6799","Type":"ContainerDied","Data":"5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd"} Jul 13 15:26:47.306124 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.305885 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" Jul 13 15:26:47.306124 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.305914 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z" event={"ID":"72c914a4-fe24-4cf9-8844-939645ee6799","Type":"ContainerDied","Data":"025765227d7df63c6c9578d83dded1ecd5e382026f14ad728be5f580ee4d276b"} Jul 13 15:26:47.306124 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.305936 2579 scope.go:117] "RemoveContainer" containerID="5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd" Jul 13 15:26:47.316257 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.316171 2579 scope.go:117] "RemoveContainer" containerID="5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd" Jul 13 15:26:47.317018 ip-10-0-133-95 kubenswrapper[2579]: E0713 15:26:47.316987 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd\": container with ID starting with 5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd not found: ID does not exist" containerID="5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd" Jul 13 15:26:47.317144 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.317028 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd"} err="failed to get container status \"5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd\": rpc error: code = NotFound desc = could not find container \"5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd\": container with ID starting with 5c76d72040a16d0351692bb13e46ec2b8f1c9a2e155251d9f541e16d9ab3c1cd not found: ID does not exist" Jul 13 15:26:47.329721 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.329654 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z"] Jul 13 15:26:47.331599 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.331574 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-215a0a-89b9595c6-xxc9z"] Jul 13 15:26:47.349954 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.349925 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cljd6\" (UniqueName: \"kubernetes.io/projected/72c914a4-fe24-4cf9-8844-939645ee6799-kube-api-access-cljd6\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:26:47.349954 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.349953 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72c914a4-fe24-4cf9-8844-939645ee6799-openshift-service-ca\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:26:47.350152 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:47.349967 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72c914a4-fe24-4cf9-8844-939645ee6799-maas-api-tls\") on node \"ip-10-0-133-95.ec2.internal\" DevicePath \"\"" Jul 13 15:26:48.205925 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:26:48.205893 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72c914a4-fe24-4cf9-8844-939645ee6799" path="/var/lib/kubelet/pods/72c914a4-fe24-4cf9-8844-939645ee6799/volumes" Jul 13 15:27:00.485577 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:00.485541 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-55f6645595-f6c74_c1f770c4-a7ae-4be7-a128-1ef10ca4a241/maas-api/0.log" Jul 13 15:27:00.860253 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:00.860214 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5d9474b7d6-vpwbb_ebf96e7a-c817-41f2-bea1-f7363fc190c8/manager/0.log" Jul 13 15:27:01.225888 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:01.225806 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6496967d77-bm88l_2a298642-2cb0-4152-aa36-e64718da5f2a/copy-manifests/0.log" Jul 13 15:27:01.234739 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:01.234710 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6496967d77-bm88l_2a298642-2cb0-4152-aa36-e64718da5f2a/manager/0.log" Jul 13 15:27:01.649591 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:01.649562 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-dsqzf_bdd6c496-7cf9-4596-a262-1ad1e610c87e/postgres/0.log" Jul 13 15:27:03.870366 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:03.870316 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h4q7j_36b9d459-50da-4cda-a914-d28075cb6089/manager/0.log" Jul 13 15:27:04.366352 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:04.366308 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-64s22_7022f291-a695-427a-b621-13f23623d858/discovery/0.log" Jul 13 15:27:05.991160 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:05.991125 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-klcgd_f4cae382-e512-44ca-be40-0bc51b22a58a/main/0.log" Jul 13 15:27:14.460820 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:14.460781 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zclht_687ef339-93d5-47be-931e-aacc68f61a06/global-pull-secret-syncer/0.log" Jul 13 15:27:14.597466 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:14.597422 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tw45d_a80b9629-203e-4dfa-a1ef-548a3a668e06/konnectivity-agent/0.log" Jul 13 15:27:14.655270 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:14.655237 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-95.ec2.internal_a4e72ecf078b84cf1a21b2a5799579a9/haproxy/0.log" Jul 13 15:27:19.879555 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:19.879466 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h4q7j_36b9d459-50da-4cda-a914-d28075cb6089/manager/0.log" Jul 13 15:27:22.146561 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.146524 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4czr7_3aae023a-9895-49c6-a9a0-b203e6404c24/node-exporter/0.log" Jul 13 15:27:22.184110 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.184082 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4czr7_3aae023a-9895-49c6-a9a0-b203e6404c24/kube-rbac-proxy/0.log" Jul 13 15:27:22.219275 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.219242 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4czr7_3aae023a-9895-49c6-a9a0-b203e6404c24/init-textfile/0.log" Jul 13 15:27:22.641512 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.641484 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b378907a-7514-44fb-ad08-62c15acf4ee4/prometheus/0.log" Jul 13 15:27:22.672833 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.672799 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b378907a-7514-44fb-ad08-62c15acf4ee4/config-reloader/0.log" Jul 13 15:27:22.709307 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.709281 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b378907a-7514-44fb-ad08-62c15acf4ee4/thanos-sidecar/0.log" Jul 13 15:27:22.753906 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.753878 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b378907a-7514-44fb-ad08-62c15acf4ee4/kube-rbac-proxy-web/0.log" Jul 13 15:27:22.786125 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.786099 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b378907a-7514-44fb-ad08-62c15acf4ee4/kube-rbac-proxy/0.log" Jul 13 15:27:22.836054 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.836017 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b378907a-7514-44fb-ad08-62c15acf4ee4/kube-rbac-proxy-thanos/0.log" Jul 13 15:27:22.870283 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.870250 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b378907a-7514-44fb-ad08-62c15acf4ee4/init-config-reloader/0.log" Jul 13 15:27:22.907164 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.907073 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-j5z2t_89462f5c-675c-484a-8a10-760a14d47242/prometheus-operator/0.log" Jul 13 15:27:22.934516 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.934489 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-j5z2t_89462f5c-675c-484a-8a10-760a14d47242/kube-rbac-proxy/0.log" Jul 13 15:27:22.965069 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:22.965040 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-srt9j_59057457-d132-4527-919c-5c097bfcd8ad/prometheus-operator-admission-webhook/0.log" Jul 13 15:27:23.133229 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:23.133192 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696dcb9849-6nxjk_ade3f4e2-a136-4da9-9538-d2d271880738/thanos-query/0.log" Jul 13 15:27:23.168527 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:23.168444 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696dcb9849-6nxjk_ade3f4e2-a136-4da9-9538-d2d271880738/kube-rbac-proxy-web/0.log" Jul 13 15:27:23.200069 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:23.200019 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696dcb9849-6nxjk_ade3f4e2-a136-4da9-9538-d2d271880738/kube-rbac-proxy/0.log" Jul 13 15:27:23.254759 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:23.254726 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696dcb9849-6nxjk_ade3f4e2-a136-4da9-9538-d2d271880738/prom-label-proxy/0.log" Jul 13 15:27:23.281111 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:23.281082 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696dcb9849-6nxjk_ade3f4e2-a136-4da9-9538-d2d271880738/kube-rbac-proxy-rules/0.log" Jul 13 15:27:23.307407 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:23.307376 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696dcb9849-6nxjk_ade3f4e2-a136-4da9-9538-d2d271880738/kube-rbac-proxy-metrics/0.log" Jul 13 15:27:24.494164 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.494131 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf"] Jul 13 15:27:24.494696 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.494676 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd93df27-63cc-42dd-a061-0aa66f695b8c" containerName="maas-api" Jul 13 15:27:24.494780 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.494700 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd93df27-63cc-42dd-a061-0aa66f695b8c" containerName="maas-api" Jul 13 15:27:24.494780 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.494717 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c914a4-fe24-4cf9-8844-939645ee6799" containerName="maas-api" Jul 13 15:27:24.494780 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.494725 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c914a4-fe24-4cf9-8844-939645ee6799" containerName="maas-api" Jul 13 15:27:24.494937 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.494831 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="72c914a4-fe24-4cf9-8844-939645ee6799" containerName="maas-api" Jul 13 15:27:24.494937 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.494846 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd93df27-63cc-42dd-a061-0aa66f695b8c" containerName="maas-api" Jul 13 15:27:24.497986 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.497963 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.501660 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.501638 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g54mc\"/\"openshift-service-ca.crt\"" Jul 13 15:27:24.501803 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.501677 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g54mc\"/\"kube-root-ca.crt\"" Jul 13 15:27:24.503919 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.503897 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g54mc\"/\"default-dockercfg-f7xfv\"" Jul 13 15:27:24.509631 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.509606 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf"] Jul 13 15:27:24.577143 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.577104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dw2s\" (UniqueName: \"kubernetes.io/projected/6771887f-41a6-48e1-844d-5cc31f2596d5-kube-api-access-5dw2s\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.577143 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.577147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6771887f-41a6-48e1-844d-5cc31f2596d5-lib-modules\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.577430 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.577250 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6771887f-41a6-48e1-844d-5cc31f2596d5-proc\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.577430 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.577277 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6771887f-41a6-48e1-844d-5cc31f2596d5-sys\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.577430 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.577295 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6771887f-41a6-48e1-844d-5cc31f2596d5-podres\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.677778 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.677740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6771887f-41a6-48e1-844d-5cc31f2596d5-proc\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.677778 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.677780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6771887f-41a6-48e1-844d-5cc31f2596d5-sys\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.678014 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.677799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6771887f-41a6-48e1-844d-5cc31f2596d5-podres\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.678014 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.677841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dw2s\" (UniqueName: \"kubernetes.io/projected/6771887f-41a6-48e1-844d-5cc31f2596d5-kube-api-access-5dw2s\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.678014 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.677872 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6771887f-41a6-48e1-844d-5cc31f2596d5-proc\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.678014 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.677889 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6771887f-41a6-48e1-844d-5cc31f2596d5-sys\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.678014 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.677879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6771887f-41a6-48e1-844d-5cc31f2596d5-lib-modules\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.678014 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.677947 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6771887f-41a6-48e1-844d-5cc31f2596d5-podres\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.678014 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.677972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6771887f-41a6-48e1-844d-5cc31f2596d5-lib-modules\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.688300 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.688275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dw2s\" (UniqueName: \"kubernetes.io/projected/6771887f-41a6-48e1-844d-5cc31f2596d5-kube-api-access-5dw2s\") pod \"perf-node-gather-daemonset-6cwhf\" (UID: \"6771887f-41a6-48e1-844d-5cc31f2596d5\") " pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.808642 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.808555 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:24.951995 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:24.951968 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf"] Jul 13 15:27:24.953909 ip-10-0-133-95 kubenswrapper[2579]: W0713 15:27:24.953881 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6771887f_41a6_48e1_844d_5cc31f2596d5.slice/crio-56a2e99f2b9fa66aa0a8c750c97758975e1ad421e18cdc3dadc01f95a86f5e12 WatchSource:0}: Error finding container 56a2e99f2b9fa66aa0a8c750c97758975e1ad421e18cdc3dadc01f95a86f5e12: Status 404 returned error can't find the container with id 56a2e99f2b9fa66aa0a8c750c97758975e1ad421e18cdc3dadc01f95a86f5e12 Jul 13 15:27:25.477413 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:25.477372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" event={"ID":"6771887f-41a6-48e1-844d-5cc31f2596d5","Type":"ContainerStarted","Data":"7b1d872a4b13bd9e8ec321b31b272398d3a892ef8d28f425b23d1134f2854f66"} Jul 13 15:27:25.477593 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:25.477434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" event={"ID":"6771887f-41a6-48e1-844d-5cc31f2596d5","Type":"ContainerStarted","Data":"56a2e99f2b9fa66aa0a8c750c97758975e1ad421e18cdc3dadc01f95a86f5e12"} Jul 13 15:27:25.477593 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:25.477455 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:25.498225 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:25.498175 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" podStartSLOduration=1.49815908 podStartE2EDuration="1.49815908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:27:25.497997502 +0000 UTC m=+2495.781846719" watchObservedRunningTime="2026-07-13 15:27:25.49815908 +0000 UTC m=+2495.782008298" Jul 13 15:27:25.969607 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:25.969572 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-bz27r_1920ad9c-d7a4-4fd7-b195-61a10b5a7699/download-server/0.log" Jul 13 15:27:28.010197 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:28.010166 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fkvtf_619758d9-bb0f-4d1a-9072-b078268744e8/dns/0.log" Jul 13 15:27:28.038779 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:28.038749 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fkvtf_619758d9-bb0f-4d1a-9072-b078268744e8/kube-rbac-proxy/0.log" Jul 13 15:27:28.151890 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:28.151863 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lkrg2_25809cb4-9092-4b5b-bdf8-c1ddf28a4fa1/dns-node-resolver/0.log" Jul 13 15:27:28.825374 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:28.825324 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-89rws_ac81ad92-c6e5-4a69-a093-ca92f73b965c/node-ca/0.log" Jul 13 15:27:30.231781 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:30.231734 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-64s22_7022f291-a695-427a-b621-13f23623d858/discovery/0.log" Jul 13 15:27:31.225486 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:31.225448 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-94wgn_7285b985-9f19-4d1e-aa48-28b5fd21e53c/serve-healthcheck-canary/0.log" Jul 13 15:27:31.492301 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:31.492221 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g54mc/perf-node-gather-daemonset-6cwhf" Jul 13 15:27:31.913882 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:31.913848 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-5xtgw_86e0453b-1b4c-4edd-9cd5-ddff7ba0e932/insights-operator/0.log" Jul 13 15:27:31.915140 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:31.915116 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-5xtgw_86e0453b-1b4c-4edd-9cd5-ddff7ba0e932/insights-operator/1.log" Jul 13 15:27:32.116080 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:32.116050 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pn5dm_bdd25561-c565-40b6-b743-a7832ded9c13/kube-rbac-proxy/0.log" Jul 13 15:27:32.142309 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:32.142282 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pn5dm_bdd25561-c565-40b6-b743-a7832ded9c13/exporter/0.log" Jul 13 15:27:32.169150 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:32.169073 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pn5dm_bdd25561-c565-40b6-b743-a7832ded9c13/extractor/0.log" Jul 13 15:27:34.888949 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:34.888913 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-55f6645595-f6c74_c1f770c4-a7ae-4be7-a128-1ef10ca4a241/maas-api/0.log" Jul 13 15:27:35.122660 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:35.122624 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5d9474b7d6-vpwbb_ebf96e7a-c817-41f2-bea1-f7363fc190c8/manager/0.log" Jul 13 15:27:35.238277 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:35.238193 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-64s22_7022f291-a695-427a-b621-13f23623d858/discovery/0.log" Jul 13 15:27:35.245118 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:35.245088 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6496967d77-bm88l_2a298642-2cb0-4152-aa36-e64718da5f2a/manager/0.log" Jul 13 15:27:35.267333 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:35.267303 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6496967d77-bm88l_2a298642-2cb0-4152-aa36-e64718da5f2a/copy-manifests/0.log" Jul 13 15:27:35.464468 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:35.464443 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-dsqzf_bdd6c496-7cf9-4596-a262-1ad1e610c87e/postgres/0.log" Jul 13 15:27:36.814932 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:36.814898 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-64s22_7022f291-a695-427a-b621-13f23623d858/discovery/0.log" Jul 13 15:27:36.911327 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:36.911295 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d4d649b46-fm85m_4ef5fe11-1d11-4bed-a45d-260b3ca15bb0/manager/0.log" Jul 13 15:27:41.976131 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:41.976102 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-zltvn_0727e9e7-31e6-4544-9658-9b431a12408a/migrator/0.log" Jul 13 15:27:42.008248 ip-10-0-133-95 kubenswrapper[2579]: I0713 15:27:42.008218 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-zltvn_0727e9e7-31e6-4544-9658-9b431a12408a/graceful-termination/0.log"