Aug 05 16:38:54.240633 ip-10-0-132-4 systemd[1]: Starting Kubernetes Kubelet... Aug 05 16:38:54.640190 ip-10-0-132-4 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 16:38:54.640190 ip-10-0-132-4 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 05 16:38:54.640190 ip-10-0-132-4 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 16:38:54.640190 ip-10-0-132-4 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 05 16:38:54.640190 ip-10-0-132-4 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 16:38:54.641114 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.641000 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 05 16:38:54.646379 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646363 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 16:38:54.646379 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646378 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646381 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646386 2583 feature_gate.go:328] unrecognized feature gate: Example Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646389 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646392 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646395 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646398 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646403 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646407 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646410 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646413 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646415 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646418 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646421 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646425 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646428 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646431 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646433 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646436 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 16:38:54.646447 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646439 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646441 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646444 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646447 2583 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646449 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646452 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646455 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646458 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646461 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646464 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646466 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646469 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646471 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646474 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646477 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646479 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646482 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646484 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 16:38:54.646900 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.646487 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647219 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647225 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647230 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647233 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647236 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647239 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647241 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647244 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647247 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647250 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647252 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647255 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647257 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647260 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647262 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647265 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647268 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647270 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 16:38:54.647332 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647273 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647275 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647278 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647280 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647284 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647287 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647289 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647291 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647294 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647296 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647299 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647301 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647303 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647306 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647309 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647312 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647315 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647318 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647320 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647323 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 16:38:54.647878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647325 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647328 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647330 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647333 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647336 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647338 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647341 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647353 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647356 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647358 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647361 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647363 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647366 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647368 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647371 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647373 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647376 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647378 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647381 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 16:38:54.648388 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647383 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647387 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.647391 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648075 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648082 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648085 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648089 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648091 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648095 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648098 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648101 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648103 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648106 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648110 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648113 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648117 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648120 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648123 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648125 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 16:38:54.648842 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648128 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648131 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648133 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648136 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648139 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648141 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648145 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648147 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648150 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648153 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648155 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648158 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648160 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648163 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648165 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648175 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648179 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648181 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648184 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648186 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 16:38:54.649327 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648190 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648194 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648207 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648210 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648213 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648216 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648219 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648222 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648226 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648229 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648231 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648234 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648237 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648240 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648243 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648245 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648248 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648250 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648253 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 16:38:54.649834 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648255 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648258 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648260 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648263 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648265 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648268 2583 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648270 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648273 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648275 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648277 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648280 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648282 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648284 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648287 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648289 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648292 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648295 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648297 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648300 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648302 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 16:38:54.650294 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648304 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648309 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648312 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648314 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648317 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648319 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648322 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648325 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648327 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648330 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648332 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648335 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648337 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648340 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648354 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648357 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648360 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648362 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648365 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648368 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 16:38:54.650800 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648372 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648375 2583 feature_gate.go:328] unrecognized feature gate: Example Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648377 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648380 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648762 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648768 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648772 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648775 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648778 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648781 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648783 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648786 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648793 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648796 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648798 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648801 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648804 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648806 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648809 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648811 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 16:38:54.651286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648814 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648816 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648818 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648821 2583 feature_gate.go:328] unrecognized feature gate: Example Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648823 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648826 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648828 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648831 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648834 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648836 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648839 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648841 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648843 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648846 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648849 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648851 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648854 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648857 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648860 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648862 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 16:38:54.651783 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648865 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648867 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648870 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648872 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648875 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648878 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648881 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648883 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648887 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648890 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648893 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648897 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648900 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648903 2583 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648907 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648910 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648913 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648916 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648918 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 16:38:54.652274 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648921 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648924 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648926 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648929 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648931 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648934 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648936 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648938 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648941 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648943 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648947 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648950 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648953 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648956 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648958 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648961 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648964 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648967 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648969 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 16:38:54.652776 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648972 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648974 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648977 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648980 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648982 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648985 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648987 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648990 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648992 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648995 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.648997 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649000 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649002 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649005 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649008 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649011 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649013 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649016 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649018 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649020 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 16:38:54.653231 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649023 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649025 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649028 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649031 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649033 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649110 2583 flags.go:64] FLAG: --address="0.0.0.0" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649119 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649129 2583 flags.go:64] FLAG: --anonymous-auth="true" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649136 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649143 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649148 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649152 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649156 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649159 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649162 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649165 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649169 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649172 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649175 2583 flags.go:64] FLAG: --cgroup-root="" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649178 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649181 2583 flags.go:64] FLAG: --client-ca-file="" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649184 2583 flags.go:64] FLAG: --cloud-provider="external" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649187 2583 flags.go:64] FLAG: --cluster-dns="[]" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649191 2583 flags.go:64] FLAG: --cluster-domain="" Aug 05 16:38:54.653748 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649194 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649197 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649200 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649203 2583 flags.go:64] FLAG: --container-log-max-files="5" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649207 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649210 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649213 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649216 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649219 2583 flags.go:64] FLAG: --contention-profiling="false" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649222 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649224 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649230 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649233 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649237 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649240 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649243 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649246 2583 flags.go:64] FLAG: --enable-load-reader="false" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649249 2583 flags.go:64] FLAG: --enable-server="true" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649252 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649257 2583 flags.go:64] FLAG: --event-burst="100" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649261 2583 flags.go:64] FLAG: --event-qps="50" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649264 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649266 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649269 2583 flags.go:64] FLAG: --eviction-hard="" Aug 05 16:38:54.654311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649273 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649276 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649278 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649281 2583 flags.go:64] FLAG: --eviction-soft="" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649284 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649287 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649290 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649293 2583 flags.go:64] FLAG: --experimental-mounter-path="" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649296 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649299 2583 flags.go:64] FLAG: --fail-swap-on="true" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649302 2583 flags.go:64] FLAG: --feature-gates="" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649306 2583 flags.go:64] FLAG: --file-check-frequency="20s" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649309 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649312 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649315 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649318 2583 flags.go:64] FLAG: --healthz-port="10248" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649321 2583 flags.go:64] FLAG: --help="false" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649324 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-132-4.ec2.internal" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649326 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649331 2583 flags.go:64] FLAG: --http-check-frequency="20s" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649334 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649337 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649340 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649360 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 05 16:38:54.654885 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649365 2583 flags.go:64] FLAG: --image-service-endpoint="" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649371 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649374 2583 flags.go:64] FLAG: --kube-api-burst="100" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649378 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649381 2583 flags.go:64] FLAG: --kube-api-qps="50" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649384 2583 flags.go:64] FLAG: --kube-reserved="" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649387 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649390 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649393 2583 flags.go:64] FLAG: --kubelet-cgroups="" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649396 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649399 2583 flags.go:64] FLAG: --lock-file="" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649401 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649404 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649408 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649413 2583 flags.go:64] FLAG: --log-json-split-stream="false" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649416 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649419 2583 flags.go:64] FLAG: --log-text-split-stream="false" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649423 2583 flags.go:64] FLAG: --logging-format="text" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649426 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649429 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649433 2583 flags.go:64] FLAG: --manifest-url="" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649436 2583 flags.go:64] FLAG: --manifest-url-header="" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649440 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649443 2583 flags.go:64] FLAG: --max-open-files="1000000" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649447 2583 flags.go:64] FLAG: --max-pods="110" Aug 05 16:38:54.655503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649450 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649453 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649458 2583 flags.go:64] FLAG: --memory-manager-policy="None" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649460 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649463 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649466 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649469 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649476 2583 flags.go:64] FLAG: --node-status-max-images="50" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649480 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649483 2583 flags.go:64] FLAG: --oom-score-adj="-999" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649487 2583 flags.go:64] FLAG: --pod-cidr="" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649490 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649495 2583 flags.go:64] FLAG: --pod-manifest-path="" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649498 2583 flags.go:64] FLAG: --pod-max-pids="-1" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649502 2583 flags.go:64] FLAG: --pods-per-core="0" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649505 2583 flags.go:64] FLAG: --port="10250" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649507 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649510 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e0c3c327abd78059" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649514 2583 flags.go:64] FLAG: --qos-reserved="" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649517 2583 flags.go:64] FLAG: --read-only-port="10255" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649519 2583 flags.go:64] FLAG: --register-node="true" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649522 2583 flags.go:64] FLAG: --register-with-taints="" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649526 2583 flags.go:64] FLAG: --registry-burst="10" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649529 2583 flags.go:64] FLAG: --registry-qps="5" Aug 05 16:38:54.656647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649531 2583 flags.go:64] FLAG: --reserved-cpus="" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649534 2583 flags.go:64] FLAG: --reserved-memory="" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649538 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649541 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649544 2583 flags.go:64] FLAG: --rotate-certificates="false" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649547 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649549 2583 flags.go:64] FLAG: --runonce="false" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649552 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649555 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649558 2583 flags.go:64] FLAG: --seccomp-default="false" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649561 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649565 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649568 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649571 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649574 2583 flags.go:64] FLAG: --storage-driver-password="root" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649577 2583 flags.go:64] FLAG: --storage-driver-secure="false" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649581 2583 flags.go:64] FLAG: --storage-driver-table="stats" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649584 2583 flags.go:64] FLAG: --storage-driver-user="root" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649586 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649590 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649593 2583 flags.go:64] FLAG: --system-cgroups="" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649596 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649601 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649604 2583 flags.go:64] FLAG: --tls-cert-file="" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649607 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 05 16:38:55.816544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649611 2583 flags.go:64] FLAG: --tls-min-version="" Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649614 2583 flags.go:64] FLAG: --tls-private-key-file="" Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649617 2583 flags.go:64] FLAG: --topology-manager-policy="none" Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649619 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649622 2583 flags.go:64] FLAG: --topology-manager-scope="container" Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649626 2583 flags.go:64] FLAG: --v="2" Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649630 2583 flags.go:64] FLAG: --version="false" Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649633 2583 flags.go:64] FLAG: --vmodule="" Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649637 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.649640 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649756 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649759 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649763 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649765 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649768 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649771 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649773 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649776 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649780 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649783 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649785 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649790 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 16:38:55.817633 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649793 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649797 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649801 2583 feature_gate.go:328] unrecognized feature gate: Example Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649803 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649806 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649809 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649814 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649817 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649819 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649822 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649825 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649827 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649829 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649833 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649837 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649840 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649843 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649846 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649848 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 16:38:55.818684 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649851 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649853 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649856 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649858 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649861 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649864 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649867 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649869 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649871 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649875 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649878 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649880 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649883 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649885 2583 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649889 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649893 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649897 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649900 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649903 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649905 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 16:38:55.819445 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649908 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649911 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649914 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649916 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649918 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649921 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649923 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649926 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649928 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649931 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649933 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649936 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649938 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649941 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649943 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649946 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649948 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649951 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649954 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649956 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 16:38:55.820125 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649959 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649963 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649965 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649968 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649970 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649973 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649976 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649979 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649981 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649984 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649987 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649989 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649992 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649996 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.649998 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650001 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650003 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650006 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650008 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650011 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 16:38:55.820909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650013 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650016 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650018 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650021 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650023 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650026 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650028 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:54.650031 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:54.650036 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.816784 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.816803 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.817596 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.817614 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817705 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817714 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 16:38:55.821512 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817720 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817725 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817730 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817734 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817739 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817743 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817747 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817751 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817756 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817760 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817765 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817771 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817779 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817785 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817790 2583 feature_gate.go:328] unrecognized feature gate: Example Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817795 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817799 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817803 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817808 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 16:38:55.821885 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817812 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817818 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817822 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817829 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817834 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817839 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817844 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817849 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817855 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817860 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817865 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817870 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817875 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817879 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817884 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817888 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817893 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817897 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817901 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 16:38:55.822418 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817906 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817910 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817914 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817918 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817923 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817927 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817931 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817935 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817940 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817945 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817949 2583 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817953 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817958 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817962 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817967 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817971 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817975 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817979 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817984 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817989 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 16:38:55.822878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817993 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.817998 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818003 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818008 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818012 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818016 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818021 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818025 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818029 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818034 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818038 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818042 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818047 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818051 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818055 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818060 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818064 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818068 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818073 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 16:38:55.823542 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818077 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818081 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818086 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818090 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818094 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818098 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818103 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818107 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818112 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818116 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818121 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818125 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818129 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818134 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818139 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818143 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818148 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818153 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818157 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 16:38:55.824029 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818161 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.818170 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818372 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818381 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818387 2583 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818392 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818396 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818401 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818408 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818414 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818420 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818425 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818430 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818435 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818439 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 16:38:55.824582 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818443 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818448 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818452 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818456 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818461 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818465 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818469 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818475 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818479 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818483 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818487 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818493 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818500 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818506 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818511 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818517 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818521 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818526 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818530 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 16:38:55.824957 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818535 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818539 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818543 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818547 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818552 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818556 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818561 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818564 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818568 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818573 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818577 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818582 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818586 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818591 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818595 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818600 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818604 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818608 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818611 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818615 2583 feature_gate.go:328] unrecognized feature gate: Example Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818619 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 16:38:55.825588 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818623 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818627 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818631 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818635 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818639 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818645 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818649 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818653 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818659 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818664 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818669 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818673 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818676 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818681 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818685 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818689 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818693 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818697 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818701 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818705 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 16:38:55.826094 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818709 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818713 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818718 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818722 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818726 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818731 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818735 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818739 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818744 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818748 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818752 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818756 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818761 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818767 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818773 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818779 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818784 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818788 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818792 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 16:38:55.826831 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818796 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818801 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818806 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818810 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818815 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818819 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:55.818823 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.818831 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.819013 2583 server.go:962] "Client rotation is on, will bootstrap in background" Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.822066 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.823454 2583 server.go:1019] "Starting client certificate rotation" Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.823563 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.824336 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 16:38:55.827575 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.825961 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 16:38:55.829175 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.829156 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 16:38:55.842370 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.842347 2583 log.go:25] "Validated CRI v1 runtime API" Aug 05 16:38:55.844530 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.844516 2583 log.go:25] "Validated CRI v1 image API" Aug 05 16:38:55.845300 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.845286 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 05 16:38:55.847854 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.847828 2583 fs.go:135] Filesystem UUIDs: map[42d3b286-cc1a-46bc-9fd7-478aef8e6b00:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c0d5a3c2-6e7b-4133-8817-e3441c195801:/dev/nvme0n1p4] Aug 05 16:38:55.847942 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.847854 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 05 16:38:55.852903 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.852882 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 16:38:55.853074 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.852921 2583 manager.go:216] Machine: {Timestamp:2026-08-05 16:38:55.851572891 +0000 UTC m=+0.336230804 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099253 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21322c0247bd17db2c99cb7b34b9c9 SystemUUID:ec21322c-0247-bd17-db2c-99cb7b34b9c9 BootID:364f20d9-cea7-4312-b374-2f83de36a691 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:84:ca:cf:ad:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:84:ca:cf:ad:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:33:d2:11:ee:40 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 05 16:38:55.853167 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.853075 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 05 16:38:55.853234 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.853186 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 05 16:38:55.857085 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.857059 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 05 16:38:55.857282 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.857090 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 05 16:38:55.857893 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.857881 2583 topology_manager.go:138] "Creating topology manager with none policy" Aug 05 16:38:55.857945 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.857896 2583 container_manager_linux.go:309] "Creating device plugin manager" Aug 05 16:38:55.857945 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.857908 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 16:38:55.858647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.858634 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 16:38:55.859704 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.859690 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 05 16:38:55.862959 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.862947 2583 state_mem.go:36] "Initialized new in-memory state store" Aug 05 16:38:55.863090 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.863080 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 05 16:38:55.863129 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.863110 2583 kubelet.go:486] "Attempting to sync node with API server" Aug 05 16:38:55.863163 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.863148 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 05 16:38:55.863163 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.863160 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 05 16:38:55.863248 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.863240 2583 kubelet.go:398] "Adding apiserver pod source" Aug 05 16:38:55.863279 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.863259 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 05 16:38:55.863674 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.863662 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 16:38:55.863723 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.863681 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 16:38:55.867188 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.867170 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 05 16:38:55.868902 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.868889 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 05 16:38:55.868962 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.868918 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 05 16:38:55.870202 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.870189 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 05 16:38:55.870257 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.870229 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 05 16:38:55.870257 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.870239 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 05 16:38:55.870257 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.870247 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 05 16:38:55.870338 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.870259 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 05 16:38:55.870338 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.870268 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 05 16:38:55.870338 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.870279 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 05 16:38:55.870338 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.870289 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 05 16:38:55.870338 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.870298 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 05 16:38:55.870338 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.870306 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 05 16:38:55.870338 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.870318 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 05 16:38:55.870338 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.870327 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 05 16:38:55.871305 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.871292 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 05 16:38:55.871354 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.871307 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 05 16:38:55.872647 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:55.872607 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 05 16:38:55.872716 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:55.872608 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 05 16:38:55.874673 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.874659 2583 server.go:1268] "Started kubelet" Aug 05 16:38:55.874798 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.874741 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 05 16:38:55.874902 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.874817 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 05 16:38:55.874902 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.874746 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 05 16:38:55.875544 ip-10-0-132-4 systemd[1]: Started Kubernetes Kubelet. Aug 05 16:38:55.876151 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.876106 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 05 16:38:55.876962 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.876948 2583 server.go:310] "Adding debug handlers to kubelet server" Aug 05 16:38:55.878754 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:55.878735 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 05 16:38:55.881262 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.881248 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 05 16:38:55.881403 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.881387 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 05 16:38:55.881464 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:55.881444 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Aug 05 16:38:55.881927 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.881902 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 05 16:38:55.882011 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.881991 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 05 16:38:55.882068 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.882019 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 05 16:38:55.882163 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.882145 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 05 16:38:55.882287 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.882170 2583 reconstruct.go:97] "Volume reconstruction finished" Aug 05 16:38:55.882287 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.882180 2583 reconciler.go:29] "Reconciler: start to sync state" Aug 05 16:38:55.882440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.882425 2583 factory.go:55] Registering systemd factory Aug 05 16:38:55.882440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.882441 2583 factory.go:223] Registration of the systemd container factory successfully Aug 05 16:38:55.882772 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.882733 2583 factory.go:153] Registering CRI-O factory Aug 05 16:38:55.882772 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.882749 2583 factory.go:223] Registration of the crio container factory successfully Aug 05 16:38:55.882938 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.882798 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 05 16:38:55.882938 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.882818 2583 factory.go:103] Registering Raw factory Aug 05 16:38:55.882938 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.882827 2583 manager.go:1196] Started watching for new ooms in manager Aug 05 16:38:55.883308 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.883293 2583 manager.go:349] Starting recovery of all containers Aug 05 16:38:55.883395 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:55.882094 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-4.ec2.internal.18c8f62f7126411c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-4.ec2.internal,UID:ip-10-0-132-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-4.ec2.internal,},FirstTimestamp:2026-08-05 16:38:55.874629916 +0000 UTC m=+0.359287810,LastTimestamp:2026-08-05 16:38:55.874629916 +0000 UTC m=+0.359287810,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-4.ec2.internal,}" Aug 05 16:38:55.889534 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:55.889433 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 05 16:38:55.889605 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:55.889528 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 05 16:38:55.894576 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.894555 2583 manager.go:354] Recovery completed Aug 05 16:38:55.899428 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.899416 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 16:38:55.901260 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.901244 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Aug 05 16:38:55.901321 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.901272 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 16:38:55.901321 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.901282 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Aug 05 16:38:55.901810 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.901798 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 05 16:38:55.901863 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.901810 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 05 16:38:55.901863 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.901824 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 16:38:55.901923 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.901827 2583 state_mem.go:36] "Initialized new in-memory state store" Aug 05 16:38:55.902633 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.902616 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Aug 05 16:38:55.902698 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.902641 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 16:38:55.902698 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.902650 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Aug 05 16:38:55.903073 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.903058 2583 policy_none.go:49] "None policy: Start" Aug 05 16:38:55.903073 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.903074 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 05 16:38:55.903196 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.903084 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 05 16:38:55.903674 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:55.903585 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-4.ec2.internal.18c8f62f72bc9826 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-4.ec2.internal,UID:ip-10-0-132-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-4.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-4.ec2.internal,},FirstTimestamp:2026-08-05 16:38:55.901259814 +0000 UTC m=+0.385917708,LastTimestamp:2026-08-05 16:38:55.901259814 +0000 UTC m=+0.385917708,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-4.ec2.internal,}" Aug 05 16:38:55.903790 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.903775 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v4vlt" Aug 05 16:38:55.904129 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.904114 2583 policy_none.go:47] "Start" Aug 05 16:38:55.910551 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.910440 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v4vlt" Aug 05 16:38:55.915453 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:55.915392 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-4.ec2.internal.18c8f62f72bcda8a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-4.ec2.internal,UID:ip-10-0-132-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-4.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-4.ec2.internal,},FirstTimestamp:2026-08-05 16:38:55.90127681 +0000 UTC m=+0.385934703,LastTimestamp:2026-08-05 16:38:55.90127681 +0000 UTC m=+0.385934703,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-4.ec2.internal,}" Aug 05 16:38:55.945810 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.945791 2583 manager.go:337] "Starting Device Plugin manager" Aug 05 16:38:55.945931 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:55.945825 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 05 16:38:55.945931 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.945836 2583 server.go:87] "Starting device plugin registration server" Aug 05 16:38:55.946128 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.946114 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 05 16:38:55.946161 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.946133 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 05 16:38:55.946237 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.946209 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 05 16:38:55.946313 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.946306 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 05 16:38:55.946358 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:55.946317 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 05 16:38:55.947739 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:55.947709 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 05 16:38:55.947826 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:55.947770 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-4.ec2.internal\" not found" Aug 05 16:38:56.012344 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.012306 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 05 16:38:56.013546 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.013533 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 05 16:38:56.013609 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.013567 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 05 16:38:56.013609 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.013589 2583 kubelet.go:2448] "Starting kubelet main sync loop" Aug 05 16:38:56.013700 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:56.013623 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 05 16:38:56.016092 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.016075 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 16:38:56.046931 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.046912 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 16:38:56.047743 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.047726 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Aug 05 16:38:56.047853 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.047754 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 16:38:56.047853 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.047766 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Aug 05 16:38:56.047853 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.047791 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.068040 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.067983 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.068040 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:56.068005 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-4.ec2.internal\": node \"ip-10-0-132-4.ec2.internal\" not found" Aug 05 16:38:56.086996 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:56.086977 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Aug 05 16:38:56.114226 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.114180 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal"] Aug 05 16:38:56.114333 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.114268 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 16:38:56.115723 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.115708 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Aug 05 16:38:56.115779 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.115740 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 16:38:56.115779 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.115755 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Aug 05 16:38:56.117604 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.117593 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 16:38:56.117773 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.117760 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.117810 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.117791 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 16:38:56.118305 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.118288 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Aug 05 16:38:56.118393 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.118313 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 16:38:56.118393 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.118322 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Aug 05 16:38:56.118393 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.118291 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Aug 05 16:38:56.118505 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.118402 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 16:38:56.118505 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.118416 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Aug 05 16:38:56.119456 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.119440 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.119500 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.119473 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 16:38:56.120097 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.120081 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory" Aug 05 16:38:56.120187 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.120106 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 16:38:56.120187 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.120119 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID" Aug 05 16:38:56.146818 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:56.146800 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-4.ec2.internal\" not found" node="ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.151598 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:56.151583 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-4.ec2.internal\" not found" node="ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.183354 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.183336 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43edf4011e3f2d06d7b775a7e67ce658-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"43edf4011e3f2d06d7b775a7e67ce658\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.183428 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.183363 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43edf4011e3f2d06d7b775a7e67ce658-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"43edf4011e3f2d06d7b775a7e67ce658\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.183428 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.183385 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbc2ecf91e3a14d28f59c693cc51e1f3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-4.ec2.internal\" (UID: \"bbc2ecf91e3a14d28f59c693cc51e1f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.187291 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:56.187275 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Aug 05 16:38:56.283625 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.283595 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43edf4011e3f2d06d7b775a7e67ce658-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"43edf4011e3f2d06d7b775a7e67ce658\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.283720 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.283630 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43edf4011e3f2d06d7b775a7e67ce658-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"43edf4011e3f2d06d7b775a7e67ce658\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.283720 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.283647 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbc2ecf91e3a14d28f59c693cc51e1f3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-4.ec2.internal\" (UID: \"bbc2ecf91e3a14d28f59c693cc51e1f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.283720 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.283649 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43edf4011e3f2d06d7b775a7e67ce658-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"43edf4011e3f2d06d7b775a7e67ce658\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.283720 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.283676 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbc2ecf91e3a14d28f59c693cc51e1f3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-4.ec2.internal\" (UID: \"bbc2ecf91e3a14d28f59c693cc51e1f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.283720 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.283680 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43edf4011e3f2d06d7b775a7e67ce658-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"43edf4011e3f2d06d7b775a7e67ce658\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.287701 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:56.287686 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Aug 05 16:38:56.388524 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:56.388449 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Aug 05 16:38:56.449651 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.449629 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.455204 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.455185 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.489162 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:56.489132 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Aug 05 16:38:56.589672 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:56.589632 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Aug 05 16:38:56.690266 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:56.690178 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Aug 05 16:38:56.724710 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.724683 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 16:38:56.790724 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:56.790694 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found" Aug 05 16:38:56.822860 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.822832 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 05 16:38:56.823324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.822973 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 05 16:38:56.823324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.823007 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 05 16:38:56.880229 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.880192 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 16:38:56.882190 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.882172 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 05 16:38:56.882288 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.882178 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.894864 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.894843 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 16:38:56.895828 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.895814 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" Aug 05 16:38:56.897644 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.897629 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 16:38:56.903661 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.903644 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 16:38:56.914801 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.914773 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 16:33:55 +0000 UTC" deadline="2028-04-30 04:58:40.683206478 +0000 UTC" Aug 05 16:38:56.914801 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.914799 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15204h19m43.768410061s" Aug 05 16:38:56.954225 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.954152 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tq89j" Aug 05 16:38:56.963026 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:56.963002 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tq89j" Aug 05 16:38:57.042007 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:57.041980 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43edf4011e3f2d06d7b775a7e67ce658.slice/crio-1aedcc9f0612c5bc6674d6ad186670d7e03002668f138b29bd52a250f6ff4c85 WatchSource:0}: Error finding container 1aedcc9f0612c5bc6674d6ad186670d7e03002668f138b29bd52a250f6ff4c85: Status 404 returned error can't find the container with id 1aedcc9f0612c5bc6674d6ad186670d7e03002668f138b29bd52a250f6ff4c85 Aug 05 16:38:57.042522 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:57.042502 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc2ecf91e3a14d28f59c693cc51e1f3.slice/crio-e5a940f294728f7f95c03a66981dc82b84189d582488f36aac1f47d10ac3401f WatchSource:0}: Error finding container e5a940f294728f7f95c03a66981dc82b84189d582488f36aac1f47d10ac3401f: Status 404 returned error can't find the container with id e5a940f294728f7f95c03a66981dc82b84189d582488f36aac1f47d10ac3401f Aug 05 16:38:57.048384 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.048360 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 16:38:57.131094 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.131071 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 16:38:57.687345 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.687310 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 16:38:57.864201 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.864161 2583 apiserver.go:52] "Watching apiserver" Aug 05 16:38:57.875546 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.875522 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 05 16:38:57.876006 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.875971 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal","openshift-multus/network-metrics-daemon-7xvbx","openshift-network-diagnostics/network-check-target-h2jtk","kube-system/global-pull-secret-syncer-6pglf","kube-system/konnectivity-agent-xn7jj","kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal","openshift-multus/multus-4rm4h","openshift-multus/multus-additional-cni-plugins-jxqxl","openshift-network-operator/iptables-alerter-4q9lm","openshift-ovn-kubernetes/ovnkube-node-gnvfn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z","openshift-cluster-node-tuning-operator/tuned-8vklw","openshift-dns/node-resolver-m846k","openshift-image-registry/node-ca-ghgcw"] Aug 05 16:38:57.878548 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.878522 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:38:57.878682 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:57.878619 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:38:57.880690 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.880670 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:38:57.880794 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:57.880741 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:38:57.883104 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.883080 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:38:57.883201 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:57.883141 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:38:57.885056 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.885035 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xn7jj" Aug 05 16:38:57.887293 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.887270 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.888059 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.887822 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v7hq8\"" Aug 05 16:38:57.888059 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.887879 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 05 16:38:57.888059 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.887940 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 05 16:38:57.889673 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.889653 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:57.890289 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.890271 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 05 16:38:57.890289 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.890283 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n42xv\"" Aug 05 16:38:57.890548 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.890532 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 05 16:38:57.890915 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.890756 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 05 16:38:57.890915 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.890823 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 05 16:38:57.891923 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.891867 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4q9lm" Aug 05 16:38:57.892038 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.892013 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-66l9p\"" Aug 05 16:38:57.892287 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.892269 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 05 16:38:57.893063 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.892515 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 05 16:38:57.893063 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.892533 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:38:57.893063 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.892564 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:38:57.893063 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.892592 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d4e36102-8bf2-443b-acb5-ba26c5282f01-konnectivity-ca\") pod \"konnectivity-agent-xn7jj\" (UID: \"d4e36102-8bf2-443b-acb5-ba26c5282f01\") " pod="kube-system/konnectivity-agent-xn7jj" Aug 05 16:38:57.893063 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.892620 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxhjx\" (UniqueName: \"kubernetes.io/projected/2be87eb4-e338-44b2-ab97-dad8edd973f1-kube-api-access-mxhjx\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:38:57.893063 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.892646 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rng86\" (UniqueName: \"kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86\") pod \"network-check-target-h2jtk\" (UID: \"8e3cb855-bb8d-4b02-983d-6db5ecc9f278\") " pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:38:57.893063 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.892675 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0d5e3b35-ca04-44af-820a-ce5467bd445c-kubelet-config\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:38:57.893063 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.892707 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0d5e3b35-ca04-44af-820a-ce5467bd445c-dbus\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:38:57.893063 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.892732 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d4e36102-8bf2-443b-acb5-ba26c5282f01-agent-certs\") pod \"konnectivity-agent-xn7jj\" (UID: \"d4e36102-8bf2-443b-acb5-ba26c5282f01\") " pod="kube-system/konnectivity-agent-xn7jj" Aug 05 16:38:57.894300 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.894279 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ks7kz\"" Aug 05 16:38:57.894600 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.894519 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 05 16:38:57.894600 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.894519 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 05 16:38:57.894744 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.894707 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.896392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.895984 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 05 16:38:57.896758 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.896733 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:57.898089 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.897981 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 05 16:38:57.898089 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.897988 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 05 16:38:57.898858 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.898837 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 05 16:38:57.898944 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.898877 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 05 16:38:57.898944 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.898885 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 05 16:38:57.898944 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.898846 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 05 16:38:57.899156 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.899139 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cflnw\"" Aug 05 16:38:57.899244 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.899206 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.899352 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.899333 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 05 16:38:57.899420 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.899383 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 05 16:38:57.899652 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.899632 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 05 16:38:57.899739 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.899708 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j9p4z\"" Aug 05 16:38:57.902128 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.902104 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 05 16:38:57.902228 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.902186 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2wfzk\"" Aug 05 16:38:57.903640 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.902885 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m846k" Aug 05 16:38:57.903640 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.903001 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 05 16:38:57.905520 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.905500 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 05 16:38:57.905609 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.905500 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m2jj7\"" Aug 05 16:38:57.905693 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.905671 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 05 16:38:57.905792 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.905723 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ghgcw" Aug 05 16:38:57.908016 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.907997 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 05 16:38:57.908159 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.908136 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 05 16:38:57.908346 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.908329 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zmncd\"" Aug 05 16:38:57.908426 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.908368 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 05 16:38:57.965622 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.965574 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 16:33:56 +0000 UTC" deadline="2028-01-06 01:43:39.018349213 +0000 UTC" Aug 05 16:38:57.965622 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.965612 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12441h4m41.052740856s" Aug 05 16:38:57.983026 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.983001 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 05 16:38:57.993246 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993205 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a4923c1-abcf-4998-9757-d6753a11e98a-host\") pod \"node-ca-ghgcw\" (UID: \"3a4923c1-abcf-4998-9757-d6753a11e98a\") " pod="openshift-image-registry/node-ca-ghgcw" Aug 05 16:38:57.993371 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993264 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxhjx\" (UniqueName: \"kubernetes.io/projected/2be87eb4-e338-44b2-ab97-dad8edd973f1-kube-api-access-mxhjx\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:38:57.993371 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993291 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rng86\" (UniqueName: \"kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86\") pod \"network-check-target-h2jtk\" (UID: \"8e3cb855-bb8d-4b02-983d-6db5ecc9f278\") " pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:38:57.993371 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993314 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hd98\" (UniqueName: \"kubernetes.io/projected/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-kube-api-access-5hd98\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.993371 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993338 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-etc-openvswitch\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.993371 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993359 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-run-ovn-kubernetes\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.993570 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993381 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-cni-bin\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.993570 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993426 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9df7d7c5-95a4-444e-a727-8a7f8a65be2e-hosts-file\") pod \"node-resolver-m846k\" (UID: \"9df7d7c5-95a4-444e-a727-8a7f8a65be2e\") " pod="openshift-dns/node-resolver-m846k" Aug 05 16:38:57.993570 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993484 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/052da024-7fa4-4d8d-8229-c77a07da6376-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:57.993570 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993536 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-registration-dir\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:57.993570 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993562 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfnxv\" (UniqueName: \"kubernetes.io/projected/e80cd850-38f1-4423-af36-37cea3dc1859-kube-api-access-wfnxv\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:57.993756 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993583 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e22a6166-f95e-4fda-9582-27b74c5d7592-tmp\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.993756 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993621 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-multus-daemon-config\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.993756 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993648 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-systemd-units\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.993756 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993669 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-device-dir\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:57.993756 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993691 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-etc-selinux\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:57.993756 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993712 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-sys\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.993756 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993733 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a4923c1-abcf-4998-9757-d6753a11e98a-serviceca\") pod \"node-ca-ghgcw\" (UID: \"3a4923c1-abcf-4998-9757-d6753a11e98a\") " pod="openshift-image-registry/node-ca-ghgcw" Aug 05 16:38:57.993983 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993768 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-slash\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.993983 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993791 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5fbada7-5644-4c41-8bb1-6ea71a042437-ovn-node-metrics-cert\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.993983 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993813 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df7d7c5-95a4-444e-a727-8a7f8a65be2e-tmp-dir\") pod \"node-resolver-m846k\" (UID: \"9df7d7c5-95a4-444e-a727-8a7f8a65be2e\") " pod="openshift-dns/node-resolver-m846k" Aug 05 16:38:57.993983 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993836 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/052da024-7fa4-4d8d-8229-c77a07da6376-system-cni-dir\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:57.993983 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993859 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vfxg\" (UniqueName: \"kubernetes.io/projected/052da024-7fa4-4d8d-8229-c77a07da6376-kube-api-access-2vfxg\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:57.993983 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993881 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-cnibin\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.993983 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993905 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-var-lib-cni-bin\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.993983 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993925 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-var-lib-cni-multus\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.993983 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993949 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40c91398-cab2-44e7-8a20-f25b8f0a73c4-iptables-alerter-script\") pod \"iptables-alerter-4q9lm\" (UID: \"40c91398-cab2-44e7-8a20-f25b8f0a73c4\") " pod="openshift-network-operator/iptables-alerter-4q9lm" Aug 05 16:38:57.993983 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993972 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-kubelet\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.993992 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-run\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994007 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-lib-modules\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994027 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994052 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d4e36102-8bf2-443b-acb5-ba26c5282f01-konnectivity-ca\") pod \"konnectivity-agent-xn7jj\" (UID: \"d4e36102-8bf2-443b-acb5-ba26c5282f01\") " pod="kube-system/konnectivity-agent-xn7jj" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994075 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40c91398-cab2-44e7-8a20-f25b8f0a73c4-host-slash\") pod \"iptables-alerter-4q9lm\" (UID: \"40c91398-cab2-44e7-8a20-f25b8f0a73c4\") " pod="openshift-network-operator/iptables-alerter-4q9lm" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994096 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-cni-netd\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994140 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-sysctl-conf\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994177 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-os-release\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994251 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-cni-binary-copy\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994282 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994307 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e5fbada7-5644-4c41-8bb1-6ea71a042437-ovnkube-script-lib\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994335 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/052da024-7fa4-4d8d-8229-c77a07da6376-cnibin\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994359 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/052da024-7fa4-4d8d-8229-c77a07da6376-os-release\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:57.994392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994380 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-socket-dir\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994422 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-tuned\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994472 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-system-cni-dir\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994498 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-multus-conf-dir\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994523 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/052da024-7fa4-4d8d-8229-c77a07da6376-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994547 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jzkh\" (UniqueName: \"kubernetes.io/projected/e22a6166-f95e-4fda-9582-27b74c5d7592-kube-api-access-6jzkh\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994580 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d4e36102-8bf2-443b-acb5-ba26c5282f01-agent-certs\") pod \"konnectivity-agent-xn7jj\" (UID: \"d4e36102-8bf2-443b-acb5-ba26c5282f01\") " pod="kube-system/konnectivity-agent-xn7jj" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994616 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-var-lib-kubelet\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:57.994638 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994736 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-run-netns\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994763 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-run-systemd\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:57.994789 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret podName:0d5e3b35-ca04-44af-820a-ce5467bd445c nodeName:}" failed. No retries permitted until 2026-08-05 16:38:58.494764198 +0000 UTC m=+2.979422080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret") pod "global-pull-secret-syncer-6pglf" (UID: "0d5e3b35-ca04-44af-820a-ce5467bd445c") : object "kube-system"/"original-pull-secret" not registered Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994829 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-var-lib-kubelet\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994859 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drfvd\" (UniqueName: \"kubernetes.io/projected/3a4923c1-abcf-4998-9757-d6753a11e98a-kube-api-access-drfvd\") pod \"node-ca-ghgcw\" (UID: \"3a4923c1-abcf-4998-9757-d6753a11e98a\") " pod="openshift-image-registry/node-ca-ghgcw" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994886 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-run-k8s-cni-cncf-io\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994925 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-run-netns\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994937 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 05 16:38:57.994953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994950 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-run-ovn\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994971 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.994995 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-modprobe-d\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995022 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995053 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-multus-socket-dir-parent\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995077 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-etc-kubernetes\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995103 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/052da024-7fa4-4d8d-8229-c77a07da6376-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:57.995120 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995127 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-sysconfig\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:57.995170 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs podName:2be87eb4-e338-44b2-ab97-dad8edd973f1 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:58.495152296 +0000 UTC m=+2.979810208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs") pod "network-metrics-daemon-7xvbx" (UID: "2be87eb4-e338-44b2-ab97-dad8edd973f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995341 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0d5e3b35-ca04-44af-820a-ce5467bd445c-dbus\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995396 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d4e36102-8bf2-443b-acb5-ba26c5282f01-konnectivity-ca\") pod \"konnectivity-agent-xn7jj\" (UID: \"d4e36102-8bf2-443b-acb5-ba26c5282f01\") " pod="kube-system/konnectivity-agent-xn7jj" Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995191 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0d5e3b35-ca04-44af-820a-ce5467bd445c-dbus\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995664 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-multus-cni-dir\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.995705 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995689 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-hostroot\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995714 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jxmf\" (UniqueName: \"kubernetes.io/projected/40c91398-cab2-44e7-8a20-f25b8f0a73c4-kube-api-access-2jxmf\") pod \"iptables-alerter-4q9lm\" (UID: \"40c91398-cab2-44e7-8a20-f25b8f0a73c4\") " pod="openshift-network-operator/iptables-alerter-4q9lm" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995740 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-run-openvswitch\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995781 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-node-log\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995804 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e5fbada7-5644-4c41-8bb1-6ea71a042437-env-overrides\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995825 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbvz8\" (UniqueName: \"kubernetes.io/projected/e5fbada7-5644-4c41-8bb1-6ea71a042437-kube-api-access-gbvz8\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995857 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-var-lib-openvswitch\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-log-socket\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995914 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e5fbada7-5644-4c41-8bb1-6ea71a042437-ovnkube-config\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995937 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/052da024-7fa4-4d8d-8229-c77a07da6376-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995961 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-kubernetes\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.995983 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-sysctl-d\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.996008 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0d5e3b35-ca04-44af-820a-ce5467bd445c-kubelet-config\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.996033 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnqb6\" (UniqueName: \"kubernetes.io/projected/9df7d7c5-95a4-444e-a727-8a7f8a65be2e-kube-api-access-xnqb6\") pod \"node-resolver-m846k\" (UID: \"9df7d7c5-95a4-444e-a727-8a7f8a65be2e\") " pod="openshift-dns/node-resolver-m846k" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.996055 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-sys-fs\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.996063 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0d5e3b35-ca04-44af-820a-ce5467bd445c-kubelet-config\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:38:57.996284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.996077 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-run-multus-certs\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:57.996811 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.996100 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-systemd\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.996811 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.996122 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-host\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:57.998332 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:57.998314 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d4e36102-8bf2-443b-acb5-ba26c5282f01-agent-certs\") pod \"konnectivity-agent-xn7jj\" (UID: \"d4e36102-8bf2-443b-acb5-ba26c5282f01\") " pod="kube-system/konnectivity-agent-xn7jj" Aug 05 16:38:58.002115 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:58.002095 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 16:38:58.002115 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:58.002116 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 16:38:58.002291 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:58.002130 2583 projected.go:196] Error preparing data for projected volume kube-api-access-rng86 for pod openshift-network-diagnostics/network-check-target-h2jtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:38:58.002291 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:58.002180 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86 podName:8e3cb855-bb8d-4b02-983d-6db5ecc9f278 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:58.502166603 +0000 UTC m=+2.986824497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rng86" (UniqueName: "kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86") pod "network-check-target-h2jtk" (UID: "8e3cb855-bb8d-4b02-983d-6db5ecc9f278") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:38:58.002693 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.002648 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxhjx\" (UniqueName: \"kubernetes.io/projected/2be87eb4-e338-44b2-ab97-dad8edd973f1-kube-api-access-mxhjx\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:38:58.018049 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.017998 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" event={"ID":"43edf4011e3f2d06d7b775a7e67ce658","Type":"ContainerStarted","Data":"1aedcc9f0612c5bc6674d6ad186670d7e03002668f138b29bd52a250f6ff4c85"} Aug 05 16:38:58.019157 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.019114 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" event={"ID":"bbc2ecf91e3a14d28f59c693cc51e1f3","Type":"ContainerStarted","Data":"e5a940f294728f7f95c03a66981dc82b84189d582488f36aac1f47d10ac3401f"} Aug 05 16:38:58.096899 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.096866 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/052da024-7fa4-4d8d-8229-c77a07da6376-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.097069 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.096909 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-kubernetes\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.097069 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.096935 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-sysctl-d\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.097069 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.096962 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnqb6\" (UniqueName: \"kubernetes.io/projected/9df7d7c5-95a4-444e-a727-8a7f8a65be2e-kube-api-access-xnqb6\") pod \"node-resolver-m846k\" (UID: \"9df7d7c5-95a4-444e-a727-8a7f8a65be2e\") " pod="openshift-dns/node-resolver-m846k" Aug 05 16:38:58.097069 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.096987 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-sys-fs\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.097069 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097012 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-run-multus-certs\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.097069 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097037 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-systemd\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.097069 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097058 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-host\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097132 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-run-multus-certs\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097136 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-sysctl-d\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097139 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-kubernetes\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097162 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-sys-fs\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097189 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-systemd\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097195 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-host\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097240 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a4923c1-abcf-4998-9757-d6753a11e98a-host\") pod \"node-ca-ghgcw\" (UID: \"3a4923c1-abcf-4998-9757-d6753a11e98a\") " pod="openshift-image-registry/node-ca-ghgcw" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097272 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a4923c1-abcf-4998-9757-d6753a11e98a-host\") pod \"node-ca-ghgcw\" (UID: \"3a4923c1-abcf-4998-9757-d6753a11e98a\") " pod="openshift-image-registry/node-ca-ghgcw" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097326 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hd98\" (UniqueName: \"kubernetes.io/projected/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-kube-api-access-5hd98\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097354 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-etc-openvswitch\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097382 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-run-ovn-kubernetes\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097407 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-cni-bin\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.097424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097432 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9df7d7c5-95a4-444e-a727-8a7f8a65be2e-hosts-file\") pod \"node-resolver-m846k\" (UID: \"9df7d7c5-95a4-444e-a727-8a7f8a65be2e\") " pod="openshift-dns/node-resolver-m846k" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097454 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/052da024-7fa4-4d8d-8229-c77a07da6376-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097459 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-etc-openvswitch\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097459 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-run-ovn-kubernetes\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097475 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-registration-dir\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097499 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfnxv\" (UniqueName: \"kubernetes.io/projected/e80cd850-38f1-4423-af36-37cea3dc1859-kube-api-access-wfnxv\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097522 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e22a6166-f95e-4fda-9582-27b74c5d7592-tmp\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097512 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-cni-bin\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097546 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-multus-daemon-config\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097570 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/052da024-7fa4-4d8d-8229-c77a07da6376-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097586 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9df7d7c5-95a4-444e-a727-8a7f8a65be2e-hosts-file\") pod \"node-resolver-m846k\" (UID: \"9df7d7c5-95a4-444e-a727-8a7f8a65be2e\") " pod="openshift-dns/node-resolver-m846k" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097588 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-systemd-units\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-device-dir\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097634 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-systemd-units\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097654 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-etc-selinux\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097680 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-sys\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097692 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-device-dir\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.098109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097703 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a4923c1-abcf-4998-9757-d6753a11e98a-serviceca\") pod \"node-ca-ghgcw\" (UID: \"3a4923c1-abcf-4998-9757-d6753a11e98a\") " pod="openshift-image-registry/node-ca-ghgcw" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097745 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-slash\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097770 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5fbada7-5644-4c41-8bb1-6ea71a042437-ovn-node-metrics-cert\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097793 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df7d7c5-95a4-444e-a727-8a7f8a65be2e-tmp-dir\") pod \"node-resolver-m846k\" (UID: \"9df7d7c5-95a4-444e-a727-8a7f8a65be2e\") " pod="openshift-dns/node-resolver-m846k" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097846 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-registration-dir\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097893 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-etc-selinux\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.097943 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-sys\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098031 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/052da024-7fa4-4d8d-8229-c77a07da6376-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098077 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-multus-daemon-config\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098110 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df7d7c5-95a4-444e-a727-8a7f8a65be2e-tmp-dir\") pod \"node-resolver-m846k\" (UID: \"9df7d7c5-95a4-444e-a727-8a7f8a65be2e\") " pod="openshift-dns/node-resolver-m846k" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098120 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/052da024-7fa4-4d8d-8229-c77a07da6376-system-cni-dir\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098148 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vfxg\" (UniqueName: \"kubernetes.io/projected/052da024-7fa4-4d8d-8229-c77a07da6376-kube-api-access-2vfxg\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098172 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/052da024-7fa4-4d8d-8229-c77a07da6376-system-cni-dir\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098173 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-cnibin\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098208 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-var-lib-cni-bin\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098237 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-cnibin\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098253 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-var-lib-cni-multus\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098256 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-slash\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.098941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098304 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-var-lib-cni-bin\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098345 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40c91398-cab2-44e7-8a20-f25b8f0a73c4-iptables-alerter-script\") pod \"iptables-alerter-4q9lm\" (UID: \"40c91398-cab2-44e7-8a20-f25b8f0a73c4\") " pod="openshift-network-operator/iptables-alerter-4q9lm" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098372 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-kubelet\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098378 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-var-lib-cni-multus\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098411 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-kubelet\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098437 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-run\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098462 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-lib-modules\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098499 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40c91398-cab2-44e7-8a20-f25b8f0a73c4-host-slash\") pod \"iptables-alerter-4q9lm\" (UID: \"40c91398-cab2-44e7-8a20-f25b8f0a73c4\") " pod="openshift-network-operator/iptables-alerter-4q9lm" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098501 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-run\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098540 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40c91398-cab2-44e7-8a20-f25b8f0a73c4-host-slash\") pod \"iptables-alerter-4q9lm\" (UID: \"40c91398-cab2-44e7-8a20-f25b8f0a73c4\") " pod="openshift-network-operator/iptables-alerter-4q9lm" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098540 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-cni-netd\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098571 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-sysctl-conf\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098575 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-cni-netd\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098596 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-os-release\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098629 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-cni-binary-copy\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098634 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-lib-modules\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098656 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-os-release\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098656 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.099894 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098695 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e5fbada7-5644-4c41-8bb1-6ea71a042437-ovnkube-script-lib\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098720 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/052da024-7fa4-4d8d-8229-c77a07da6376-cnibin\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098746 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/052da024-7fa4-4d8d-8229-c77a07da6376-os-release\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098773 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-socket-dir\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098776 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-sysctl-conf\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098797 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-tuned\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098820 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-system-cni-dir\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098823 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098835 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-multus-conf-dir\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098851 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/052da024-7fa4-4d8d-8229-c77a07da6376-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098869 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jzkh\" (UniqueName: \"kubernetes.io/projected/e22a6166-f95e-4fda-9582-27b74c5d7592-kube-api-access-6jzkh\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-var-lib-kubelet\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098910 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-run-netns\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098932 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-run-systemd\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098930 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40c91398-cab2-44e7-8a20-f25b8f0a73c4-iptables-alerter-script\") pod \"iptables-alerter-4q9lm\" (UID: \"40c91398-cab2-44e7-8a20-f25b8f0a73c4\") " pod="openshift-network-operator/iptables-alerter-4q9lm" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098946 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-var-lib-kubelet\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.098988 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-var-lib-kubelet\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.100761 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099011 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drfvd\" (UniqueName: \"kubernetes.io/projected/3a4923c1-abcf-4998-9757-d6753a11e98a-kube-api-access-drfvd\") pod \"node-ca-ghgcw\" (UID: \"3a4923c1-abcf-4998-9757-d6753a11e98a\") " pod="openshift-image-registry/node-ca-ghgcw" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099051 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-run-k8s-cni-cncf-io\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099078 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-run-netns\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099086 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-socket-dir\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099109 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-run-ovn\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099134 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-host-run-netns\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099145 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-cni-binary-copy\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099151 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-modprobe-d\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099231 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-multus-socket-dir-parent\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099262 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-etc-kubernetes\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099270 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/052da024-7fa4-4d8d-8229-c77a07da6376-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099287 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/052da024-7fa4-4d8d-8229-c77a07da6376-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099313 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-sysconfig\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099338 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-multus-cni-dir\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099361 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-hostroot\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099366 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-run-k8s-cni-cncf-io\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.101639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099386 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jxmf\" (UniqueName: \"kubernetes.io/projected/40c91398-cab2-44e7-8a20-f25b8f0a73c4-kube-api-access-2jxmf\") pod \"iptables-alerter-4q9lm\" (UID: \"40c91398-cab2-44e7-8a20-f25b8f0a73c4\") " pod="openshift-network-operator/iptables-alerter-4q9lm" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099411 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-run-openvswitch\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099424 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e5fbada7-5644-4c41-8bb1-6ea71a042437-ovnkube-script-lib\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099438 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-node-log\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099446 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-run-netns\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099461 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-modprobe-d\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099487 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/052da024-7fa4-4d8d-8229-c77a07da6376-cnibin\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099499 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-system-cni-dir\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099518 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-multus-socket-dir-parent\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099541 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-run-ovn\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099579 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-run-openvswitch\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099616 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-host-var-lib-kubelet\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099674 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/052da024-7fa4-4d8d-8229-c77a07da6376-os-release\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099491 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e80cd850-38f1-4423-af36-37cea3dc1859-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099696 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e5fbada7-5644-4c41-8bb1-6ea71a042437-env-overrides\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099717 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-run-systemd\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099727 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbvz8\" (UniqueName: \"kubernetes.io/projected/e5fbada7-5644-4c41-8bb1-6ea71a042437-kube-api-access-gbvz8\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099763 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-var-lib-openvswitch\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.102440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099788 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-log-socket\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099802 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-sysconfig\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099813 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e5fbada7-5644-4c41-8bb1-6ea71a042437-ovnkube-config\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099852 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-var-lib-openvswitch\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099892 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-hostroot\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099902 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/052da024-7fa4-4d8d-8229-c77a07da6376-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099925 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-multus-conf-dir\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099925 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-etc-kubernetes\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099970 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-log-socket\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.099990 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-multus-cni-dir\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.100011 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e5fbada7-5644-4c41-8bb1-6ea71a042437-node-log\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.100183 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a4923c1-abcf-4998-9757-d6753a11e98a-serviceca\") pod \"node-ca-ghgcw\" (UID: \"3a4923c1-abcf-4998-9757-d6753a11e98a\") " pod="openshift-image-registry/node-ca-ghgcw" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.100308 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e5fbada7-5644-4c41-8bb1-6ea71a042437-ovnkube-config\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.100370 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e5fbada7-5644-4c41-8bb1-6ea71a042437-env-overrides\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.100642 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e22a6166-f95e-4fda-9582-27b74c5d7592-tmp\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.100772 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5fbada7-5644-4c41-8bb1-6ea71a042437-ovn-node-metrics-cert\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.103324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.101966 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e22a6166-f95e-4fda-9582-27b74c5d7592-etc-tuned\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.105846 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.105815 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hd98\" (UniqueName: \"kubernetes.io/projected/e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c-kube-api-access-5hd98\") pod \"multus-4rm4h\" (UID: \"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c\") " pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.106148 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.106123 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnqb6\" (UniqueName: \"kubernetes.io/projected/9df7d7c5-95a4-444e-a727-8a7f8a65be2e-kube-api-access-xnqb6\") pod \"node-resolver-m846k\" (UID: \"9df7d7c5-95a4-444e-a727-8a7f8a65be2e\") " pod="openshift-dns/node-resolver-m846k" Aug 05 16:38:58.106573 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.106526 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfnxv\" (UniqueName: \"kubernetes.io/projected/e80cd850-38f1-4423-af36-37cea3dc1859-kube-api-access-wfnxv\") pod \"aws-ebs-csi-driver-node-5nc8z\" (UID: \"e80cd850-38f1-4423-af36-37cea3dc1859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.106947 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.106924 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vfxg\" (UniqueName: \"kubernetes.io/projected/052da024-7fa4-4d8d-8229-c77a07da6376-kube-api-access-2vfxg\") pod \"multus-additional-cni-plugins-jxqxl\" (UID: \"052da024-7fa4-4d8d-8229-c77a07da6376\") " pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.108147 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.108124 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drfvd\" (UniqueName: \"kubernetes.io/projected/3a4923c1-abcf-4998-9757-d6753a11e98a-kube-api-access-drfvd\") pod \"node-ca-ghgcw\" (UID: \"3a4923c1-abcf-4998-9757-d6753a11e98a\") " pod="openshift-image-registry/node-ca-ghgcw" Aug 05 16:38:58.108675 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.108646 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbvz8\" (UniqueName: \"kubernetes.io/projected/e5fbada7-5644-4c41-8bb1-6ea71a042437-kube-api-access-gbvz8\") pod \"ovnkube-node-gnvfn\" (UID: \"e5fbada7-5644-4c41-8bb1-6ea71a042437\") " pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.109102 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.109086 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jzkh\" (UniqueName: \"kubernetes.io/projected/e22a6166-f95e-4fda-9582-27b74c5d7592-kube-api-access-6jzkh\") pod \"tuned-8vklw\" (UID: \"e22a6166-f95e-4fda-9582-27b74c5d7592\") " pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.109481 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.109461 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jxmf\" (UniqueName: \"kubernetes.io/projected/40c91398-cab2-44e7-8a20-f25b8f0a73c4-kube-api-access-2jxmf\") pod \"iptables-alerter-4q9lm\" (UID: \"40c91398-cab2-44e7-8a20-f25b8f0a73c4\") " pod="openshift-network-operator/iptables-alerter-4q9lm" Aug 05 16:38:58.199239 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.199154 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xn7jj" Aug 05 16:38:58.207955 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.207930 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4rm4h" Aug 05 16:38:58.215447 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.215425 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxqxl" Aug 05 16:38:58.221047 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.221032 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4q9lm" Aug 05 16:38:58.231689 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.231666 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:38:58.237350 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.237330 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" Aug 05 16:38:58.245996 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.245976 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8vklw" Aug 05 16:38:58.253471 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.253454 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m846k" Aug 05 16:38:58.258105 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.258090 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ghgcw" Aug 05 16:38:58.501824 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.501738 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:38:58.501824 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.501784 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:38:58.502031 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:58.501898 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 16:38:58.502031 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:58.501897 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:38:58.502031 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:58.501968 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret podName:0d5e3b35-ca04-44af-820a-ce5467bd445c nodeName:}" failed. No retries permitted until 2026-08-05 16:38:59.501952017 +0000 UTC m=+3.986609898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret") pod "global-pull-secret-syncer-6pglf" (UID: "0d5e3b35-ca04-44af-820a-ce5467bd445c") : object "kube-system"/"original-pull-secret" not registered Aug 05 16:38:58.502031 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:58.502006 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs podName:2be87eb4-e338-44b2-ab97-dad8edd973f1 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:59.501987802 +0000 UTC m=+3.986645686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs") pod "network-metrics-daemon-7xvbx" (UID: "2be87eb4-e338-44b2-ab97-dad8edd973f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:38:58.514726 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.514702 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 16:38:58.602675 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.602636 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rng86\" (UniqueName: \"kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86\") pod \"network-check-target-h2jtk\" (UID: \"8e3cb855-bb8d-4b02-983d-6db5ecc9f278\") " pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:38:58.602832 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:58.602783 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 16:38:58.602832 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:58.602800 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 16:38:58.602832 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:58.602809 2583 projected.go:196] Error preparing data for projected volume kube-api-access-rng86 for pod openshift-network-diagnostics/network-check-target-h2jtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:38:58.602993 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:58.602872 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86 podName:8e3cb855-bb8d-4b02-983d-6db5ecc9f278 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:59.602848265 +0000 UTC m=+4.087506147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rng86" (UniqueName: "kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86") pod "network-check-target-h2jtk" (UID: "8e3cb855-bb8d-4b02-983d-6db5ecc9f278") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:38:58.924155 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:58.924122 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod052da024_7fa4_4d8d_8229_c77a07da6376.slice/crio-7384803f4412d7e682d008522fe3187eb213274d9e062d5c7a274913baa9e32e WatchSource:0}: Error finding container 7384803f4412d7e682d008522fe3187eb213274d9e062d5c7a274913baa9e32e: Status 404 returned error can't find the container with id 7384803f4412d7e682d008522fe3187eb213274d9e062d5c7a274913baa9e32e Aug 05 16:38:58.927455 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:58.927413 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80cd850_38f1_4423_af36_37cea3dc1859.slice/crio-f47f4dc57a4c75316b08f76cea34dbc875f9a713d003c13abc9f747d9666bb19 WatchSource:0}: Error finding container f47f4dc57a4c75316b08f76cea34dbc875f9a713d003c13abc9f747d9666bb19: Status 404 returned error can't find the container with id f47f4dc57a4c75316b08f76cea34dbc875f9a713d003c13abc9f747d9666bb19 Aug 05 16:38:58.931286 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:58.931258 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22a6166_f95e_4fda_9582_27b74c5d7592.slice/crio-e0589a0134b8c2eb2142eae91f17bb996e2234af4123db56c27f0ba15f09d0d5 WatchSource:0}: Error finding container e0589a0134b8c2eb2142eae91f17bb996e2234af4123db56c27f0ba15f09d0d5: Status 404 returned error can't find the container with id e0589a0134b8c2eb2142eae91f17bb996e2234af4123db56c27f0ba15f09d0d5 Aug 05 16:38:58.932513 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:58.932493 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a7f2d4_b9b1_4490_a8ca_913098ec0d8c.slice/crio-32b95a004b22443beebda22ef461797d4afc934c14d71c589bf68dd28d90cb27 WatchSource:0}: Error finding container 32b95a004b22443beebda22ef461797d4afc934c14d71c589bf68dd28d90cb27: Status 404 returned error can't find the container with id 32b95a004b22443beebda22ef461797d4afc934c14d71c589bf68dd28d90cb27 Aug 05 16:38:58.934650 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:58.934610 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e36102_8bf2_443b_acb5_ba26c5282f01.slice/crio-3ef05fa7583c7d0d36239c629067a17f26ecdc249540ea28812b4821ede2ee31 WatchSource:0}: Error finding container 3ef05fa7583c7d0d36239c629067a17f26ecdc249540ea28812b4821ede2ee31: Status 404 returned error can't find the container with id 3ef05fa7583c7d0d36239c629067a17f26ecdc249540ea28812b4821ede2ee31 Aug 05 16:38:58.935353 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:58.935292 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c91398_cab2_44e7_8a20_f25b8f0a73c4.slice/crio-7e15de85058a430ae3a77abddc53ed2987f8452ab48d312d34f84838d8d8c02e WatchSource:0}: Error finding container 7e15de85058a430ae3a77abddc53ed2987f8452ab48d312d34f84838d8d8c02e: Status 404 returned error can't find the container with id 7e15de85058a430ae3a77abddc53ed2987f8452ab48d312d34f84838d8d8c02e Aug 05 16:38:58.937088 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:58.937026 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fbada7_5644_4c41_8bb1_6ea71a042437.slice/crio-947bca35b28293a5b18315c1d4f6329cf4f1311e7a446248f4697709fb779d5d WatchSource:0}: Error finding container 947bca35b28293a5b18315c1d4f6329cf4f1311e7a446248f4697709fb779d5d: Status 404 returned error can't find the container with id 947bca35b28293a5b18315c1d4f6329cf4f1311e7a446248f4697709fb779d5d Aug 05 16:38:58.937935 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:58.937914 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4923c1_abcf_4998_9757_d6753a11e98a.slice/crio-763d6685409341a7d9bf3bedd35ead087be366893a3791488899deae8427efe5 WatchSource:0}: Error finding container 763d6685409341a7d9bf3bedd35ead087be366893a3791488899deae8427efe5: Status 404 returned error can't find the container with id 763d6685409341a7d9bf3bedd35ead087be366893a3791488899deae8427efe5 Aug 05 16:38:58.938969 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:38:58.938885 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df7d7c5_95a4_444e_a727_8a7f8a65be2e.slice/crio-abaf84bff511ab457376185f22540604cd47b3bcf8fe0d320ce2c5f9e6c3ca8d WatchSource:0}: Error finding container abaf84bff511ab457376185f22540604cd47b3bcf8fe0d320ce2c5f9e6c3ca8d: Status 404 returned error can't find the container with id abaf84bff511ab457376185f22540604cd47b3bcf8fe0d320ce2c5f9e6c3ca8d Aug 05 16:38:58.966416 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.966365 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 16:33:56 +0000 UTC" deadline="2028-01-28 02:24:25.609666901 +0000 UTC" Aug 05 16:38:58.966416 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:58.966417 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12969h45m26.64325474s" Aug 05 16:38:59.016366 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.014006 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:38:59.016366 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:59.014361 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:38:59.023899 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.023870 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m846k" event={"ID":"9df7d7c5-95a4-444e-a727-8a7f8a65be2e","Type":"ContainerStarted","Data":"abaf84bff511ab457376185f22540604cd47b3bcf8fe0d320ce2c5f9e6c3ca8d"} Aug 05 16:38:59.025085 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.025050 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4q9lm" event={"ID":"40c91398-cab2-44e7-8a20-f25b8f0a73c4","Type":"ContainerStarted","Data":"7e15de85058a430ae3a77abddc53ed2987f8452ab48d312d34f84838d8d8c02e"} Aug 05 16:38:59.026418 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.026390 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xn7jj" event={"ID":"d4e36102-8bf2-443b-acb5-ba26c5282f01","Type":"ContainerStarted","Data":"3ef05fa7583c7d0d36239c629067a17f26ecdc249540ea28812b4821ede2ee31"} Aug 05 16:38:59.027544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.027525 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8vklw" event={"ID":"e22a6166-f95e-4fda-9582-27b74c5d7592","Type":"ContainerStarted","Data":"e0589a0134b8c2eb2142eae91f17bb996e2234af4123db56c27f0ba15f09d0d5"} Aug 05 16:38:59.028709 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.028688 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" event={"ID":"e80cd850-38f1-4423-af36-37cea3dc1859","Type":"ContainerStarted","Data":"f47f4dc57a4c75316b08f76cea34dbc875f9a713d003c13abc9f747d9666bb19"} Aug 05 16:38:59.029707 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.029688 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ghgcw" event={"ID":"3a4923c1-abcf-4998-9757-d6753a11e98a","Type":"ContainerStarted","Data":"763d6685409341a7d9bf3bedd35ead087be366893a3791488899deae8427efe5"} Aug 05 16:38:59.030813 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.030780 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" event={"ID":"e5fbada7-5644-4c41-8bb1-6ea71a042437","Type":"ContainerStarted","Data":"947bca35b28293a5b18315c1d4f6329cf4f1311e7a446248f4697709fb779d5d"} Aug 05 16:38:59.031897 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.031869 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4rm4h" event={"ID":"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c","Type":"ContainerStarted","Data":"32b95a004b22443beebda22ef461797d4afc934c14d71c589bf68dd28d90cb27"} Aug 05 16:38:59.033056 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.033031 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxqxl" event={"ID":"052da024-7fa4-4d8d-8229-c77a07da6376","Type":"ContainerStarted","Data":"7384803f4412d7e682d008522fe3187eb213274d9e062d5c7a274913baa9e32e"} Aug 05 16:38:59.509977 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.509617 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:38:59.510143 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.509986 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:38:59.510143 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:59.509736 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 16:38:59.510143 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:59.510082 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:38:59.510143 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:59.510124 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret podName:0d5e3b35-ca04-44af-820a-ce5467bd445c nodeName:}" failed. No retries permitted until 2026-08-05 16:39:01.510103911 +0000 UTC m=+5.994761798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret") pod "global-pull-secret-syncer-6pglf" (UID: "0d5e3b35-ca04-44af-820a-ce5467bd445c") : object "kube-system"/"original-pull-secret" not registered Aug 05 16:38:59.510383 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:59.510177 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs podName:2be87eb4-e338-44b2-ab97-dad8edd973f1 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:01.510135875 +0000 UTC m=+5.994793770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs") pod "network-metrics-daemon-7xvbx" (UID: "2be87eb4-e338-44b2-ab97-dad8edd973f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:38:59.611347 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:38:59.611314 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rng86\" (UniqueName: \"kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86\") pod \"network-check-target-h2jtk\" (UID: \"8e3cb855-bb8d-4b02-983d-6db5ecc9f278\") " pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:38:59.611520 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:59.611481 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 16:38:59.611520 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:59.611507 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 16:38:59.611520 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:59.611520 2583 projected.go:196] Error preparing data for projected volume kube-api-access-rng86 for pod openshift-network-diagnostics/network-check-target-h2jtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:38:59.611669 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:38:59.611578 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86 podName:8e3cb855-bb8d-4b02-983d-6db5ecc9f278 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:01.611560837 +0000 UTC m=+6.096218734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rng86" (UniqueName: "kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86") pod "network-check-target-h2jtk" (UID: "8e3cb855-bb8d-4b02-983d-6db5ecc9f278") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:39:00.014844 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:00.014332 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:00.014844 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:00.014465 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:00.015784 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:00.015525 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:00.015784 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:00.015638 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:00.057005 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:00.056031 2583 generic.go:356] "Generic (PLEG): container finished" podID="43edf4011e3f2d06d7b775a7e67ce658" containerID="b95ad7316440f8e1a5ce4a4a99922bd58a438dfb597a1df9e6ab83cfbe966124" exitCode=0 Aug 05 16:39:00.057005 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:00.056136 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" event={"ID":"43edf4011e3f2d06d7b775a7e67ce658","Type":"ContainerDied","Data":"b95ad7316440f8e1a5ce4a4a99922bd58a438dfb597a1df9e6ab83cfbe966124"} Aug 05 16:39:00.076169 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:00.076069 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" event={"ID":"bbc2ecf91e3a14d28f59c693cc51e1f3","Type":"ContainerStarted","Data":"0432a06bd94fc63ccd9fc66ae1dfdc5085d1c664b023cf2a51b16540cfe8a8f9"} Aug 05 16:39:00.092134 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:00.091870 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" podStartSLOduration=4.091850797 podStartE2EDuration="4.091850797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:00.091457958 +0000 UTC m=+4.576115865" watchObservedRunningTime="2026-08-05 16:39:00.091850797 +0000 UTC m=+4.576508704" Aug 05 16:39:01.014986 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:01.014520 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:01.014986 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:01.014643 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:01.097170 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:01.097134 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" event={"ID":"43edf4011e3f2d06d7b775a7e67ce658","Type":"ContainerStarted","Data":"ebbf708df57145925e985eebe77367cbd7117dc5a1ab31798243f3c31964ad1c"} Aug 05 16:39:01.117105 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:01.117044 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" podStartSLOduration=5.117022988 podStartE2EDuration="5.117022988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:01.115763792 +0000 UTC m=+5.600421700" watchObservedRunningTime="2026-08-05 16:39:01.117022988 +0000 UTC m=+5.601680892" Aug 05 16:39:01.524699 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:01.524660 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:01.524889 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:01.524773 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:01.524953 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:01.524913 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 16:39:01.525006 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:01.524979 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret podName:0d5e3b35-ca04-44af-820a-ce5467bd445c nodeName:}" failed. No retries permitted until 2026-08-05 16:39:05.524959614 +0000 UTC m=+10.009617515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret") pod "global-pull-secret-syncer-6pglf" (UID: "0d5e3b35-ca04-44af-820a-ce5467bd445c") : object "kube-system"/"original-pull-secret" not registered Aug 05 16:39:01.525071 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:01.525053 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:39:01.525119 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:01.525089 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs podName:2be87eb4-e338-44b2-ab97-dad8edd973f1 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:05.52507592 +0000 UTC m=+10.009733801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs") pod "network-metrics-daemon-7xvbx" (UID: "2be87eb4-e338-44b2-ab97-dad8edd973f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:39:01.625465 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:01.625428 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rng86\" (UniqueName: \"kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86\") pod \"network-check-target-h2jtk\" (UID: \"8e3cb855-bb8d-4b02-983d-6db5ecc9f278\") " pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:01.625658 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:01.625638 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 16:39:01.625743 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:01.625668 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 16:39:01.625743 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:01.625680 2583 projected.go:196] Error preparing data for projected volume kube-api-access-rng86 for pod openshift-network-diagnostics/network-check-target-h2jtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:39:01.625743 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:01.625739 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86 podName:8e3cb855-bb8d-4b02-983d-6db5ecc9f278 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:05.625721072 +0000 UTC m=+10.110378970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rng86" (UniqueName: "kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86") pod "network-check-target-h2jtk" (UID: "8e3cb855-bb8d-4b02-983d-6db5ecc9f278") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:39:02.018073 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:02.017485 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:02.018073 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:02.017635 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:02.018847 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:02.018679 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:02.021263 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:02.019426 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:03.014230 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:03.014184 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:03.014466 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:03.014333 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:04.017782 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:04.017261 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:04.017782 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:04.017291 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:04.017782 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:04.017412 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:04.017782 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:04.017574 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:05.014733 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:05.014694 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:05.014874 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:05.014847 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:05.562257 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:05.561490 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:05.562257 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:05.561555 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:05.562257 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:05.561718 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:39:05.562257 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:05.561779 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs podName:2be87eb4-e338-44b2-ab97-dad8edd973f1 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:13.561760329 +0000 UTC m=+18.046418225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs") pod "network-metrics-daemon-7xvbx" (UID: "2be87eb4-e338-44b2-ab97-dad8edd973f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:39:05.562257 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:05.562161 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 16:39:05.562257 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:05.562209 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret podName:0d5e3b35-ca04-44af-820a-ce5467bd445c nodeName:}" failed. No retries permitted until 2026-08-05 16:39:13.562194008 +0000 UTC m=+18.046851892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret") pod "global-pull-secret-syncer-6pglf" (UID: "0d5e3b35-ca04-44af-820a-ce5467bd445c") : object "kube-system"/"original-pull-secret" not registered Aug 05 16:39:05.663311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:05.662623 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rng86\" (UniqueName: \"kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86\") pod \"network-check-target-h2jtk\" (UID: \"8e3cb855-bb8d-4b02-983d-6db5ecc9f278\") " pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:05.663311 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:05.662851 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 16:39:05.663311 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:05.662878 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 16:39:05.663311 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:05.662891 2583 projected.go:196] Error preparing data for projected volume kube-api-access-rng86 for pod openshift-network-diagnostics/network-check-target-h2jtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:39:05.663311 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:05.662947 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86 podName:8e3cb855-bb8d-4b02-983d-6db5ecc9f278 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:13.662931024 +0000 UTC m=+18.147588908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rng86" (UniqueName: "kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86") pod "network-check-target-h2jtk" (UID: "8e3cb855-bb8d-4b02-983d-6db5ecc9f278") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:39:06.016248 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:06.015575 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:06.016248 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:06.015697 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:06.016248 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:06.016046 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:06.016248 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:06.016138 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:07.014722 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:07.014636 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:07.015064 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:07.014777 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:08.014345 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:08.014267 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:08.014345 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:08.014302 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:08.014574 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:08.014404 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:08.014807 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:08.014765 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:09.014401 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:09.014368 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:09.014560 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:09.014483 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:10.014693 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:10.014654 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:10.015109 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:10.014791 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:10.015109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:10.014654 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:10.015109 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:10.014910 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:11.014289 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:11.014261 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:11.014504 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:11.014390 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:12.014321 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:12.014283 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:12.014321 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:12.014308 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:12.014911 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:12.014418 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:12.014911 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:12.014509 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:13.014656 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:13.014626 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:13.015088 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:13.014721 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:13.622500 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:13.622459 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:13.622653 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:13.622520 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:13.622653 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:13.622620 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 16:39:13.622653 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:13.622634 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:39:13.622800 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:13.622694 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret podName:0d5e3b35-ca04-44af-820a-ce5467bd445c nodeName:}" failed. No retries permitted until 2026-08-05 16:39:29.622674542 +0000 UTC m=+34.107332450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret") pod "global-pull-secret-syncer-6pglf" (UID: "0d5e3b35-ca04-44af-820a-ce5467bd445c") : object "kube-system"/"original-pull-secret" not registered Aug 05 16:39:13.622800 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:13.622712 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs podName:2be87eb4-e338-44b2-ab97-dad8edd973f1 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:29.622705048 +0000 UTC m=+34.107362929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs") pod "network-metrics-daemon-7xvbx" (UID: "2be87eb4-e338-44b2-ab97-dad8edd973f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:39:13.723624 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:13.723588 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rng86\" (UniqueName: \"kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86\") pod \"network-check-target-h2jtk\" (UID: \"8e3cb855-bb8d-4b02-983d-6db5ecc9f278\") " pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:13.723799 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:13.723774 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 16:39:13.723799 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:13.723796 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 16:39:13.723912 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:13.723809 2583 projected.go:196] Error preparing data for projected volume kube-api-access-rng86 for pod openshift-network-diagnostics/network-check-target-h2jtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:39:13.723912 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:13.723874 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86 podName:8e3cb855-bb8d-4b02-983d-6db5ecc9f278 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:29.723856025 +0000 UTC m=+34.208513919 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rng86" (UniqueName: "kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86") pod "network-check-target-h2jtk" (UID: "8e3cb855-bb8d-4b02-983d-6db5ecc9f278") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:39:14.014592 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:14.014461 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:14.014592 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:14.014467 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:14.015133 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:14.014596 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:14.015133 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:14.014675 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:15.014087 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:15.014050 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:15.014305 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:15.014173 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:16.015179 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:16.015143 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:16.015655 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:16.015184 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:16.015655 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:16.015254 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:16.015655 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:16.015307 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:17.014303 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:17.014273 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:17.014476 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:17.014380 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:18.014287 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.013976 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:18.015047 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.014046 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:18.015047 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:18.014376 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:18.015047 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:18.014459 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:18.131779 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.131745 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xn7jj" event={"ID":"d4e36102-8bf2-443b-acb5-ba26c5282f01","Type":"ContainerStarted","Data":"7050aa86f80334adf5fa5f3539848141f47c7907a16f80d42ed23d560ef90c53"} Aug 05 16:39:18.133115 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.133095 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8vklw" event={"ID":"e22a6166-f95e-4fda-9582-27b74c5d7592","Type":"ContainerStarted","Data":"9088809e0dac3a7fd869215260d78d4c3c1c133bc2cee225847cce8f4bf8db06"} Aug 05 16:39:18.134385 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.134369 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" event={"ID":"e80cd850-38f1-4423-af36-37cea3dc1859","Type":"ContainerStarted","Data":"8e054eeac83d9da280f86c67529d751314f5699b6b5550dcf0fb6f020241f8cd"} Aug 05 16:39:18.135764 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.135744 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ghgcw" event={"ID":"3a4923c1-abcf-4998-9757-d6753a11e98a","Type":"ContainerStarted","Data":"50c2dcdeb3e36992b3d66089f946b14a3853b027200145ac39d894b6e267a7b2"} Aug 05 16:39:18.138380 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.138361 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" event={"ID":"e5fbada7-5644-4c41-8bb1-6ea71a042437","Type":"ContainerStarted","Data":"bf2a3e8a312606eff6e93764b0121c255c9373a0caf1f3930ca393bc7e673067"} Aug 05 16:39:18.138475 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.138429 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" event={"ID":"e5fbada7-5644-4c41-8bb1-6ea71a042437","Type":"ContainerStarted","Data":"c5d20cbe26f87bd24bd5cda3893e252dcaddc53e01fdaa966ba6ea19c9a71dff"} Aug 05 16:39:18.138536 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.138483 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" event={"ID":"e5fbada7-5644-4c41-8bb1-6ea71a042437","Type":"ContainerStarted","Data":"fd324be94e3e9c67e80f0705950d6c430aa4c713708853c51942c6c2631d65bd"} Aug 05 16:39:18.138590 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.138534 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" event={"ID":"e5fbada7-5644-4c41-8bb1-6ea71a042437","Type":"ContainerStarted","Data":"c4a1c6af94492136c60d3911a9816c18db89add2024ab547fc8ba8d03c193b9c"} Aug 05 16:39:18.138646 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.138586 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" event={"ID":"e5fbada7-5644-4c41-8bb1-6ea71a042437","Type":"ContainerStarted","Data":"46f20db4efc3d0713a77eb088826630f9fcf376cc52e8813442dc658d067cce2"} Aug 05 16:39:18.138646 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.138637 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" event={"ID":"e5fbada7-5644-4c41-8bb1-6ea71a042437","Type":"ContainerStarted","Data":"2141f3be08e0e96b914e3f47c5f901759efb0fb0df15e136c650d9928a17fad7"} Aug 05 16:39:18.139674 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.139650 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4rm4h" event={"ID":"e6a7f2d4-b9b1-4490-a8ca-913098ec0d8c","Type":"ContainerStarted","Data":"450bf872776f99e93d03fcccd7ef1a1814583560d0869d8dc9ce17891fc369af"} Aug 05 16:39:18.141071 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.141051 2583 generic.go:356] "Generic (PLEG): container finished" podID="052da024-7fa4-4d8d-8229-c77a07da6376" containerID="7f21f01dc435b63d276ae5f86d46cce8a22eabe03b11ed08e23c8e19201947cc" exitCode=0 Aug 05 16:39:18.141163 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.141118 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxqxl" event={"ID":"052da024-7fa4-4d8d-8229-c77a07da6376","Type":"ContainerDied","Data":"7f21f01dc435b63d276ae5f86d46cce8a22eabe03b11ed08e23c8e19201947cc"} Aug 05 16:39:18.142455 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.142432 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m846k" event={"ID":"9df7d7c5-95a4-444e-a727-8a7f8a65be2e","Type":"ContainerStarted","Data":"8f2eeef03e7093c55df68dd5ae536862369434f11787d7b9def80ede5b6586ba"} Aug 05 16:39:18.165167 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.165130 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xn7jj" podStartSLOduration=8.288586367 podStartE2EDuration="22.165117256s" totalImagesPullingTime="13.876530889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:18.147052582 +0000 UTC m=+22.631710462" watchObservedRunningTime="2026-08-05 16:39:18.165117256 +0000 UTC m=+22.649775159" Aug 05 16:39:18.165280 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.165228 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4rm4h" podStartSLOduration=3.745968188 podStartE2EDuration="22.165207088s" totalImagesPullingTime="18.4192389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:18.164802278 +0000 UTC m=+22.649460181" watchObservedRunningTime="2026-08-05 16:39:18.165207088 +0000 UTC m=+22.649864991" Aug 05 16:39:18.180094 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.180058 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ghgcw" podStartSLOduration=3.801039074 podStartE2EDuration="22.180045878s" totalImagesPullingTime="18.379006804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:18.17957117 +0000 UTC m=+22.664229076" watchObservedRunningTime="2026-08-05 16:39:18.180045878 +0000 UTC m=+22.664703823" Aug 05 16:39:18.219392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.219351 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8vklw" podStartSLOduration=3.801504418 podStartE2EDuration="22.219337568s" totalImagesPullingTime="18.41783315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:18.218956574 +0000 UTC m=+22.703614488" watchObservedRunningTime="2026-08-05 16:39:18.219337568 +0000 UTC m=+22.703995471" Aug 05 16:39:18.237297 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.237251 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m846k" podStartSLOduration=3.858576822 podStartE2EDuration="22.237235739s" totalImagesPullingTime="18.378658917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:18.236829061 +0000 UTC m=+22.721486967" watchObservedRunningTime="2026-08-05 16:39:18.237235739 +0000 UTC m=+22.721893642" Aug 05 16:39:18.924648 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.924625 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 05 16:39:18.960879 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.960766 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T16:39:18.924643181Z","UUID":"2822ce24-5d35-4fa7-8bf8-1dfb7d5fa69d","Handler":null,"Name":"","Endpoint":""} Aug 05 16:39:18.962123 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.962102 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 05 16:39:18.962255 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:18.962143 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 05 16:39:19.014591 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:19.014561 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:19.015093 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:19.014676 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:19.146303 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:19.146208 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4q9lm" event={"ID":"40c91398-cab2-44e7-8a20-f25b8f0a73c4","Type":"ContainerStarted","Data":"612af5e4e3a2bd113defa1e558e1abda6008cbb08661eb8d9cb429629206ff9e"} Aug 05 16:39:19.147972 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:19.147945 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" event={"ID":"e80cd850-38f1-4423-af36-37cea3dc1859","Type":"ContainerStarted","Data":"fbb5852726fd11ebaf96da5d3cb60a99f9e0f0362b22058a94570fda617d40a8"} Aug 05 16:39:19.163272 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:19.163230 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4q9lm" podStartSLOduration=4.749425744 podStartE2EDuration="23.163199666s" totalImagesPullingTime="18.413773922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:19.162968357 +0000 UTC m=+23.647626271" watchObservedRunningTime="2026-08-05 16:39:19.163199666 +0000 UTC m=+23.647857568" Aug 05 16:39:20.014735 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:20.014705 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:20.015239 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:20.014827 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:20.015239 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:20.014864 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:20.015239 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:20.014932 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:20.155000 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:20.154956 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" event={"ID":"e5fbada7-5644-4c41-8bb1-6ea71a042437","Type":"ContainerStarted","Data":"e678a2bdf08f1ab2bc1dbcb074992bbb0e0984474eb2baed077002eb39126a06"} Aug 05 16:39:21.014777 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:21.014745 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:21.015362 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:21.014843 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:21.159364 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:21.159327 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" event={"ID":"e80cd850-38f1-4423-af36-37cea3dc1859","Type":"ContainerStarted","Data":"440228d710312a9702e31dd3b4d13b0bcd68ccb7e20913a99abfa2d809f49363"} Aug 05 16:39:21.185430 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:21.185374 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5nc8z" podStartSLOduration=4.213062036 podStartE2EDuration="25.185330178s" totalImagesPullingTime="20.972268142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:21.184747354 +0000 UTC m=+25.669405258" watchObservedRunningTime="2026-08-05 16:39:21.185330178 +0000 UTC m=+25.669988081" Aug 05 16:39:22.015079 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:22.014894 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:22.015516 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:22.014894 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:22.015516 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:22.015164 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:22.015516 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:22.015284 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:22.218533 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:22.218499 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xn7jj" Aug 05 16:39:22.219208 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:22.219186 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xn7jj" Aug 05 16:39:23.014840 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:23.014501 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:23.014840 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:23.014599 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:23.168083 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:23.168015 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" event={"ID":"e5fbada7-5644-4c41-8bb1-6ea71a042437","Type":"ContainerStarted","Data":"0f8a7a281e4f93d00f86478fd0feb2b8d6c9b8f60c3e6141fbb2e692a4f4574d"} Aug 05 16:39:23.168828 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:23.168286 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:39:23.169954 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:23.169932 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxqxl" event={"ID":"052da024-7fa4-4d8d-8229-c77a07da6376","Type":"ContainerStarted","Data":"9331fce42059423483fe6b4b102ac4c4e84b2bf32c697003f4cbcb383b602323"} Aug 05 16:39:23.170121 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:23.170099 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xn7jj" Aug 05 16:39:23.170569 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:23.170554 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xn7jj" Aug 05 16:39:23.186391 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:23.186375 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:39:23.200996 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:23.200960 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" podStartSLOduration=8.725550363 podStartE2EDuration="27.200946306s" totalImagesPullingTime="18.475395943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:23.200273851 +0000 UTC m=+27.684931753" watchObservedRunningTime="2026-08-05 16:39:23.200946306 +0000 UTC m=+27.685604209" Aug 05 16:39:24.014941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:24.014691 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:24.015091 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:24.014725 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:24.015091 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:24.015065 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:24.015164 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:24.015090 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:24.174168 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:24.174032 2583 generic.go:356] "Generic (PLEG): container finished" podID="052da024-7fa4-4d8d-8229-c77a07da6376" containerID="9331fce42059423483fe6b4b102ac4c4e84b2bf32c697003f4cbcb383b602323" exitCode=0 Aug 05 16:39:24.174168 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:24.174127 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxqxl" event={"ID":"052da024-7fa4-4d8d-8229-c77a07da6376","Type":"ContainerDied","Data":"9331fce42059423483fe6b4b102ac4c4e84b2bf32c697003f4cbcb383b602323"} Aug 05 16:39:24.175416 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:24.174962 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:39:24.175416 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:24.175039 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:39:24.197588 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:24.197561 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:39:25.014331 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:25.014303 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:25.014488 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:25.014405 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:25.125355 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:25.125325 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6pglf"] Aug 05 16:39:25.125497 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:25.125434 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:25.125561 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:25.125540 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:25.128443 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:25.128419 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7xvbx"] Aug 05 16:39:25.128563 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:25.128510 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:25.128626 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:25.128608 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:25.129315 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:25.129297 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2jtk"] Aug 05 16:39:25.178543 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:25.178478 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:25.178974 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:25.178693 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:26.182309 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:26.182273 2583 generic.go:356] "Generic (PLEG): container finished" podID="052da024-7fa4-4d8d-8229-c77a07da6376" containerID="b8f6059de2e50b01fe833f30852aa61e68f2917daea35ed0899549615cf43e34" exitCode=0 Aug 05 16:39:26.182754 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:26.182363 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxqxl" event={"ID":"052da024-7fa4-4d8d-8229-c77a07da6376","Type":"ContainerDied","Data":"b8f6059de2e50b01fe833f30852aa61e68f2917daea35ed0899549615cf43e34"} Aug 05 16:39:27.014057 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:27.013813 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:27.014191 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:27.013827 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:27.014191 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:27.014167 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:27.014326 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:27.013837 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:27.014326 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:27.014205 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:27.014403 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:27.014323 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:27.187025 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:27.186991 2583 generic.go:356] "Generic (PLEG): container finished" podID="052da024-7fa4-4d8d-8229-c77a07da6376" containerID="bb6423b9f355cce03bf6e1033d96d79d5943af430f0935640da14a10f65293ac" exitCode=0 Aug 05 16:39:27.187379 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:27.187026 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxqxl" event={"ID":"052da024-7fa4-4d8d-8229-c77a07da6376","Type":"ContainerDied","Data":"bb6423b9f355cce03bf6e1033d96d79d5943af430f0935640da14a10f65293ac"} Aug 05 16:39:29.014539 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:29.014468 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:29.014539 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:29.014483 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:29.014539 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:29.014489 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:29.015087 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:29.014582 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6pglf" podUID="0d5e3b35-ca04-44af-820a-ce5467bd445c" Aug 05 16:39:29.015087 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:29.014641 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2jtk" podUID="8e3cb855-bb8d-4b02-983d-6db5ecc9f278" Aug 05 16:39:29.015087 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:29.014763 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7xvbx" podUID="2be87eb4-e338-44b2-ab97-dad8edd973f1" Aug 05 16:39:29.644485 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:29.644443 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:29.644485 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:29.644492 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:29.644694 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:29.644576 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 16:39:29.644694 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:29.644590 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:39:29.644694 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:29.644632 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret podName:0d5e3b35-ca04-44af-820a-ce5467bd445c nodeName:}" failed. No retries permitted until 2026-08-05 16:40:01.644616596 +0000 UTC m=+66.129274478 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret") pod "global-pull-secret-syncer-6pglf" (UID: "0d5e3b35-ca04-44af-820a-ce5467bd445c") : object "kube-system"/"original-pull-secret" not registered Aug 05 16:39:29.644694 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:29.644647 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs podName:2be87eb4-e338-44b2-ab97-dad8edd973f1 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:01.644640229 +0000 UTC m=+66.129298110 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs") pod "network-metrics-daemon-7xvbx" (UID: "2be87eb4-e338-44b2-ab97-dad8edd973f1") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 16:39:29.745481 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:29.745449 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rng86\" (UniqueName: \"kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86\") pod \"network-check-target-h2jtk\" (UID: \"8e3cb855-bb8d-4b02-983d-6db5ecc9f278\") " pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:29.745621 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:29.745596 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 16:39:29.745621 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:29.745616 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 16:39:29.745689 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:29.745625 2583 projected.go:196] Error preparing data for projected volume kube-api-access-rng86 for pod openshift-network-diagnostics/network-check-target-h2jtk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:39:29.745689 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:29.745671 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86 podName:8e3cb855-bb8d-4b02-983d-6db5ecc9f278 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:01.745657715 +0000 UTC m=+66.230315601 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rng86" (UniqueName: "kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86") pod "network-check-target-h2jtk" (UID: "8e3cb855-bb8d-4b02-983d-6db5ecc9f278") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 16:39:30.351887 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.351858 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeReady" Aug 05 16:39:30.352352 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.352001 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 05 16:39:30.400563 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.400524 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hmj89"] Aug 05 16:39:30.405119 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.405092 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9tkn4"] Aug 05 16:39:30.405260 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.405234 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:30.408265 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.408242 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9tkn4" Aug 05 16:39:30.408500 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.408483 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p9jdc\"" Aug 05 16:39:30.409128 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.409108 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 05 16:39:30.409128 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.409117 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 05 16:39:30.410858 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.410839 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 05 16:39:30.411066 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.411047 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 05 16:39:30.411478 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.411443 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jb59q\"" Aug 05 16:39:30.411478 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.411463 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 05 16:39:30.418403 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.418342 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmj89"] Aug 05 16:39:30.419155 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.419135 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9tkn4"] Aug 05 16:39:30.550722 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.550688 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spsk2\" (UniqueName: \"kubernetes.io/projected/b28faef1-bf15-45a5-8eb9-6cf946def73a-kube-api-access-spsk2\") pod \"ingress-canary-9tkn4\" (UID: \"b28faef1-bf15-45a5-8eb9-6cf946def73a\") " pod="openshift-ingress-canary/ingress-canary-9tkn4" Aug 05 16:39:30.550722 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.550727 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:30.550904 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.550761 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e95720f1-0e6c-48d4-971d-1f8b080b55fc-config-volume\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:30.550904 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.550870 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b28faef1-bf15-45a5-8eb9-6cf946def73a-cert\") pod \"ingress-canary-9tkn4\" (UID: \"b28faef1-bf15-45a5-8eb9-6cf946def73a\") " pod="openshift-ingress-canary/ingress-canary-9tkn4" Aug 05 16:39:30.550904 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.550899 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvqpw\" (UniqueName: \"kubernetes.io/projected/e95720f1-0e6c-48d4-971d-1f8b080b55fc-kube-api-access-zvqpw\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:30.551045 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.550920 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e95720f1-0e6c-48d4-971d-1f8b080b55fc-tmp-dir\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:30.652161 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.652074 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b28faef1-bf15-45a5-8eb9-6cf946def73a-cert\") pod \"ingress-canary-9tkn4\" (UID: \"b28faef1-bf15-45a5-8eb9-6cf946def73a\") " pod="openshift-ingress-canary/ingress-canary-9tkn4" Aug 05 16:39:30.652161 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.652124 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvqpw\" (UniqueName: \"kubernetes.io/projected/e95720f1-0e6c-48d4-971d-1f8b080b55fc-kube-api-access-zvqpw\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:30.652161 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.652155 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e95720f1-0e6c-48d4-971d-1f8b080b55fc-tmp-dir\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:30.652416 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.652203 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spsk2\" (UniqueName: \"kubernetes.io/projected/b28faef1-bf15-45a5-8eb9-6cf946def73a-kube-api-access-spsk2\") pod \"ingress-canary-9tkn4\" (UID: \"b28faef1-bf15-45a5-8eb9-6cf946def73a\") " pod="openshift-ingress-canary/ingress-canary-9tkn4" Aug 05 16:39:30.652416 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.652252 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:30.652416 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.652292 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e95720f1-0e6c-48d4-971d-1f8b080b55fc-config-volume\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:30.652541 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:30.652442 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 16:39:30.652541 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:30.652514 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls podName:e95720f1-0e6c-48d4-971d-1f8b080b55fc nodeName:}" failed. No retries permitted until 2026-08-05 16:39:31.152494743 +0000 UTC m=+35.637152644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls") pod "dns-default-hmj89" (UID: "e95720f1-0e6c-48d4-971d-1f8b080b55fc") : secret "dns-default-metrics-tls" not found Aug 05 16:39:30.652640 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.652558 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e95720f1-0e6c-48d4-971d-1f8b080b55fc-tmp-dir\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:30.652850 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.652830 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e95720f1-0e6c-48d4-971d-1f8b080b55fc-config-volume\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:30.656754 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.656730 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b28faef1-bf15-45a5-8eb9-6cf946def73a-cert\") pod \"ingress-canary-9tkn4\" (UID: \"b28faef1-bf15-45a5-8eb9-6cf946def73a\") " pod="openshift-ingress-canary/ingress-canary-9tkn4" Aug 05 16:39:30.663669 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.663645 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvqpw\" (UniqueName: \"kubernetes.io/projected/e95720f1-0e6c-48d4-971d-1f8b080b55fc-kube-api-access-zvqpw\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:30.663891 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.663866 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spsk2\" (UniqueName: \"kubernetes.io/projected/b28faef1-bf15-45a5-8eb9-6cf946def73a-kube-api-access-spsk2\") pod \"ingress-canary-9tkn4\" (UID: \"b28faef1-bf15-45a5-8eb9-6cf946def73a\") " pod="openshift-ingress-canary/ingress-canary-9tkn4" Aug 05 16:39:30.722861 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:30.722822 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9tkn4" Aug 05 16:39:31.014252 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:31.014145 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:39:31.014252 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:31.014200 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:39:31.014505 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:31.014481 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:39:31.017387 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:31.017365 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cn6w5\"" Aug 05 16:39:31.017503 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:31.017413 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 16:39:31.018591 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:31.018573 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7qbz9\"" Aug 05 16:39:31.018707 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:31.018687 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 05 16:39:31.022297 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:31.019619 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 05 16:39:31.022297 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:31.019671 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 16:39:31.155565 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:31.155532 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:31.155749 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:31.155713 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 16:39:31.155811 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:31.155792 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls podName:e95720f1-0e6c-48d4-971d-1f8b080b55fc nodeName:}" failed. No retries permitted until 2026-08-05 16:39:32.155769165 +0000 UTC m=+36.640427047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls") pod "dns-default-hmj89" (UID: "e95720f1-0e6c-48d4-971d-1f8b080b55fc") : secret "dns-default-metrics-tls" not found Aug 05 16:39:31.986480 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:31.986287 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9tkn4"] Aug 05 16:39:31.991484 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:39:31.991461 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28faef1_bf15_45a5_8eb9_6cf946def73a.slice/crio-7e5f3fee85220a0899e600567b79cdb981ae0d5f2258179d0ca6bef0cbe52d80 WatchSource:0}: Error finding container 7e5f3fee85220a0899e600567b79cdb981ae0d5f2258179d0ca6bef0cbe52d80: Status 404 returned error can't find the container with id 7e5f3fee85220a0899e600567b79cdb981ae0d5f2258179d0ca6bef0cbe52d80 Aug 05 16:39:32.163186 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:32.163158 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:32.163348 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:32.163328 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 16:39:32.163426 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:32.163416 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls podName:e95720f1-0e6c-48d4-971d-1f8b080b55fc nodeName:}" failed. No retries permitted until 2026-08-05 16:39:34.163399315 +0000 UTC m=+38.648057219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls") pod "dns-default-hmj89" (UID: "e95720f1-0e6c-48d4-971d-1f8b080b55fc") : secret "dns-default-metrics-tls" not found Aug 05 16:39:32.201765 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:32.201738 2583 generic.go:356] "Generic (PLEG): container finished" podID="052da024-7fa4-4d8d-8229-c77a07da6376" containerID="a21260fb5e586e8c54a17c921dbdb5ed8b17613198a4fb1d1e987a069454ca50" exitCode=0 Aug 05 16:39:32.201896 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:32.201809 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxqxl" event={"ID":"052da024-7fa4-4d8d-8229-c77a07da6376","Type":"ContainerDied","Data":"a21260fb5e586e8c54a17c921dbdb5ed8b17613198a4fb1d1e987a069454ca50"} Aug 05 16:39:32.202892 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:32.202872 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9tkn4" event={"ID":"b28faef1-bf15-45a5-8eb9-6cf946def73a","Type":"ContainerStarted","Data":"7e5f3fee85220a0899e600567b79cdb981ae0d5f2258179d0ca6bef0cbe52d80"} Aug 05 16:39:33.209192 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:33.209157 2583 generic.go:356] "Generic (PLEG): container finished" podID="052da024-7fa4-4d8d-8229-c77a07da6376" containerID="982b5ed2ed7eb0224d69ac71cc6c8f4c37cf57da1b0114288d787c1366cadd65" exitCode=0 Aug 05 16:39:33.209700 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:33.209203 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxqxl" event={"ID":"052da024-7fa4-4d8d-8229-c77a07da6376","Type":"ContainerDied","Data":"982b5ed2ed7eb0224d69ac71cc6c8f4c37cf57da1b0114288d787c1366cadd65"} Aug 05 16:39:34.180771 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:34.180739 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:34.180935 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:34.180878 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 16:39:34.180982 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:34.180938 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls podName:e95720f1-0e6c-48d4-971d-1f8b080b55fc nodeName:}" failed. No retries permitted until 2026-08-05 16:39:38.180923601 +0000 UTC m=+42.665581482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls") pod "dns-default-hmj89" (UID: "e95720f1-0e6c-48d4-971d-1f8b080b55fc") : secret "dns-default-metrics-tls" not found Aug 05 16:39:34.215086 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:34.215006 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxqxl" event={"ID":"052da024-7fa4-4d8d-8229-c77a07da6376","Type":"ContainerStarted","Data":"cdce85336325aa36a24f4a9108cb9f40cdd1141e3c74923b05299b1386c167de"} Aug 05 16:39:34.246084 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:34.246034 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jxqxl" podStartSLOduration=8.355103122 podStartE2EDuration="38.246018912s" totalImagesPullingTime="29.89091579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:34.245591065 +0000 UTC m=+38.730248967" watchObservedRunningTime="2026-08-05 16:39:34.246018912 +0000 UTC m=+38.730676815" Aug 05 16:39:35.219283 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:35.219082 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9tkn4" event={"ID":"b28faef1-bf15-45a5-8eb9-6cf946def73a","Type":"ContainerStarted","Data":"377a13d1b543019c7556481b080346f3a7a77767f616b69a6ebfd74533c3ccb3"} Aug 05 16:39:38.210762 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:38.210728 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:38.211153 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:38.210843 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 16:39:38.211153 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:38.210896 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls podName:e95720f1-0e6c-48d4-971d-1f8b080b55fc nodeName:}" failed. No retries permitted until 2026-08-05 16:39:46.210881801 +0000 UTC m=+50.695539681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls") pod "dns-default-hmj89" (UID: "e95720f1-0e6c-48d4-971d-1f8b080b55fc") : secret "dns-default-metrics-tls" not found Aug 05 16:39:46.270022 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:46.269991 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:39:46.270432 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:46.270140 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 16:39:46.270432 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:39:46.270200 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls podName:e95720f1-0e6c-48d4-971d-1f8b080b55fc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:02.27018496 +0000 UTC m=+66.754842840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls") pod "dns-default-hmj89" (UID: "e95720f1-0e6c-48d4-971d-1f8b080b55fc") : secret "dns-default-metrics-tls" not found Aug 05 16:39:56.199372 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:56.199345 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gnvfn" Aug 05 16:39:56.232150 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:39:56.232101 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9tkn4" podStartSLOduration=23.716833414 podStartE2EDuration="26.232087136s" totalImagesPullingTime="2.515253722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:35.241095553 +0000 UTC m=+39.725753457" watchObservedRunningTime="2026-08-05 16:39:56.232087136 +0000 UTC m=+60.716745060" Aug 05 16:40:01.677402 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:01.677360 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:40:01.677861 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:01.677422 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:40:01.680971 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:01.680950 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 16:40:01.681079 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:01.681031 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 16:40:01.687571 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:01.687547 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 05 16:40:01.687670 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:01.687632 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs podName:2be87eb4-e338-44b2-ab97-dad8edd973f1 nodeName:}" failed. No retries permitted until 2026-08-05 16:41:05.687609344 +0000 UTC m=+130.172267243 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs") pod "network-metrics-daemon-7xvbx" (UID: "2be87eb4-e338-44b2-ab97-dad8edd973f1") : secret "metrics-daemon-secret" not found Aug 05 16:40:01.691418 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:01.691397 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0d5e3b35-ca04-44af-820a-ce5467bd445c-original-pull-secret\") pod \"global-pull-secret-syncer-6pglf\" (UID: \"0d5e3b35-ca04-44af-820a-ce5467bd445c\") " pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:40:01.778366 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:01.778324 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rng86\" (UniqueName: \"kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86\") pod \"network-check-target-h2jtk\" (UID: \"8e3cb855-bb8d-4b02-983d-6db5ecc9f278\") " pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:40:01.781224 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:01.781198 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 05 16:40:01.791616 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:01.791601 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 05 16:40:01.801486 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:01.801458 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rng86\" (UniqueName: \"kubernetes.io/projected/8e3cb855-bb8d-4b02-983d-6db5ecc9f278-kube-api-access-rng86\") pod \"network-check-target-h2jtk\" (UID: \"8e3cb855-bb8d-4b02-983d-6db5ecc9f278\") " pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:40:01.930496 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:01.930429 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cn6w5\"" Aug 05 16:40:01.937863 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:01.937842 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:40:01.939070 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:01.939055 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6pglf" Aug 05 16:40:02.113562 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:02.113532 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2jtk"] Aug 05 16:40:02.116968 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:02.116947 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3cb855_bb8d_4b02_983d_6db5ecc9f278.slice/crio-5b1c77a11c9c01014cdfb96369bdf99b4e93f90cec78533d45c05db0b595c2c4 WatchSource:0}: Error finding container 5b1c77a11c9c01014cdfb96369bdf99b4e93f90cec78533d45c05db0b595c2c4: Status 404 returned error can't find the container with id 5b1c77a11c9c01014cdfb96369bdf99b4e93f90cec78533d45c05db0b595c2c4 Aug 05 16:40:02.146679 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:02.146654 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6pglf"] Aug 05 16:40:02.149709 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:02.149688 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d5e3b35_ca04_44af_820a_ce5467bd445c.slice/crio-9eb6fee2af2e9cc6917c4f6931542b92c87cdc6b85d210ff6ae5692143c205b3 WatchSource:0}: Error finding container 9eb6fee2af2e9cc6917c4f6931542b92c87cdc6b85d210ff6ae5692143c205b3: Status 404 returned error can't find the container with id 9eb6fee2af2e9cc6917c4f6931542b92c87cdc6b85d210ff6ae5692143c205b3 Aug 05 16:40:02.281833 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:02.281735 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:40:02.281970 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:02.281839 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 16:40:02.281970 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:02.281903 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls podName:e95720f1-0e6c-48d4-971d-1f8b080b55fc nodeName:}" failed. No retries permitted until 2026-08-05 16:40:34.281882298 +0000 UTC m=+98.766540197 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls") pod "dns-default-hmj89" (UID: "e95720f1-0e6c-48d4-971d-1f8b080b55fc") : secret "dns-default-metrics-tls" not found Aug 05 16:40:02.284501 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:02.284473 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6pglf" event={"ID":"0d5e3b35-ca04-44af-820a-ce5467bd445c","Type":"ContainerStarted","Data":"9eb6fee2af2e9cc6917c4f6931542b92c87cdc6b85d210ff6ae5692143c205b3"} Aug 05 16:40:02.285422 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:02.285402 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2jtk" event={"ID":"8e3cb855-bb8d-4b02-983d-6db5ecc9f278","Type":"ContainerStarted","Data":"5b1c77a11c9c01014cdfb96369bdf99b4e93f90cec78533d45c05db0b595c2c4"} Aug 05 16:40:07.301045 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:07.301004 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6pglf" event={"ID":"0d5e3b35-ca04-44af-820a-ce5467bd445c","Type":"ContainerStarted","Data":"211101f1aae9af9a543a89f17cabcb7e6646fd1662ece0036856aa6352b9ff5c"} Aug 05 16:40:07.302567 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:07.302539 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2jtk" event={"ID":"8e3cb855-bb8d-4b02-983d-6db5ecc9f278","Type":"ContainerStarted","Data":"28bf2f8df33d2cc8dfb245aeafbb36f3efb79d3b5acb4b284171ba10cc551f04"} Aug 05 16:40:07.302685 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:07.302664 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:40:07.317898 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:07.317844 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6pglf" podStartSLOduration=66.315834018 podStartE2EDuration="1m11.317827861s" totalImagesPullingTime="5.001993843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:07.317592006 +0000 UTC m=+71.802249950" watchObservedRunningTime="2026-08-05 16:40:07.317827861 +0000 UTC m=+71.802485765" Aug 05 16:40:07.334017 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:07.333968 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h2jtk" podStartSLOduration=66.300533188 podStartE2EDuration="1m11.333953302s" totalImagesPullingTime="5.033420114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:07.33354409 +0000 UTC m=+71.818201993" watchObservedRunningTime="2026-08-05 16:40:07.333953302 +0000 UTC m=+71.818611204" Aug 05 16:40:09.907975 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:09.907940 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj"] Aug 05 16:40:09.909707 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:09.909685 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:09.913528 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:09.913511 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 05 16:40:09.913625 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:09.913536 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s2jtm\"" Aug 05 16:40:09.914910 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:09.914856 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Aug 05 16:40:09.915165 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:09.914944 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Aug 05 16:40:09.915165 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:09.914972 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 05 16:40:09.923232 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:09.923192 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj"] Aug 05 16:40:09.929811 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:09.929789 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rcqr\" (UniqueName: \"kubernetes.io/projected/1eb27246-de51-450d-9ca9-c30c76faa40f-kube-api-access-9rcqr\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:09.929899 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:09.929838 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:09.929899 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:09.929880 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1eb27246-de51-450d-9ca9-c30c76faa40f-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:10.017124 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.017098 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rrqd6"] Aug 05 16:40:10.018787 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.018772 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rrqd6" Aug 05 16:40:10.023898 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.023875 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Aug 05 16:40:10.024053 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.023903 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7sxn8\"" Aug 05 16:40:10.024053 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.024024 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Aug 05 16:40:10.030826 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.030803 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rcqr\" (UniqueName: \"kubernetes.io/projected/1eb27246-de51-450d-9ca9-c30c76faa40f-kube-api-access-9rcqr\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:10.030926 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.030850 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:10.030926 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.030901 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1eb27246-de51-450d-9ca9-c30c76faa40f-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:10.031002 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:10.030984 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 16:40:10.031069 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:10.031051 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls podName:1eb27246-de51-450d-9ca9-c30c76faa40f nodeName:}" failed. No retries permitted until 2026-08-05 16:40:10.531035595 +0000 UTC m=+75.015693481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-8qjpj" (UID: "1eb27246-de51-450d-9ca9-c30c76faa40f") : secret "cluster-monitoring-operator-tls" not found Aug 05 16:40:10.031127 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.031079 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qflsf\" (UniqueName: \"kubernetes.io/projected/5daf1970-c202-45b1-89b4-b80a90db4997-kube-api-access-qflsf\") pod \"volume-data-source-validator-5b8776669-rrqd6\" (UID: \"5daf1970-c202-45b1-89b4-b80a90db4997\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rrqd6" Aug 05 16:40:10.031659 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.031637 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1eb27246-de51-450d-9ca9-c30c76faa40f-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:10.032797 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.032775 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rrqd6"] Aug 05 16:40:10.048766 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.048736 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rcqr\" (UniqueName: \"kubernetes.io/projected/1eb27246-de51-450d-9ca9-c30c76faa40f-kube-api-access-9rcqr\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:10.124338 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.124303 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb"] Aug 05 16:40:10.126361 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.126330 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-29j7x"] Aug 05 16:40:10.126492 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.126443 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:10.127819 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.127799 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.129784 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.129758 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Aug 05 16:40:10.129859 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.129805 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Aug 05 16:40:10.131160 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.131143 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Aug 05 16:40:10.131279 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.131148 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7xmp8\"" Aug 05 16:40:10.131377 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.131359 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/297b8597-8acf-413e-b72b-9da7dc7abf60-serving-cert\") pod \"console-operator-5ccd6b445f-29j7x\" (UID: \"297b8597-8acf-413e-b72b-9da7dc7abf60\") " pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.131429 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.131391 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwlsl\" (UniqueName: \"kubernetes.io/projected/297b8597-8acf-413e-b72b-9da7dc7abf60-kube-api-access-fwlsl\") pod \"console-operator-5ccd6b445f-29j7x\" (UID: \"297b8597-8acf-413e-b72b-9da7dc7abf60\") " pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.131429 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.131422 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qflsf\" (UniqueName: \"kubernetes.io/projected/5daf1970-c202-45b1-89b4-b80a90db4997-kube-api-access-qflsf\") pod \"volume-data-source-validator-5b8776669-rrqd6\" (UID: \"5daf1970-c202-45b1-89b4-b80a90db4997\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rrqd6" Aug 05 16:40:10.131525 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.131448 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-bzhhb\" (UID: \"9cde059e-1d59-4073-ad06-cf06124089dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:10.131525 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.131480 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/297b8597-8acf-413e-b72b-9da7dc7abf60-trusted-ca\") pod \"console-operator-5ccd6b445f-29j7x\" (UID: \"297b8597-8acf-413e-b72b-9da7dc7abf60\") " pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.131525 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.131500 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/297b8597-8acf-413e-b72b-9da7dc7abf60-config\") pod \"console-operator-5ccd6b445f-29j7x\" (UID: \"297b8597-8acf-413e-b72b-9da7dc7abf60\") " pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.131525 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.131522 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv2pn\" (UniqueName: \"kubernetes.io/projected/9cde059e-1d59-4073-ad06-cf06124089dd-kube-api-access-dv2pn\") pod \"cluster-samples-operator-559cbf5745-bzhhb\" (UID: \"9cde059e-1d59-4073-ad06-cf06124089dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:10.131848 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.131827 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Aug 05 16:40:10.132065 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.132050 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Aug 05 16:40:10.132402 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.132388 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Aug 05 16:40:10.133427 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.133407 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Aug 05 16:40:10.133535 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.133519 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wxtlg\"" Aug 05 16:40:10.139791 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.139762 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Aug 05 16:40:10.141159 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.141137 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-29j7x"] Aug 05 16:40:10.145570 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.145548 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb"] Aug 05 16:40:10.153434 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.153412 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qflsf\" (UniqueName: \"kubernetes.io/projected/5daf1970-c202-45b1-89b4-b80a90db4997-kube-api-access-qflsf\") pod \"volume-data-source-validator-5b8776669-rrqd6\" (UID: \"5daf1970-c202-45b1-89b4-b80a90db4997\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rrqd6" Aug 05 16:40:10.232504 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.232401 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/297b8597-8acf-413e-b72b-9da7dc7abf60-trusted-ca\") pod \"console-operator-5ccd6b445f-29j7x\" (UID: \"297b8597-8acf-413e-b72b-9da7dc7abf60\") " pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.232504 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.232450 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/297b8597-8acf-413e-b72b-9da7dc7abf60-config\") pod \"console-operator-5ccd6b445f-29j7x\" (UID: \"297b8597-8acf-413e-b72b-9da7dc7abf60\") " pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.232504 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.232476 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv2pn\" (UniqueName: \"kubernetes.io/projected/9cde059e-1d59-4073-ad06-cf06124089dd-kube-api-access-dv2pn\") pod \"cluster-samples-operator-559cbf5745-bzhhb\" (UID: \"9cde059e-1d59-4073-ad06-cf06124089dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:10.232781 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.232556 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/297b8597-8acf-413e-b72b-9da7dc7abf60-serving-cert\") pod \"console-operator-5ccd6b445f-29j7x\" (UID: \"297b8597-8acf-413e-b72b-9da7dc7abf60\") " pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.232781 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.232579 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwlsl\" (UniqueName: \"kubernetes.io/projected/297b8597-8acf-413e-b72b-9da7dc7abf60-kube-api-access-fwlsl\") pod \"console-operator-5ccd6b445f-29j7x\" (UID: \"297b8597-8acf-413e-b72b-9da7dc7abf60\") " pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.232781 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.232604 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-bzhhb\" (UID: \"9cde059e-1d59-4073-ad06-cf06124089dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:10.236237 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:10.232739 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 16:40:10.236237 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:10.233479 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls podName:9cde059e-1d59-4073-ad06-cf06124089dd nodeName:}" failed. No retries permitted until 2026-08-05 16:40:10.73345403 +0000 UTC m=+75.218111914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-bzhhb" (UID: "9cde059e-1d59-4073-ad06-cf06124089dd") : secret "samples-operator-tls" not found Aug 05 16:40:10.236237 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.233679 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/297b8597-8acf-413e-b72b-9da7dc7abf60-config\") pod \"console-operator-5ccd6b445f-29j7x\" (UID: \"297b8597-8acf-413e-b72b-9da7dc7abf60\") " pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.236237 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.233950 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/297b8597-8acf-413e-b72b-9da7dc7abf60-trusted-ca\") pod \"console-operator-5ccd6b445f-29j7x\" (UID: \"297b8597-8acf-413e-b72b-9da7dc7abf60\") " pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.237875 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.237853 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/297b8597-8acf-413e-b72b-9da7dc7abf60-serving-cert\") pod \"console-operator-5ccd6b445f-29j7x\" (UID: \"297b8597-8acf-413e-b72b-9da7dc7abf60\") " pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.243508 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.243487 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv2pn\" (UniqueName: \"kubernetes.io/projected/9cde059e-1d59-4073-ad06-cf06124089dd-kube-api-access-dv2pn\") pod \"cluster-samples-operator-559cbf5745-bzhhb\" (UID: \"9cde059e-1d59-4073-ad06-cf06124089dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:10.243753 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.243732 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwlsl\" (UniqueName: \"kubernetes.io/projected/297b8597-8acf-413e-b72b-9da7dc7abf60-kube-api-access-fwlsl\") pod \"console-operator-5ccd6b445f-29j7x\" (UID: \"297b8597-8acf-413e-b72b-9da7dc7abf60\") " pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.327032 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.327007 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rrqd6" Aug 05 16:40:10.442907 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.442868 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:10.446639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.446616 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rrqd6"] Aug 05 16:40:10.449984 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:10.449961 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5daf1970_c202_45b1_89b4_b80a90db4997.slice/crio-8c3059ac1a2de57c4df080b9f5276519f77db49e9378715bda8a96a97b5e4b0e WatchSource:0}: Error finding container 8c3059ac1a2de57c4df080b9f5276519f77db49e9378715bda8a96a97b5e4b0e: Status 404 returned error can't find the container with id 8c3059ac1a2de57c4df080b9f5276519f77db49e9378715bda8a96a97b5e4b0e Aug 05 16:40:10.535922 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.535879 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:10.536100 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:10.536053 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 16:40:10.536164 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:10.536139 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls podName:1eb27246-de51-450d-9ca9-c30c76faa40f nodeName:}" failed. No retries permitted until 2026-08-05 16:40:11.536117144 +0000 UTC m=+76.020775048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-8qjpj" (UID: "1eb27246-de51-450d-9ca9-c30c76faa40f") : secret "cluster-monitoring-operator-tls" not found Aug 05 16:40:10.563324 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.563291 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-29j7x"] Aug 05 16:40:10.566066 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:10.566044 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297b8597_8acf_413e_b72b_9da7dc7abf60.slice/crio-ecc1af2e7b0aa8c4e079a5ac9baaa2a3b70e157029c607500b77360d166d19cd WatchSource:0}: Error finding container ecc1af2e7b0aa8c4e079a5ac9baaa2a3b70e157029c607500b77360d166d19cd: Status 404 returned error can't find the container with id ecc1af2e7b0aa8c4e079a5ac9baaa2a3b70e157029c607500b77360d166d19cd Aug 05 16:40:10.737123 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:10.737083 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-bzhhb\" (UID: \"9cde059e-1d59-4073-ad06-cf06124089dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:10.737310 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:10.737247 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 16:40:10.737353 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:10.737314 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls podName:9cde059e-1d59-4073-ad06-cf06124089dd nodeName:}" failed. No retries permitted until 2026-08-05 16:40:11.737298056 +0000 UTC m=+76.221955937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-bzhhb" (UID: "9cde059e-1d59-4073-ad06-cf06124089dd") : secret "samples-operator-tls" not found Aug 05 16:40:11.314289 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:11.314197 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rrqd6" event={"ID":"5daf1970-c202-45b1-89b4-b80a90db4997","Type":"ContainerStarted","Data":"8c3059ac1a2de57c4df080b9f5276519f77db49e9378715bda8a96a97b5e4b0e"} Aug 05 16:40:11.315888 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:11.315858 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" event={"ID":"297b8597-8acf-413e-b72b-9da7dc7abf60","Type":"ContainerStarted","Data":"ecc1af2e7b0aa8c4e079a5ac9baaa2a3b70e157029c607500b77360d166d19cd"} Aug 05 16:40:11.544862 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:11.544825 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:11.545025 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:11.544999 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 16:40:11.545096 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:11.545081 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls podName:1eb27246-de51-450d-9ca9-c30c76faa40f nodeName:}" failed. No retries permitted until 2026-08-05 16:40:13.545061158 +0000 UTC m=+78.029719058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-8qjpj" (UID: "1eb27246-de51-450d-9ca9-c30c76faa40f") : secret "cluster-monitoring-operator-tls" not found Aug 05 16:40:11.745702 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:11.745662 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-bzhhb\" (UID: \"9cde059e-1d59-4073-ad06-cf06124089dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:11.745859 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:11.745815 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 16:40:11.745896 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:11.745876 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls podName:9cde059e-1d59-4073-ad06-cf06124089dd nodeName:}" failed. No retries permitted until 2026-08-05 16:40:13.745860243 +0000 UTC m=+78.230518143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-bzhhb" (UID: "9cde059e-1d59-4073-ad06-cf06124089dd") : secret "samples-operator-tls" not found Aug 05 16:40:12.320870 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:12.320829 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rrqd6" event={"ID":"5daf1970-c202-45b1-89b4-b80a90db4997","Type":"ContainerStarted","Data":"ce535eb4276ced36be234423509df7f796e344314019e229906f17b933f9825e"} Aug 05 16:40:12.337618 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:12.337558 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-rrqd6" podStartSLOduration=2.014093857 podStartE2EDuration="3.337541539s" totalImagesPullingTime="1.323447682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:12.336421136 +0000 UTC m=+76.821079058" watchObservedRunningTime="2026-08-05 16:40:12.337541539 +0000 UTC m=+76.822199441" Aug 05 16:40:13.325252 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:13.325207 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/0.log" Aug 05 16:40:13.325717 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:13.325270 2583 generic.go:356] "Generic (PLEG): container finished" podID="297b8597-8acf-413e-b72b-9da7dc7abf60" containerID="64a2e9b081685d3c32e4b8fcb7a5bb6c26559a3bc6155d95abb23498285f039c" exitCode=255 Aug 05 16:40:13.325717 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:13.325360 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" event={"ID":"297b8597-8acf-413e-b72b-9da7dc7abf60","Type":"ContainerDied","Data":"64a2e9b081685d3c32e4b8fcb7a5bb6c26559a3bc6155d95abb23498285f039c"} Aug 05 16:40:13.325717 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:13.325502 2583 scope.go:117] "RemoveContainer" containerID="64a2e9b081685d3c32e4b8fcb7a5bb6c26559a3bc6155d95abb23498285f039c" Aug 05 16:40:13.561397 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:13.561358 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:13.561545 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:13.561503 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 16:40:13.561584 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:13.561568 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls podName:1eb27246-de51-450d-9ca9-c30c76faa40f nodeName:}" failed. No retries permitted until 2026-08-05 16:40:17.561552574 +0000 UTC m=+82.046210455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-8qjpj" (UID: "1eb27246-de51-450d-9ca9-c30c76faa40f") : secret "cluster-monitoring-operator-tls" not found Aug 05 16:40:13.763359 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:13.763324 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-bzhhb\" (UID: \"9cde059e-1d59-4073-ad06-cf06124089dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:13.763484 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:13.763473 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 16:40:13.763544 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:13.763534 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls podName:9cde059e-1d59-4073-ad06-cf06124089dd nodeName:}" failed. No retries permitted until 2026-08-05 16:40:17.763519046 +0000 UTC m=+82.248176933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-bzhhb" (UID: "9cde059e-1d59-4073-ad06-cf06124089dd") : secret "samples-operator-tls" not found Aug 05 16:40:14.330261 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.330235 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/1.log" Aug 05 16:40:14.330712 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.330617 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/0.log" Aug 05 16:40:14.330712 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.330655 2583 generic.go:356] "Generic (PLEG): container finished" podID="297b8597-8acf-413e-b72b-9da7dc7abf60" containerID="9e5bf8b4cfd27ea5f5efefc655d7b00b5f7e1c0ca8f84bc2fc163fdd7d447ed2" exitCode=255 Aug 05 16:40:14.330804 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.330720 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" event={"ID":"297b8597-8acf-413e-b72b-9da7dc7abf60","Type":"ContainerDied","Data":"9e5bf8b4cfd27ea5f5efefc655d7b00b5f7e1c0ca8f84bc2fc163fdd7d447ed2"} Aug 05 16:40:14.330804 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.330773 2583 scope.go:117] "RemoveContainer" containerID="64a2e9b081685d3c32e4b8fcb7a5bb6c26559a3bc6155d95abb23498285f039c" Aug 05 16:40:14.330955 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.330939 2583 scope.go:117] "RemoveContainer" containerID="9e5bf8b4cfd27ea5f5efefc655d7b00b5f7e1c0ca8f84bc2fc163fdd7d447ed2" Aug 05 16:40:14.331134 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:14.331112 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-29j7x_openshift-console-operator(297b8597-8acf-413e-b72b-9da7dc7abf60)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" podUID="297b8597-8acf-413e-b72b-9da7dc7abf60" Aug 05 16:40:14.692323 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.692292 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-8grqn"] Aug 05 16:40:14.696259 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.696244 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:14.698681 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.698646 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h25hs\"" Aug 05 16:40:14.698859 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.698730 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Aug 05 16:40:14.698951 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.698936 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Aug 05 16:40:14.706150 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.706132 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-8grqn"] Aug 05 16:40:14.770395 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.770371 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-8grqn\" (UID: \"77f7cb9f-0392-411e-8f7d-3df14a5a1faf\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:14.770542 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.770453 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8grqn\" (UID: \"77f7cb9f-0392-411e-8f7d-3df14a5a1faf\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:14.871268 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.871231 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8grqn\" (UID: \"77f7cb9f-0392-411e-8f7d-3df14a5a1faf\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:14.871390 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.871291 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-8grqn\" (UID: \"77f7cb9f-0392-411e-8f7d-3df14a5a1faf\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:14.871390 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:14.871322 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 16:40:14.871390 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:14.871380 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert podName:77f7cb9f-0392-411e-8f7d-3df14a5a1faf nodeName:}" failed. No retries permitted until 2026-08-05 16:40:15.371364601 +0000 UTC m=+79.856022482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8grqn" (UID: "77f7cb9f-0392-411e-8f7d-3df14a5a1faf") : secret "networking-console-plugin-cert" not found Aug 05 16:40:14.871851 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:14.871835 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-8grqn\" (UID: \"77f7cb9f-0392-411e-8f7d-3df14a5a1faf\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:15.334429 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:15.334401 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/1.log" Aug 05 16:40:15.334790 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:15.334696 2583 scope.go:117] "RemoveContainer" containerID="9e5bf8b4cfd27ea5f5efefc655d7b00b5f7e1c0ca8f84bc2fc163fdd7d447ed2" Aug 05 16:40:15.334844 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:15.334825 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-29j7x_openshift-console-operator(297b8597-8acf-413e-b72b-9da7dc7abf60)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" podUID="297b8597-8acf-413e-b72b-9da7dc7abf60" Aug 05 16:40:15.374548 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:15.374511 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8grqn\" (UID: \"77f7cb9f-0392-411e-8f7d-3df14a5a1faf\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:15.374720 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:15.374617 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 16:40:15.374720 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:15.374668 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert podName:77f7cb9f-0392-411e-8f7d-3df14a5a1faf nodeName:}" failed. No retries permitted until 2026-08-05 16:40:16.374652179 +0000 UTC m=+80.859310063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8grqn" (UID: "77f7cb9f-0392-411e-8f7d-3df14a5a1faf") : secret "networking-console-plugin-cert" not found Aug 05 16:40:16.382108 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:16.382061 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8grqn\" (UID: \"77f7cb9f-0392-411e-8f7d-3df14a5a1faf\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:16.382527 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:16.382209 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 16:40:16.382527 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:16.382286 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert podName:77f7cb9f-0392-411e-8f7d-3df14a5a1faf nodeName:}" failed. No retries permitted until 2026-08-05 16:40:18.382270036 +0000 UTC m=+82.866927917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8grqn" (UID: "77f7cb9f-0392-411e-8f7d-3df14a5a1faf") : secret "networking-console-plugin-cert" not found Aug 05 16:40:17.590609 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:17.590475 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:17.591037 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:17.590649 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 16:40:17.591037 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:17.590729 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls podName:1eb27246-de51-450d-9ca9-c30c76faa40f nodeName:}" failed. No retries permitted until 2026-08-05 16:40:25.590707556 +0000 UTC m=+90.075365451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-8qjpj" (UID: "1eb27246-de51-450d-9ca9-c30c76faa40f") : secret "cluster-monitoring-operator-tls" not found Aug 05 16:40:17.791994 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:17.791959 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-bzhhb\" (UID: \"9cde059e-1d59-4073-ad06-cf06124089dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:17.792131 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:17.792105 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 16:40:17.792190 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:17.792169 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls podName:9cde059e-1d59-4073-ad06-cf06124089dd nodeName:}" failed. No retries permitted until 2026-08-05 16:40:25.792155126 +0000 UTC m=+90.276813025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-bzhhb" (UID: "9cde059e-1d59-4073-ad06-cf06124089dd") : secret "samples-operator-tls" not found Aug 05 16:40:18.395850 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:18.395814 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8grqn\" (UID: \"77f7cb9f-0392-411e-8f7d-3df14a5a1faf\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:18.396012 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:18.395928 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 16:40:18.396012 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:18.395984 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert podName:77f7cb9f-0392-411e-8f7d-3df14a5a1faf nodeName:}" failed. No retries permitted until 2026-08-05 16:40:22.395967591 +0000 UTC m=+86.880625489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8grqn" (UID: "77f7cb9f-0392-411e-8f7d-3df14a5a1faf") : secret "networking-console-plugin-cert" not found Aug 05 16:40:18.925859 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:18.924279 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-qqcfj"] Aug 05 16:40:18.929277 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:18.929251 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qqcfj" Aug 05 16:40:18.932256 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:18.932204 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-86lcc\"" Aug 05 16:40:18.933357 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:18.933340 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Aug 05 16:40:18.933458 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:18.933380 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Aug 05 16:40:18.939981 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:18.939955 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-qqcfj"] Aug 05 16:40:18.999698 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:18.999674 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26sgb\" (UniqueName: \"kubernetes.io/projected/40750623-6df7-4dfc-96f9-a931bdaaef65-kube-api-access-26sgb\") pod \"migrator-68bc745d87-qqcfj\" (UID: \"40750623-6df7-4dfc-96f9-a931bdaaef65\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qqcfj" Aug 05 16:40:19.041416 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.041381 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l5nhf"] Aug 05 16:40:19.044445 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.044429 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.048639 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.048623 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lp7bm\"" Aug 05 16:40:19.050796 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.050779 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 05 16:40:19.050796 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.050791 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 05 16:40:19.051936 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.051918 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 05 16:40:19.063552 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.063538 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 05 16:40:19.075728 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.075704 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l5nhf"] Aug 05 16:40:19.100963 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.100938 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26sgb\" (UniqueName: \"kubernetes.io/projected/40750623-6df7-4dfc-96f9-a931bdaaef65-kube-api-access-26sgb\") pod \"migrator-68bc745d87-qqcfj\" (UID: \"40750623-6df7-4dfc-96f9-a931bdaaef65\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qqcfj" Aug 05 16:40:19.101067 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.100986 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plmbs\" (UniqueName: \"kubernetes.io/projected/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-api-access-plmbs\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.101067 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.101031 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cbdef18-b929-4459-bee9-2f32bb2716b8-data-volume\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.101067 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.101058 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.101162 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.101129 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1cbdef18-b929-4459-bee9-2f32bb2716b8-crio-socket\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.101197 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.101172 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.109232 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.109185 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26sgb\" (UniqueName: \"kubernetes.io/projected/40750623-6df7-4dfc-96f9-a931bdaaef65-kube-api-access-26sgb\") pod \"migrator-68bc745d87-qqcfj\" (UID: \"40750623-6df7-4dfc-96f9-a931bdaaef65\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qqcfj" Aug 05 16:40:19.202463 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.202392 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plmbs\" (UniqueName: \"kubernetes.io/projected/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-api-access-plmbs\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.202463 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.202432 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cbdef18-b929-4459-bee9-2f32bb2716b8-data-volume\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.202463 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.202452 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.202697 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.202482 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1cbdef18-b929-4459-bee9-2f32bb2716b8-crio-socket\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.202697 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.202511 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.202697 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:19.202539 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 16:40:19.202697 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:19.202605 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm podName:1cbdef18-b929-4459-bee9-2f32bb2716b8 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:19.702588606 +0000 UTC m=+84.187246504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5nhf" (UID: "1cbdef18-b929-4459-bee9-2f32bb2716b8") : configmap "kube-rbac-proxy" not found Aug 05 16:40:19.202697 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:19.202625 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 16:40:19.202697 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:19.202678 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls podName:1cbdef18-b929-4459-bee9-2f32bb2716b8 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:19.702667335 +0000 UTC m=+84.187325217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5nhf" (UID: "1cbdef18-b929-4459-bee9-2f32bb2716b8") : secret "insights-runtime-extractor-tls" not found Aug 05 16:40:19.202697 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.202621 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1cbdef18-b929-4459-bee9-2f32bb2716b8-crio-socket\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.202960 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.202705 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cbdef18-b929-4459-bee9-2f32bb2716b8-data-volume\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.214248 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.214210 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plmbs\" (UniqueName: \"kubernetes.io/projected/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-api-access-plmbs\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.237971 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.237947 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qqcfj" Aug 05 16:40:19.361926 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.361905 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-qqcfj"] Aug 05 16:40:19.364151 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:19.364126 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40750623_6df7_4dfc_96f9_a931bdaaef65.slice/crio-dea446dcda85d3eed090060bc82811d2305a05c40d12dc8b1923bbddb7df3f7c WatchSource:0}: Error finding container dea446dcda85d3eed090060bc82811d2305a05c40d12dc8b1923bbddb7df3f7c: Status 404 returned error can't find the container with id dea446dcda85d3eed090060bc82811d2305a05c40d12dc8b1923bbddb7df3f7c Aug 05 16:40:19.707099 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.707055 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.707294 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:19.707166 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:19.707294 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:19.707204 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 16:40:19.707294 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:19.707275 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 16:40:19.707294 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:19.707288 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls podName:1cbdef18-b929-4459-bee9-2f32bb2716b8 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:20.70727348 +0000 UTC m=+85.191931362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5nhf" (UID: "1cbdef18-b929-4459-bee9-2f32bb2716b8") : secret "insights-runtime-extractor-tls" not found Aug 05 16:40:19.707481 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:19.707340 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm podName:1cbdef18-b929-4459-bee9-2f32bb2716b8 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:20.707322709 +0000 UTC m=+85.191980591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5nhf" (UID: "1cbdef18-b929-4459-bee9-2f32bb2716b8") : configmap "kube-rbac-proxy" not found Aug 05 16:40:20.348647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:20.348611 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qqcfj" event={"ID":"40750623-6df7-4dfc-96f9-a931bdaaef65","Type":"ContainerStarted","Data":"dea446dcda85d3eed090060bc82811d2305a05c40d12dc8b1923bbddb7df3f7c"} Aug 05 16:40:20.443550 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:20.443508 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:20.443732 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:20.443580 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:20.443975 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:20.443958 2583 scope.go:117] "RemoveContainer" containerID="9e5bf8b4cfd27ea5f5efefc655d7b00b5f7e1c0ca8f84bc2fc163fdd7d447ed2" Aug 05 16:40:20.444160 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:20.444131 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-29j7x_openshift-console-operator(297b8597-8acf-413e-b72b-9da7dc7abf60)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" podUID="297b8597-8acf-413e-b72b-9da7dc7abf60" Aug 05 16:40:20.716058 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:20.715967 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:20.716058 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:20.716049 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 16:40:20.716334 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:20.716124 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm podName:1cbdef18-b929-4459-bee9-2f32bb2716b8 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:22.716102429 +0000 UTC m=+87.200760316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5nhf" (UID: "1cbdef18-b929-4459-bee9-2f32bb2716b8") : configmap "kube-rbac-proxy" not found Aug 05 16:40:20.716334 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:20.716057 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:20.716334 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:20.716153 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 16:40:20.716334 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:20.716229 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls podName:1cbdef18-b929-4459-bee9-2f32bb2716b8 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:22.716195817 +0000 UTC m=+87.200853720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5nhf" (UID: "1cbdef18-b929-4459-bee9-2f32bb2716b8") : secret "insights-runtime-extractor-tls" not found Aug 05 16:40:20.927207 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:20.927189 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m846k_9df7d7c5-95a4-444e-a727-8a7f8a65be2e/dns-node-resolver/0.log" Aug 05 16:40:21.173045 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.173013 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-h9fv4"] Aug 05 16:40:21.175952 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.175936 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" Aug 05 16:40:21.179056 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.179035 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dgs8b\"" Aug 05 16:40:21.179183 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.179040 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Aug 05 16:40:21.180130 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.180113 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Aug 05 16:40:21.180182 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.180113 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Aug 05 16:40:21.180182 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.180155 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Aug 05 16:40:21.186735 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.186713 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-h9fv4"] Aug 05 16:40:21.220176 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.220146 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0b6f0a28-5e9f-403f-a6a1-288d2d614863-signing-key\") pod \"service-ca-98c88fbb5-h9fv4\" (UID: \"0b6f0a28-5e9f-403f-a6a1-288d2d614863\") " pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" Aug 05 16:40:21.220337 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.220283 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0b6f0a28-5e9f-403f-a6a1-288d2d614863-signing-cabundle\") pod \"service-ca-98c88fbb5-h9fv4\" (UID: \"0b6f0a28-5e9f-403f-a6a1-288d2d614863\") " pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" Aug 05 16:40:21.220401 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.220378 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkqfw\" (UniqueName: \"kubernetes.io/projected/0b6f0a28-5e9f-403f-a6a1-288d2d614863-kube-api-access-xkqfw\") pod \"service-ca-98c88fbb5-h9fv4\" (UID: \"0b6f0a28-5e9f-403f-a6a1-288d2d614863\") " pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" Aug 05 16:40:21.320872 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.320842 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkqfw\" (UniqueName: \"kubernetes.io/projected/0b6f0a28-5e9f-403f-a6a1-288d2d614863-kube-api-access-xkqfw\") pod \"service-ca-98c88fbb5-h9fv4\" (UID: \"0b6f0a28-5e9f-403f-a6a1-288d2d614863\") " pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" Aug 05 16:40:21.321004 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.320908 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0b6f0a28-5e9f-403f-a6a1-288d2d614863-signing-key\") pod \"service-ca-98c88fbb5-h9fv4\" (UID: \"0b6f0a28-5e9f-403f-a6a1-288d2d614863\") " pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" Aug 05 16:40:21.321060 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.321049 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0b6f0a28-5e9f-403f-a6a1-288d2d614863-signing-cabundle\") pod \"service-ca-98c88fbb5-h9fv4\" (UID: \"0b6f0a28-5e9f-403f-a6a1-288d2d614863\") " pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" Aug 05 16:40:21.321670 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.321650 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0b6f0a28-5e9f-403f-a6a1-288d2d614863-signing-cabundle\") pod \"service-ca-98c88fbb5-h9fv4\" (UID: \"0b6f0a28-5e9f-403f-a6a1-288d2d614863\") " pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" Aug 05 16:40:21.323300 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.323281 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0b6f0a28-5e9f-403f-a6a1-288d2d614863-signing-key\") pod \"service-ca-98c88fbb5-h9fv4\" (UID: \"0b6f0a28-5e9f-403f-a6a1-288d2d614863\") " pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" Aug 05 16:40:21.329278 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.329259 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkqfw\" (UniqueName: \"kubernetes.io/projected/0b6f0a28-5e9f-403f-a6a1-288d2d614863-kube-api-access-xkqfw\") pod \"service-ca-98c88fbb5-h9fv4\" (UID: \"0b6f0a28-5e9f-403f-a6a1-288d2d614863\") " pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" Aug 05 16:40:21.355968 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.355935 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qqcfj" event={"ID":"40750623-6df7-4dfc-96f9-a931bdaaef65","Type":"ContainerStarted","Data":"53697ee91a25baa953953b27ba24baa9dbeac4705fa753f1f6336f7e270d74a7"} Aug 05 16:40:21.356290 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.356005 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qqcfj" event={"ID":"40750623-6df7-4dfc-96f9-a931bdaaef65","Type":"ContainerStarted","Data":"d9830f1863267d8472951eb47ad678dc9ca697d58e3c471b761eafa66089df3a"} Aug 05 16:40:21.375120 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.375069 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-qqcfj" podStartSLOduration=1.9234379320000001 podStartE2EDuration="3.375054861s" totalImagesPullingTime="1.451616929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:21.374614416 +0000 UTC m=+85.859272318" watchObservedRunningTime="2026-08-05 16:40:21.375054861 +0000 UTC m=+85.859712802" Aug 05 16:40:21.485091 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.485016 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" Aug 05 16:40:21.607801 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.607771 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-h9fv4"] Aug 05 16:40:21.610480 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:21.610453 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b6f0a28_5e9f_403f_a6a1_288d2d614863.slice/crio-d0f83cbb4d1e712630d9d5d1ca3f4f42e096353742fd5d20936d1cf98505022c WatchSource:0}: Error finding container d0f83cbb4d1e712630d9d5d1ca3f4f42e096353742fd5d20936d1cf98505022c: Status 404 returned error can't find the container with id d0f83cbb4d1e712630d9d5d1ca3f4f42e096353742fd5d20936d1cf98505022c Aug 05 16:40:21.727023 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:21.726997 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ghgcw_3a4923c1-abcf-4998-9757-d6753a11e98a/node-ca/0.log" Aug 05 16:40:22.361692 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:22.361657 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" event={"ID":"0b6f0a28-5e9f-403f-a6a1-288d2d614863","Type":"ContainerStarted","Data":"d0f83cbb4d1e712630d9d5d1ca3f4f42e096353742fd5d20936d1cf98505022c"} Aug 05 16:40:22.430821 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:22.430782 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8grqn\" (UID: \"77f7cb9f-0392-411e-8f7d-3df14a5a1faf\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:22.431000 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:22.430944 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 16:40:22.431044 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:22.431020 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert podName:77f7cb9f-0392-411e-8f7d-3df14a5a1faf nodeName:}" failed. No retries permitted until 2026-08-05 16:40:30.430997775 +0000 UTC m=+94.915655676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8grqn" (UID: "77f7cb9f-0392-411e-8f7d-3df14a5a1faf") : secret "networking-console-plugin-cert" not found Aug 05 16:40:22.527786 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:22.527759 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9tkn4_b28faef1-bf15-45a5-8eb9-6cf946def73a/serve-healthcheck-canary/0.log" Aug 05 16:40:22.733404 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:22.733321 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:22.733404 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:22.733375 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:22.733635 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:22.733455 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 16:40:22.733635 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:22.733504 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 16:40:22.733635 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:22.733531 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm podName:1cbdef18-b929-4459-bee9-2f32bb2716b8 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:26.733512973 +0000 UTC m=+91.218170879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5nhf" (UID: "1cbdef18-b929-4459-bee9-2f32bb2716b8") : configmap "kube-rbac-proxy" not found Aug 05 16:40:22.733635 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:22.733550 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls podName:1cbdef18-b929-4459-bee9-2f32bb2716b8 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:26.733540915 +0000 UTC m=+91.218198811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5nhf" (UID: "1cbdef18-b929-4459-bee9-2f32bb2716b8") : secret "insights-runtime-extractor-tls" not found Aug 05 16:40:24.369284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:24.369245 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" event={"ID":"0b6f0a28-5e9f-403f-a6a1-288d2d614863","Type":"ContainerStarted","Data":"5ff4ac7f95658482c190f0367fb2ab96627bcfb749f1a0779911134ab1efbaf9"} Aug 05 16:40:24.386643 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:24.386569 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-h9fv4" podStartSLOduration=1.608261169 podStartE2EDuration="3.386553251s" totalImagesPullingTime="1.778292082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:24.385903653 +0000 UTC m=+88.870561555" watchObservedRunningTime="2026-08-05 16:40:24.386553251 +0000 UTC m=+88.871211153" Aug 05 16:40:25.659940 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:25.659907 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:25.660316 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:25.660030 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 16:40:25.660316 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:25.660091 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls podName:1eb27246-de51-450d-9ca9-c30c76faa40f nodeName:}" failed. No retries permitted until 2026-08-05 16:40:41.660076943 +0000 UTC m=+106.144734824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-8qjpj" (UID: "1eb27246-de51-450d-9ca9-c30c76faa40f") : secret "cluster-monitoring-operator-tls" not found Aug 05 16:40:25.862278 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:25.862247 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-bzhhb\" (UID: \"9cde059e-1d59-4073-ad06-cf06124089dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:25.864546 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:25.864520 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cde059e-1d59-4073-ad06-cf06124089dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-bzhhb\" (UID: \"9cde059e-1d59-4073-ad06-cf06124089dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:26.036336 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:26.036261 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" Aug 05 16:40:26.158929 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:26.158901 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb"] Aug 05 16:40:26.377000 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:26.376962 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" event={"ID":"9cde059e-1d59-4073-ad06-cf06124089dd","Type":"ContainerStarted","Data":"3f2bb3d8c1a05639a888295654d38df08758a705d032ba1eedb37ee46a2dee22"} Aug 05 16:40:26.769357 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:26.769273 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:26.769357 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:26.769347 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:26.769815 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:26.769388 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 16:40:26.769815 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:26.769453 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 16:40:26.769815 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:26.769460 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm podName:1cbdef18-b929-4459-bee9-2f32bb2716b8 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:34.769438943 +0000 UTC m=+99.254096832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5nhf" (UID: "1cbdef18-b929-4459-bee9-2f32bb2716b8") : configmap "kube-rbac-proxy" not found Aug 05 16:40:26.769815 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:26.769489 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls podName:1cbdef18-b929-4459-bee9-2f32bb2716b8 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:34.769478162 +0000 UTC m=+99.254136063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5nhf" (UID: "1cbdef18-b929-4459-bee9-2f32bb2716b8") : secret "insights-runtime-extractor-tls" not found Aug 05 16:40:28.385746 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:28.385704 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" event={"ID":"9cde059e-1d59-4073-ad06-cf06124089dd","Type":"ContainerStarted","Data":"aa1d6cfe4cea0613ac1def31cd9d20d8104140967c60ea1e5d94dcc9c66e621d"} Aug 05 16:40:28.386143 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:28.385765 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" event={"ID":"9cde059e-1d59-4073-ad06-cf06124089dd","Type":"ContainerStarted","Data":"d73d6818b33ede3668107ba510d32459e41714f1ea174afb654bb1f7466afafd"} Aug 05 16:40:28.406461 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:28.406370 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-bzhhb" podStartSLOduration=16.471282853 podStartE2EDuration="18.406354722s" totalImagesPullingTime="1.935071869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:28.405821152 +0000 UTC m=+92.890479078" watchObservedRunningTime="2026-08-05 16:40:28.406354722 +0000 UTC m=+92.891012639" Aug 05 16:40:30.501140 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:30.501110 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8grqn\" (UID: \"77f7cb9f-0392-411e-8f7d-3df14a5a1faf\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:30.501537 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:30.501266 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 16:40:30.501537 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:30.501322 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert podName:77f7cb9f-0392-411e-8f7d-3df14a5a1faf nodeName:}" failed. No retries permitted until 2026-08-05 16:40:46.501308999 +0000 UTC m=+110.985966880 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-8grqn" (UID: "77f7cb9f-0392-411e-8f7d-3df14a5a1faf") : secret "networking-console-plugin-cert" not found Aug 05 16:40:34.014592 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.014561 2583 scope.go:117] "RemoveContainer" containerID="9e5bf8b4cfd27ea5f5efefc655d7b00b5f7e1c0ca8f84bc2fc163fdd7d447ed2" Aug 05 16:40:34.332900 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.332818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:40:34.334952 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.334920 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e95720f1-0e6c-48d4-971d-1f8b080b55fc-metrics-tls\") pod \"dns-default-hmj89\" (UID: \"e95720f1-0e6c-48d4-971d-1f8b080b55fc\") " pod="openshift-dns/dns-default-hmj89" Aug 05 16:40:34.406199 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.406172 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 16:40:34.406614 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.406597 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/1.log" Aug 05 16:40:34.406724 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.406632 2583 generic.go:356] "Generic (PLEG): container finished" podID="297b8597-8acf-413e-b72b-9da7dc7abf60" containerID="ca8d5e09d2289d94f905ed958d1d7a35026a959fe99471b64a540b6e25d61f34" exitCode=255 Aug 05 16:40:34.406724 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.406669 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" event={"ID":"297b8597-8acf-413e-b72b-9da7dc7abf60","Type":"ContainerDied","Data":"ca8d5e09d2289d94f905ed958d1d7a35026a959fe99471b64a540b6e25d61f34"} Aug 05 16:40:34.406835 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.406727 2583 scope.go:117] "RemoveContainer" containerID="9e5bf8b4cfd27ea5f5efefc655d7b00b5f7e1c0ca8f84bc2fc163fdd7d447ed2" Aug 05 16:40:34.407034 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.407007 2583 scope.go:117] "RemoveContainer" containerID="ca8d5e09d2289d94f905ed958d1d7a35026a959fe99471b64a540b6e25d61f34" Aug 05 16:40:34.407203 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:34.407186 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-29j7x_openshift-console-operator(297b8597-8acf-413e-b72b-9da7dc7abf60)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" podUID="297b8597-8acf-413e-b72b-9da7dc7abf60" Aug 05 16:40:34.620395 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.620374 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p9jdc\"" Aug 05 16:40:34.627471 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.627453 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmj89" Aug 05 16:40:34.778125 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.778098 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmj89"] Aug 05 16:40:34.780677 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:34.780646 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95720f1_0e6c_48d4_971d_1f8b080b55fc.slice/crio-84b61342cbe4dbf7680eef927c9f4a5449ae49e70048d0ad01962f769c915c20 WatchSource:0}: Error finding container 84b61342cbe4dbf7680eef927c9f4a5449ae49e70048d0ad01962f769c915c20: Status 404 returned error can't find the container with id 84b61342cbe4dbf7680eef927c9f4a5449ae49e70048d0ad01962f769c915c20 Aug 05 16:40:34.836828 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.836802 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:34.836934 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.836841 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:34.836977 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:34.836953 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 16:40:34.837010 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:34.837004 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls podName:1cbdef18-b929-4459-bee9-2f32bb2716b8 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:50.836988455 +0000 UTC m=+115.321646357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5nhf" (UID: "1cbdef18-b929-4459-bee9-2f32bb2716b8") : secret "insights-runtime-extractor-tls" not found Aug 05 16:40:34.837298 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:34.837282 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cbdef18-b929-4459-bee9-2f32bb2716b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:35.411785 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:35.411750 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmj89" event={"ID":"e95720f1-0e6c-48d4-971d-1f8b080b55fc","Type":"ContainerStarted","Data":"84b61342cbe4dbf7680eef927c9f4a5449ae49e70048d0ad01962f769c915c20"} Aug 05 16:40:35.413565 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:35.413540 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 16:40:37.421230 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:37.421158 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmj89" event={"ID":"e95720f1-0e6c-48d4-971d-1f8b080b55fc","Type":"ContainerStarted","Data":"17d06ba50acfec5cdbdf90d45ad337afa536cf3f1c806b5cfbfc9b8fa9cbf8ba"} Aug 05 16:40:38.307285 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:38.307259 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h2jtk" Aug 05 16:40:38.425494 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:38.425463 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmj89" event={"ID":"e95720f1-0e6c-48d4-971d-1f8b080b55fc","Type":"ContainerStarted","Data":"aa89f96b12693ca3e5ff0389e3d9302d0b3d6c8d0c470f03c244ab9f3d0bcade"} Aug 05 16:40:38.425868 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:38.425597 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hmj89" Aug 05 16:40:38.443601 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:38.443539 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hmj89" podStartSLOduration=66.062983343 podStartE2EDuration="1m8.443521673s" totalImagesPullingTime="2.38053833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:38.443341475 +0000 UTC m=+102.927999377" watchObservedRunningTime="2026-08-05 16:40:38.443521673 +0000 UTC m=+102.928179572" Aug 05 16:40:40.443337 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:40.443310 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:40.443715 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:40.443354 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:40:40.443715 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:40.443639 2583 scope.go:117] "RemoveContainer" containerID="ca8d5e09d2289d94f905ed958d1d7a35026a959fe99471b64a540b6e25d61f34" Aug 05 16:40:40.443791 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:40.443774 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-29j7x_openshift-console-operator(297b8597-8acf-413e-b72b-9da7dc7abf60)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" podUID="297b8597-8acf-413e-b72b-9da7dc7abf60" Aug 05 16:40:41.690341 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:41.690311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:41.692742 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:41.692719 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1eb27246-de51-450d-9ca9-c30c76faa40f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-8qjpj\" (UID: \"1eb27246-de51-450d-9ca9-c30c76faa40f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:41.718738 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:41.718703 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" Aug 05 16:40:41.844582 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:41.844549 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj"] Aug 05 16:40:41.847721 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:41.847698 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb27246_de51_450d_9ca9_c30c76faa40f.slice/crio-35e0c0e5134dd537c0bc726db57ce5defe37bb2ed673bc3f8b79322b93e40aad WatchSource:0}: Error finding container 35e0c0e5134dd537c0bc726db57ce5defe37bb2ed673bc3f8b79322b93e40aad: Status 404 returned error can't find the container with id 35e0c0e5134dd537c0bc726db57ce5defe37bb2ed673bc3f8b79322b93e40aad Aug 05 16:40:42.444658 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:42.444614 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" event={"ID":"1eb27246-de51-450d-9ca9-c30c76faa40f","Type":"ContainerStarted","Data":"35e0c0e5134dd537c0bc726db57ce5defe37bb2ed673bc3f8b79322b93e40aad"} Aug 05 16:40:43.449050 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:43.449023 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" event={"ID":"1eb27246-de51-450d-9ca9-c30c76faa40f","Type":"ContainerStarted","Data":"6b0c5d43c61b8f198d142244bfccfa3589c9b4eed2c01f0a4025cef6a9385e15"} Aug 05 16:40:43.494394 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:43.494336 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-8qjpj" podStartSLOduration=32.957595791 podStartE2EDuration="34.494318344s" totalImagesPullingTime="1.536722553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:43.4941103 +0000 UTC m=+107.978768205" watchObservedRunningTime="2026-08-05 16:40:43.494318344 +0000 UTC m=+107.978976249" Aug 05 16:40:46.528512 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:46.528465 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8grqn\" (UID: \"77f7cb9f-0392-411e-8f7d-3df14a5a1faf\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:46.530766 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:46.530747 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77f7cb9f-0392-411e-8f7d-3df14a5a1faf-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-8grqn\" (UID: \"77f7cb9f-0392-411e-8f7d-3df14a5a1faf\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:46.805158 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:46.805075 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" Aug 05 16:40:46.928728 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:46.928703 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-8grqn"] Aug 05 16:40:46.930730 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:46.930703 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f7cb9f_0392_411e_8f7d_3df14a5a1faf.slice/crio-49e13812985cb6459330f4b2550e81c71aac0a034c07b793515a2417b1e91e9c WatchSource:0}: Error finding container 49e13812985cb6459330f4b2550e81c71aac0a034c07b793515a2417b1e91e9c: Status 404 returned error can't find the container with id 49e13812985cb6459330f4b2550e81c71aac0a034c07b793515a2417b1e91e9c Aug 05 16:40:47.462283 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:47.462252 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" event={"ID":"77f7cb9f-0392-411e-8f7d-3df14a5a1faf","Type":"ContainerStarted","Data":"49e13812985cb6459330f4b2550e81c71aac0a034c07b793515a2417b1e91e9c"} Aug 05 16:40:48.432359 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:48.432330 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hmj89" Aug 05 16:40:48.466969 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:48.466941 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" event={"ID":"77f7cb9f-0392-411e-8f7d-3df14a5a1faf","Type":"ContainerStarted","Data":"745006e7a65f8aeeaf053fecd7b3c22114c2092a1da314357c859c9c5e3e878d"} Aug 05 16:40:48.499723 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:48.499676 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-8grqn" podStartSLOduration=33.357767606 podStartE2EDuration="34.499660681s" totalImagesPullingTime="1.141893075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:48.498479722 +0000 UTC m=+112.983137626" watchObservedRunningTime="2026-08-05 16:40:48.499660681 +0000 UTC m=+112.984318585" Aug 05 16:40:49.132602 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.132569 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-29pss"] Aug 05 16:40:49.135762 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.135745 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.139414 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.139393 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jdxtr\"" Aug 05 16:40:49.139661 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.139649 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Aug 05 16:40:49.140707 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.140685 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 05 16:40:49.140812 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.140732 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Aug 05 16:40:49.146647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.146621 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-29pss"] Aug 05 16:40:49.250910 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.250880 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frg9j\" (UniqueName: \"kubernetes.io/projected/bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e-kube-api-access-frg9j\") pod \"prometheus-operator-758d7cb874-29pss\" (UID: \"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.251088 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.250923 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-29pss\" (UID: \"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.251088 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.250942 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-29pss\" (UID: \"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.251088 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.251005 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-29pss\" (UID: \"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.352250 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.352203 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-29pss\" (UID: \"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.352417 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.352281 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frg9j\" (UniqueName: \"kubernetes.io/projected/bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e-kube-api-access-frg9j\") pod \"prometheus-operator-758d7cb874-29pss\" (UID: \"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.352417 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.352315 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-29pss\" (UID: \"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.352417 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.352337 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-29pss\" (UID: \"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.352908 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.352887 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-29pss\" (UID: \"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.354679 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.354659 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-29pss\" (UID: \"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.354767 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.354729 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-29pss\" (UID: \"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.362364 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.362337 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frg9j\" (UniqueName: \"kubernetes.io/projected/bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e-kube-api-access-frg9j\") pod \"prometheus-operator-758d7cb874-29pss\" (UID: \"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.445110 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.445047 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" Aug 05 16:40:49.580901 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:49.580875 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-29pss"] Aug 05 16:40:49.583589 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:49.583567 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9c2e54_6cc9_46dc_8a0a_b040e2c5675e.slice/crio-094775f7b9212138d508e63e313307707b79a34cdec9d02e91aa1e0f3afe5c8c WatchSource:0}: Error finding container 094775f7b9212138d508e63e313307707b79a34cdec9d02e91aa1e0f3afe5c8c: Status 404 returned error can't find the container with id 094775f7b9212138d508e63e313307707b79a34cdec9d02e91aa1e0f3afe5c8c Aug 05 16:40:50.475523 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:50.475482 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" event={"ID":"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e","Type":"ContainerStarted","Data":"094775f7b9212138d508e63e313307707b79a34cdec9d02e91aa1e0f3afe5c8c"} Aug 05 16:40:50.865683 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:50.865634 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:50.867980 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:50.867953 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cbdef18-b929-4459-bee9-2f32bb2716b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5nhf\" (UID: \"1cbdef18-b929-4459-bee9-2f32bb2716b8\") " pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:51.153159 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:51.153064 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l5nhf" Aug 05 16:40:51.276971 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:51.276947 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l5nhf"] Aug 05 16:40:51.279190 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:51.279162 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbdef18_b929_4459_bee9_2f32bb2716b8.slice/crio-9a054d2968db36ecaebbc261a24ccf1d39542ba05ff5700894ea26a44fe8cfca WatchSource:0}: Error finding container 9a054d2968db36ecaebbc261a24ccf1d39542ba05ff5700894ea26a44fe8cfca: Status 404 returned error can't find the container with id 9a054d2968db36ecaebbc261a24ccf1d39542ba05ff5700894ea26a44fe8cfca Aug 05 16:40:51.480924 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:51.480844 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" event={"ID":"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e","Type":"ContainerStarted","Data":"28ab261a527a50595792e7a0efd3e36d2954308d2564746841fca3824b2397f9"} Aug 05 16:40:51.480924 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:51.480902 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" event={"ID":"bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e","Type":"ContainerStarted","Data":"eb97920c886ab29ae1a1233b61781292ca340697c2fdd558891c0acbd76e281d"} Aug 05 16:40:51.482322 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:51.482302 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5nhf" event={"ID":"1cbdef18-b929-4459-bee9-2f32bb2716b8","Type":"ContainerStarted","Data":"41137303e4c1b60f6de9e255a60d5ddfb003064923d0b80c1a355c60b1d3cd2c"} Aug 05 16:40:51.482416 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:51.482343 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5nhf" event={"ID":"1cbdef18-b929-4459-bee9-2f32bb2716b8","Type":"ContainerStarted","Data":"9a054d2968db36ecaebbc261a24ccf1d39542ba05ff5700894ea26a44fe8cfca"} Aug 05 16:40:51.499384 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:51.499345 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-29pss" podStartSLOduration=1.161148993 podStartE2EDuration="2.499331776s" totalImagesPullingTime="1.338182783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:51.498549038 +0000 UTC m=+115.983206942" watchObservedRunningTime="2026-08-05 16:40:51.499331776 +0000 UTC m=+115.983989679" Aug 05 16:40:52.487281 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:52.487248 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5nhf" event={"ID":"1cbdef18-b929-4459-bee9-2f32bb2716b8","Type":"ContainerStarted","Data":"6a961541e3498fdd56ce3db71f9da803b4e6bccb8292646f96986e9cf8a67b46"} Aug 05 16:40:53.014966 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.014938 2583 scope.go:117] "RemoveContainer" containerID="ca8d5e09d2289d94f905ed958d1d7a35026a959fe99471b64a540b6e25d61f34" Aug 05 16:40:53.015147 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:53.015109 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-29j7x_openshift-console-operator(297b8597-8acf-413e-b72b-9da7dc7abf60)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" podUID="297b8597-8acf-413e-b72b-9da7dc7abf60" Aug 05 16:40:53.537970 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.537938 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn"] Aug 05 16:40:53.540952 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.540934 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:53.543905 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.543878 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Aug 05 16:40:53.544011 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.543939 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jgmj4\"" Aug 05 16:40:53.544011 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.543946 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Aug 05 16:40:53.555584 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.555560 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn"] Aug 05 16:40:53.564444 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.564419 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ckt42"] Aug 05 16:40:53.567841 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.567822 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.570847 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.570650 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 05 16:40:53.570847 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.570674 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 05 16:40:53.571002 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.570935 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 05 16:40:53.571327 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.571312 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6jkd7\"" Aug 05 16:40:53.689034 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689006 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-root\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.689193 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689045 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-accelerators-collector-config\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.689193 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689083 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.689193 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689130 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8554acc7-d16c-432e-8df5-1085a795a2a4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:53.689193 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689154 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-metrics-client-ca\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.689403 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689241 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-tls\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.689403 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689279 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-sys\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.689403 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689326 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-wtmp\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.689403 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689355 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8554acc7-d16c-432e-8df5-1085a795a2a4-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:53.689403 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689384 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-textfile\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.689582 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689465 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8554acc7-d16c-432e-8df5-1085a795a2a4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:53.689582 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689505 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t6s7\" (UniqueName: \"kubernetes.io/projected/8554acc7-d16c-432e-8df5-1085a795a2a4-kube-api-access-9t6s7\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:53.689582 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.689537 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7gfb\" (UniqueName: \"kubernetes.io/projected/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-kube-api-access-w7gfb\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.790443 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790345 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t6s7\" (UniqueName: \"kubernetes.io/projected/8554acc7-d16c-432e-8df5-1085a795a2a4-kube-api-access-9t6s7\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:53.790443 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790397 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7gfb\" (UniqueName: \"kubernetes.io/projected/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-kube-api-access-w7gfb\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.790650 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790611 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-root\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.790708 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790661 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-accelerators-collector-config\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.790708 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790700 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.790797 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790745 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8554acc7-d16c-432e-8df5-1085a795a2a4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:53.790797 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790772 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-metrics-client-ca\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.790899 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790804 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-tls\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.790899 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790836 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-sys\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.790899 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:53.790861 2583 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Aug 05 16:40:53.790899 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790879 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-wtmp\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.791080 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790907 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8554acc7-d16c-432e-8df5-1085a795a2a4-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:53.791080 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:53.790924 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8554acc7-d16c-432e-8df5-1085a795a2a4-openshift-state-metrics-tls podName:8554acc7-d16c-432e-8df5-1085a795a2a4 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:54.290903779 +0000 UTC m=+118.775561666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8554acc7-d16c-432e-8df5-1085a795a2a4-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-bw5zn" (UID: "8554acc7-d16c-432e-8df5-1085a795a2a4") : secret "openshift-state-metrics-tls" not found Aug 05 16:40:53.791080 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790958 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-textfile\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.791080 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.791018 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8554acc7-d16c-432e-8df5-1085a795a2a4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:53.791306 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:53.791281 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Aug 05 16:40:53.791356 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:53.791346 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-tls podName:2dee3bdb-5aa6-4fb4-8bb0-e2455471a057 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:54.291327131 +0000 UTC m=+118.775985019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-tls") pod "node-exporter-ckt42" (UID: "2dee3bdb-5aa6-4fb4-8bb0-e2455471a057") : secret "node-exporter-tls" not found Aug 05 16:40:53.791457 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.790697 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-root\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.791593 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.791579 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-sys\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.791738 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.791683 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-textfile\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.791844 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.791823 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8554acc7-d16c-432e-8df5-1085a795a2a4-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:53.791900 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.791848 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-metrics-client-ca\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.791962 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.791830 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-wtmp\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.792384 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.792358 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-accelerators-collector-config\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.793874 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.793844 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8554acc7-d16c-432e-8df5-1085a795a2a4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:53.793984 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.793921 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.815247 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.815200 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7gfb\" (UniqueName: \"kubernetes.io/projected/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-kube-api-access-w7gfb\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:53.815646 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:53.815624 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t6s7\" (UniqueName: \"kubernetes.io/projected/8554acc7-d16c-432e-8df5-1085a795a2a4-kube-api-access-9t6s7\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:54.294490 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:54.294459 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8554acc7-d16c-432e-8df5-1085a795a2a4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:54.294655 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:54.294524 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-tls\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:54.296765 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:54.296741 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2dee3bdb-5aa6-4fb4-8bb0-e2455471a057-node-exporter-tls\") pod \"node-exporter-ckt42\" (UID: \"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057\") " pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:54.296765 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:54.296764 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8554acc7-d16c-432e-8df5-1085a795a2a4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-bw5zn\" (UID: \"8554acc7-d16c-432e-8df5-1085a795a2a4\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:54.452648 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:54.452620 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" Aug 05 16:40:54.477956 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:54.477917 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ckt42" Aug 05 16:40:54.487774 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:54.487746 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dee3bdb_5aa6_4fb4_8bb0_e2455471a057.slice/crio-c4af64a5e96819be8eff3059928787e4b81d66818d9e10d08699428644655bf3 WatchSource:0}: Error finding container c4af64a5e96819be8eff3059928787e4b81d66818d9e10d08699428644655bf3: Status 404 returned error can't find the container with id c4af64a5e96819be8eff3059928787e4b81d66818d9e10d08699428644655bf3 Aug 05 16:40:54.495759 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:54.495733 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckt42" event={"ID":"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057","Type":"ContainerStarted","Data":"c4af64a5e96819be8eff3059928787e4b81d66818d9e10d08699428644655bf3"} Aug 05 16:40:54.497678 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:54.497654 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5nhf" event={"ID":"1cbdef18-b929-4459-bee9-2f32bb2716b8","Type":"ContainerStarted","Data":"5c5a2cc72b962b7e4bccfcd44a85175199c553989f8f9858f5ecd9bba70099fe"} Aug 05 16:40:54.528659 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:54.528601 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l5nhf" podStartSLOduration=34.339341903 podStartE2EDuration="36.528579203s" totalImagesPullingTime="2.1892373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:40:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:54.528107831 +0000 UTC m=+119.012765754" watchObservedRunningTime="2026-08-05 16:40:54.528579203 +0000 UTC m=+119.013237107" Aug 05 16:40:54.609133 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:54.609103 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn"] Aug 05 16:40:54.645781 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:54.645754 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8554acc7_d16c_432e_8df5_1085a795a2a4.slice/crio-070a33ff0e258eeb442be686d7865b7a241f407d9bc9f085ec5b6d710927d781 WatchSource:0}: Error finding container 070a33ff0e258eeb442be686d7865b7a241f407d9bc9f085ec5b6d710927d781: Status 404 returned error can't find the container with id 070a33ff0e258eeb442be686d7865b7a241f407d9bc9f085ec5b6d710927d781 Aug 05 16:40:55.510482 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.508096 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" event={"ID":"8554acc7-d16c-432e-8df5-1085a795a2a4","Type":"ContainerStarted","Data":"0ec544bf666df5480efe941b7e20c7d31184f8c9274e3e190591a47590127cc1"} Aug 05 16:40:55.510482 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.508197 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" event={"ID":"8554acc7-d16c-432e-8df5-1085a795a2a4","Type":"ContainerStarted","Data":"81cfa999a966517b30c75d1242df1fc16b18540a9510bf763e740ff10a4e7bcd"} Aug 05 16:40:55.510482 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.508263 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" event={"ID":"8554acc7-d16c-432e-8df5-1085a795a2a4","Type":"ContainerStarted","Data":"070a33ff0e258eeb442be686d7865b7a241f407d9bc9f085ec5b6d710927d781"} Aug 05 16:40:55.948507 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.948477 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-597b94895-gf2vs"] Aug 05 16:40:55.952056 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.952033 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:55.957856 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.957822 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Aug 05 16:40:55.957998 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.957824 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Aug 05 16:40:55.957998 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.957822 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Aug 05 16:40:55.958122 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.958104 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Aug 05 16:40:55.958430 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.958414 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5c7thi68uugt\"" Aug 05 16:40:55.959410 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.959068 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Aug 05 16:40:55.959410 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.959112 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kkmgn\"" Aug 05 16:40:55.972620 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:55.972594 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-597b94895-gf2vs"] Aug 05 16:40:56.107997 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.107969 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.108119 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.108025 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58vkx\" (UniqueName: \"kubernetes.io/projected/f110d151-f6de-4d45-8f7f-f2926dd14ff0-kube-api-access-58vkx\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.108119 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.108059 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.108119 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.108076 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-grpc-tls\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.108119 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.108095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.108280 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.108120 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.108280 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.108178 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f110d151-f6de-4d45-8f7f-f2926dd14ff0-metrics-client-ca\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.108280 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.108202 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-tls\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.208927 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.208895 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58vkx\" (UniqueName: \"kubernetes.io/projected/f110d151-f6de-4d45-8f7f-f2926dd14ff0-kube-api-access-58vkx\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.209066 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.208934 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.209066 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.208949 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-grpc-tls\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.209066 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.208971 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.209066 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.209001 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.209066 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.209033 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f110d151-f6de-4d45-8f7f-f2926dd14ff0-metrics-client-ca\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.209066 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.209056 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-tls\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.209359 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.209103 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.209847 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.209813 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f110d151-f6de-4d45-8f7f-f2926dd14ff0-metrics-client-ca\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.211775 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.211752 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.211854 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.211819 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.211906 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.211846 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-grpc-tls\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.211964 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.211949 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.212015 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.211994 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-tls\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.212254 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.212234 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f110d151-f6de-4d45-8f7f-f2926dd14ff0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.219591 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.219573 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58vkx\" (UniqueName: \"kubernetes.io/projected/f110d151-f6de-4d45-8f7f-f2926dd14ff0-kube-api-access-58vkx\") pod \"thanos-querier-597b94895-gf2vs\" (UID: \"f110d151-f6de-4d45-8f7f-f2926dd14ff0\") " pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.262628 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.262604 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:40:56.397545 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.397470 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-597b94895-gf2vs"] Aug 05 16:40:56.400385 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:56.400350 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf110d151_f6de_4d45_8f7f_f2926dd14ff0.slice/crio-ed0ad7a82df84fbd21969510d60b156c14c8c09eadb1eb96e16d1c162df6fc39 WatchSource:0}: Error finding container ed0ad7a82df84fbd21969510d60b156c14c8c09eadb1eb96e16d1c162df6fc39: Status 404 returned error can't find the container with id ed0ad7a82df84fbd21969510d60b156c14c8c09eadb1eb96e16d1c162df6fc39 Aug 05 16:40:56.512545 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.512512 2583 generic.go:356] "Generic (PLEG): container finished" podID="2dee3bdb-5aa6-4fb4-8bb0-e2455471a057" containerID="fbe7c18ca386acb3bdb25dfb0fe9afe3051028701c1819a32a1beb650acbfcbc" exitCode=0 Aug 05 16:40:56.512698 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.512585 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckt42" event={"ID":"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057","Type":"ContainerDied","Data":"fbe7c18ca386acb3bdb25dfb0fe9afe3051028701c1819a32a1beb650acbfcbc"} Aug 05 16:40:56.514741 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.514711 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" event={"ID":"8554acc7-d16c-432e-8df5-1085a795a2a4","Type":"ContainerStarted","Data":"ced1ba3f078580fc4f73798ff3022674e66832984d6ebe16ed36eebae4c9b8e8"} Aug 05 16:40:56.517940 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.516376 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" event={"ID":"f110d151-f6de-4d45-8f7f-f2926dd14ff0","Type":"ContainerStarted","Data":"ed0ad7a82df84fbd21969510d60b156c14c8c09eadb1eb96e16d1c162df6fc39"} Aug 05 16:40:56.578229 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:56.578159 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-bw5zn" podStartSLOduration=2.51759576 podStartE2EDuration="3.578139421s" totalImagesPullingTime="1.060543661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:56.578002008 +0000 UTC m=+121.062659912" watchObservedRunningTime="2026-08-05 16:40:56.578139421 +0000 UTC m=+121.062797326" Aug 05 16:40:57.523123 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:57.523084 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckt42" event={"ID":"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057","Type":"ContainerStarted","Data":"356f0004af2d7632bb7dfb992962fafca2428d3db834b6ca7402eb8c66942e59"} Aug 05 16:40:57.523700 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:57.523194 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckt42" event={"ID":"2dee3bdb-5aa6-4fb4-8bb0-e2455471a057","Type":"ContainerStarted","Data":"cbadb6a021d3b582a15af598833d04bc14e1b4604f51c21fbab8443bc1971821"} Aug 05 16:40:58.290579 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.290518 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ckt42" podStartSLOduration=3.892693928 podStartE2EDuration="5.29050152s" totalImagesPullingTime="1.329193772s" totalInitContainerRuntime="68.61382ms" isStatefulPod=true podCreationTimestamp="2026-08-05 16:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:57.549430229 +0000 UTC m=+122.034088133" watchObservedRunningTime="2026-08-05 16:40:58.29050152 +0000 UTC m=+122.775159423" Aug 05 16:40:58.290853 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.290835 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8"] Aug 05 16:40:58.294389 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.294369 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" Aug 05 16:40:58.297817 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.297794 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Aug 05 16:40:58.301606 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.301313 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-m8qcs\"" Aug 05 16:40:58.303562 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.303536 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8"] Aug 05 16:40:58.431627 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.431593 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b82c97c2-2933-4968-9299-5161c15e193a-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-wthk8\" (UID: \"b82c97c2-2933-4968-9299-5161c15e193a\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" Aug 05 16:40:58.431821 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.431659 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hv5f\" (UniqueName: \"kubernetes.io/projected/b82c97c2-2933-4968-9299-5161c15e193a-kube-api-access-8hv5f\") pod \"monitoring-plugin-6dffbbd67-wthk8\" (UID: \"b82c97c2-2933-4968-9299-5161c15e193a\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" Aug 05 16:40:58.532496 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.532473 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b82c97c2-2933-4968-9299-5161c15e193a-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-wthk8\" (UID: \"b82c97c2-2933-4968-9299-5161c15e193a\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" Aug 05 16:40:58.532838 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.532513 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hv5f\" (UniqueName: \"kubernetes.io/projected/b82c97c2-2933-4968-9299-5161c15e193a-kube-api-access-8hv5f\") pod \"monitoring-plugin-6dffbbd67-wthk8\" (UID: \"b82c97c2-2933-4968-9299-5161c15e193a\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" Aug 05 16:40:58.532838 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:58.532629 2583 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Aug 05 16:40:58.532838 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:40:58.532702 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82c97c2-2933-4968-9299-5161c15e193a-monitoring-plugin-cert podName:b82c97c2-2933-4968-9299-5161c15e193a nodeName:}" failed. No retries permitted until 2026-08-05 16:40:59.032681256 +0000 UTC m=+123.517339141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b82c97c2-2933-4968-9299-5161c15e193a-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-wthk8" (UID: "b82c97c2-2933-4968-9299-5161c15e193a") : secret "monitoring-plugin-cert" not found Aug 05 16:40:58.541873 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.541818 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hv5f\" (UniqueName: \"kubernetes.io/projected/b82c97c2-2933-4968-9299-5161c15e193a-kube-api-access-8hv5f\") pod \"monitoring-plugin-6dffbbd67-wthk8\" (UID: \"b82c97c2-2933-4968-9299-5161c15e193a\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" Aug 05 16:40:58.801591 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.801514 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-645867fbcd-nt6vb"] Aug 05 16:40:58.804763 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.804748 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:58.808497 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.808479 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Aug 05 16:40:58.808734 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.808715 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Aug 05 16:40:58.808815 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.808736 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Aug 05 16:40:58.808884 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.808868 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-w9mgh\"" Aug 05 16:40:58.809192 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.809179 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Aug 05 16:40:58.809516 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.809504 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Aug 05 16:40:58.819517 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.819492 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Aug 05 16:40:58.830869 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.830837 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-645867fbcd-nt6vb"] Aug 05 16:40:58.935085 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.935056 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/82faad46-ffea-4f5a-b547-817a1ff3e884-federate-client-tls\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:58.935269 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.935094 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8c8f\" (UniqueName: \"kubernetes.io/projected/82faad46-ffea-4f5a-b547-817a1ff3e884-kube-api-access-d8c8f\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:58.935269 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.935163 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82faad46-ffea-4f5a-b547-817a1ff3e884-telemeter-trusted-ca-bundle\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:58.935269 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.935202 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/82faad46-ffea-4f5a-b547-817a1ff3e884-secret-telemeter-client\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:58.935269 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.935245 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82faad46-ffea-4f5a-b547-817a1ff3e884-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:58.935410 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.935278 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82faad46-ffea-4f5a-b547-817a1ff3e884-metrics-client-ca\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:58.935410 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.935301 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82faad46-ffea-4f5a-b547-817a1ff3e884-serving-certs-ca-bundle\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:58.935410 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:58.935339 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/82faad46-ffea-4f5a-b547-817a1ff3e884-telemeter-client-tls\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.035933 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.035904 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8c8f\" (UniqueName: \"kubernetes.io/projected/82faad46-ffea-4f5a-b547-817a1ff3e884-kube-api-access-d8c8f\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.036081 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.035962 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b82c97c2-2933-4968-9299-5161c15e193a-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-wthk8\" (UID: \"b82c97c2-2933-4968-9299-5161c15e193a\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" Aug 05 16:40:59.036160 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.036141 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82faad46-ffea-4f5a-b547-817a1ff3e884-telemeter-trusted-ca-bundle\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.036208 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.036184 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/82faad46-ffea-4f5a-b547-817a1ff3e884-secret-telemeter-client\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.036329 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.036305 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82faad46-ffea-4f5a-b547-817a1ff3e884-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.036401 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.036377 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82faad46-ffea-4f5a-b547-817a1ff3e884-metrics-client-ca\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.036455 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.036438 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82faad46-ffea-4f5a-b547-817a1ff3e884-serving-certs-ca-bundle\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.036507 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.036475 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/82faad46-ffea-4f5a-b547-817a1ff3e884-telemeter-client-tls\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.036617 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.036532 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/82faad46-ffea-4f5a-b547-817a1ff3e884-federate-client-tls\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.037260 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.037232 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82faad46-ffea-4f5a-b547-817a1ff3e884-metrics-client-ca\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.037371 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.037239 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82faad46-ffea-4f5a-b547-817a1ff3e884-serving-certs-ca-bundle\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.037371 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.037242 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82faad46-ffea-4f5a-b547-817a1ff3e884-telemeter-trusted-ca-bundle\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.038963 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.038937 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/82faad46-ffea-4f5a-b547-817a1ff3e884-secret-telemeter-client\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.039085 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.038937 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b82c97c2-2933-4968-9299-5161c15e193a-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-wthk8\" (UID: \"b82c97c2-2933-4968-9299-5161c15e193a\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" Aug 05 16:40:59.039244 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.039207 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82faad46-ffea-4f5a-b547-817a1ff3e884-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.039311 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.039263 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/82faad46-ffea-4f5a-b547-817a1ff3e884-telemeter-client-tls\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.039366 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.039307 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/82faad46-ffea-4f5a-b547-817a1ff3e884-federate-client-tls\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.045138 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.045118 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8c8f\" (UniqueName: \"kubernetes.io/projected/82faad46-ffea-4f5a-b547-817a1ff3e884-kube-api-access-d8c8f\") pod \"telemeter-client-645867fbcd-nt6vb\" (UID: \"82faad46-ffea-4f5a-b547-817a1ff3e884\") " pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.114047 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.114025 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" Aug 05 16:40:59.206547 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.206519 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" Aug 05 16:40:59.247129 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.247105 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-645867fbcd-nt6vb"] Aug 05 16:40:59.249680 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:59.249653 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82faad46_ffea_4f5a_b547_817a1ff3e884.slice/crio-717065059d76e85daee377dbacd1e3068a2d4f7fef39ca3bcef13e31c59fdb6f WatchSource:0}: Error finding container 717065059d76e85daee377dbacd1e3068a2d4f7fef39ca3bcef13e31c59fdb6f: Status 404 returned error can't find the container with id 717065059d76e85daee377dbacd1e3068a2d4f7fef39ca3bcef13e31c59fdb6f Aug 05 16:40:59.339283 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.339253 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8"] Aug 05 16:40:59.342271 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:40:59.342248 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82c97c2_2933_4968_9299_5161c15e193a.slice/crio-36faa745af927df21176f2f4ca3032657c37a73e9ba5d842cc52c80e73d4311b WatchSource:0}: Error finding container 36faa745af927df21176f2f4ca3032657c37a73e9ba5d842cc52c80e73d4311b: Status 404 returned error can't find the container with id 36faa745af927df21176f2f4ca3032657c37a73e9ba5d842cc52c80e73d4311b Aug 05 16:40:59.534751 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.534650 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" event={"ID":"f110d151-f6de-4d45-8f7f-f2926dd14ff0","Type":"ContainerStarted","Data":"75a86250b10c91e36f5f274505219f7c26c37e30b82801dce978871852ef82e0"} Aug 05 16:40:59.534751 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.534729 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" event={"ID":"f110d151-f6de-4d45-8f7f-f2926dd14ff0","Type":"ContainerStarted","Data":"b8132a847c5eaba971e721362d2bfd9a3a0b7fa21a7b983c14fcaba5eb4c9abb"} Aug 05 16:40:59.535252 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.534771 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" event={"ID":"f110d151-f6de-4d45-8f7f-f2926dd14ff0","Type":"ContainerStarted","Data":"0c8ec2b611c7119fd16bb97170bdd30cc44067afc6cb4eff55a2546f1895bd27"} Aug 05 16:40:59.536109 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.536081 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" event={"ID":"b82c97c2-2933-4968-9299-5161c15e193a","Type":"ContainerStarted","Data":"36faa745af927df21176f2f4ca3032657c37a73e9ba5d842cc52c80e73d4311b"} Aug 05 16:40:59.537407 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:40:59.537386 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" event={"ID":"82faad46-ffea-4f5a-b547-817a1ff3e884","Type":"ContainerStarted","Data":"717065059d76e85daee377dbacd1e3068a2d4f7fef39ca3bcef13e31c59fdb6f"} Aug 05 16:41:00.543903 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:00.543869 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" event={"ID":"f110d151-f6de-4d45-8f7f-f2926dd14ff0","Type":"ContainerStarted","Data":"78014bb39e0e3b50aec343254b6847262fd0828bd2f1c582fa084a6d99f4f3dc"} Aug 05 16:41:00.544303 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:00.543936 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" event={"ID":"f110d151-f6de-4d45-8f7f-f2926dd14ff0","Type":"ContainerStarted","Data":"61076997511b5f04f4822a26ba5de83b8b063eba6c051d6c04ddf5ffa9b9dcbd"} Aug 05 16:41:00.544303 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:00.543996 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" event={"ID":"f110d151-f6de-4d45-8f7f-f2926dd14ff0","Type":"ContainerStarted","Data":"4aa5df77483857089509bd8585c4f029cdedf28b34e8bed7aa3f4cf008345252"} Aug 05 16:41:00.544303 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:00.544026 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:41:00.579904 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:00.579844 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" podStartSLOduration=2.51227331 podStartE2EDuration="5.579827016s" totalImagesPullingTime="3.067553706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:00.578270707 +0000 UTC m=+125.062928613" watchObservedRunningTime="2026-08-05 16:41:00.579827016 +0000 UTC m=+125.064484930" Aug 05 16:41:01.549197 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:01.549162 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" event={"ID":"b82c97c2-2933-4968-9299-5161c15e193a","Type":"ContainerStarted","Data":"796fcadfc3fbe815d538092f585017c5a642e298d729725e1cd868ee17803a52"} Aug 05 16:41:01.549619 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:01.549289 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" Aug 05 16:41:01.550778 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:01.550750 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" event={"ID":"82faad46-ffea-4f5a-b547-817a1ff3e884","Type":"ContainerStarted","Data":"5659ba4db15627df4130618c5aef3e638b246a9fef96caaee658abf850e6d474"} Aug 05 16:41:01.554104 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:01.554085 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" Aug 05 16:41:01.570568 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:01.570521 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-wthk8" podStartSLOduration=1.5436037599999999 podStartE2EDuration="3.570507895s" totalImagesPullingTime="2.026904135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:01.569603861 +0000 UTC m=+126.054261764" watchObservedRunningTime="2026-08-05 16:41:01.570507895 +0000 UTC m=+126.055165798" Aug 05 16:41:02.556790 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:02.556751 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" event={"ID":"82faad46-ffea-4f5a-b547-817a1ff3e884","Type":"ContainerStarted","Data":"ce1232f46cde321bcc1d23071c65f6036c044ab2cf47166c2f53d606427e3ccb"} Aug 05 16:41:02.557184 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:02.556820 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" event={"ID":"82faad46-ffea-4f5a-b547-817a1ff3e884","Type":"ContainerStarted","Data":"9fce40182b5852e278934cb319f03b7fe6c8179c6a3e29d12e81adad37cae7fa"} Aug 05 16:41:02.597833 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:02.597784 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-645867fbcd-nt6vb" podStartSLOduration=1.545517582 podStartE2EDuration="4.597769352s" totalImagesPullingTime="3.05225177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:02.596912371 +0000 UTC m=+127.081570275" watchObservedRunningTime="2026-08-05 16:41:02.597769352 +0000 UTC m=+127.082427255" Aug 05 16:41:05.695100 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:05.695063 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:41:05.697406 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:05.697384 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be87eb4-e338-44b2-ab97-dad8edd973f1-metrics-certs\") pod \"network-metrics-daemon-7xvbx\" (UID: \"2be87eb4-e338-44b2-ab97-dad8edd973f1\") " pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:41:05.836957 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:05.836924 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7qbz9\"" Aug 05 16:41:05.845066 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:05.845039 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7xvbx" Aug 05 16:41:05.989734 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:05.989704 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7xvbx"] Aug 05 16:41:05.990545 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:41:05.990522 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be87eb4_e338_44b2_ab97_dad8edd973f1.slice/crio-4a25e4115e2bf9acddc5960783540dbb4eddb38f428f7d4cbaff6c485225ce2f WatchSource:0}: Error finding container 4a25e4115e2bf9acddc5960783540dbb4eddb38f428f7d4cbaff6c485225ce2f: Status 404 returned error can't find the container with id 4a25e4115e2bf9acddc5960783540dbb4eddb38f428f7d4cbaff6c485225ce2f Aug 05 16:41:06.016728 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:06.016708 2583 scope.go:117] "RemoveContainer" containerID="ca8d5e09d2289d94f905ed958d1d7a35026a959fe99471b64a540b6e25d61f34" Aug 05 16:41:06.557159 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:06.557132 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-597b94895-gf2vs" Aug 05 16:41:06.573975 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:06.573953 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 16:41:06.574111 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:06.574060 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" event={"ID":"297b8597-8acf-413e-b72b-9da7dc7abf60","Type":"ContainerStarted","Data":"29215686b90c2c4c28dead31f9af1f1539db425257c90eaca09eed46c891e309"} Aug 05 16:41:06.574360 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:06.574338 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:41:06.575394 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:06.575374 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7xvbx" event={"ID":"2be87eb4-e338-44b2-ab97-dad8edd973f1","Type":"ContainerStarted","Data":"4a25e4115e2bf9acddc5960783540dbb4eddb38f428f7d4cbaff6c485225ce2f"} Aug 05 16:41:06.605617 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:06.605562 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" podStartSLOduration=54.773265921 podStartE2EDuration="56.605542363s" totalImagesPullingTime="1.832276442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:06.60485377 +0000 UTC m=+131.089511675" watchObservedRunningTime="2026-08-05 16:41:06.605542363 +0000 UTC m=+131.090200268" Aug 05 16:41:07.053879 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.053844 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-29j7x" Aug 05 16:41:07.266716 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.266676 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-62pb9"] Aug 05 16:41:07.276466 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.274827 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-62pb9" Aug 05 16:41:07.279105 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.279068 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Aug 05 16:41:07.279269 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.279068 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qzxgk\"" Aug 05 16:41:07.279269 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.279143 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Aug 05 16:41:07.297933 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.297904 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-62pb9"] Aug 05 16:41:07.310432 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.309499 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78bp8\" (UniqueName: \"kubernetes.io/projected/984e95d2-f85a-4c81-a6a0-4f766eaf8c48-kube-api-access-78bp8\") pod \"downloads-77c974ffcf-62pb9\" (UID: \"984e95d2-f85a-4c81-a6a0-4f766eaf8c48\") " pod="openshift-console/downloads-77c974ffcf-62pb9" Aug 05 16:41:07.410886 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.410850 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78bp8\" (UniqueName: \"kubernetes.io/projected/984e95d2-f85a-4c81-a6a0-4f766eaf8c48-kube-api-access-78bp8\") pod \"downloads-77c974ffcf-62pb9\" (UID: \"984e95d2-f85a-4c81-a6a0-4f766eaf8c48\") " pod="openshift-console/downloads-77c974ffcf-62pb9" Aug 05 16:41:07.421961 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.421937 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78bp8\" (UniqueName: \"kubernetes.io/projected/984e95d2-f85a-4c81-a6a0-4f766eaf8c48-kube-api-access-78bp8\") pod \"downloads-77c974ffcf-62pb9\" (UID: \"984e95d2-f85a-4c81-a6a0-4f766eaf8c48\") " pod="openshift-console/downloads-77c974ffcf-62pb9" Aug 05 16:41:07.581817 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.581730 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7xvbx" event={"ID":"2be87eb4-e338-44b2-ab97-dad8edd973f1","Type":"ContainerStarted","Data":"5817a44a46ed30a67c74cbf86a3f0a8954271596483079a8a8be09cfc0f40f7a"} Aug 05 16:41:07.581817 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.581786 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7xvbx" event={"ID":"2be87eb4-e338-44b2-ab97-dad8edd973f1","Type":"ContainerStarted","Data":"67316247ddad9e7dbcb1f0f4b8a6c0a6caa1fea6fa86e67f018682ce1c6e7d42"} Aug 05 16:41:07.588139 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.588121 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-62pb9" Aug 05 16:41:07.602858 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.602809 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7xvbx" podStartSLOduration=130.365333139 podStartE2EDuration="2m11.602792184s" totalImagesPullingTime="1.237459045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:07.601701727 +0000 UTC m=+132.086359630" watchObservedRunningTime="2026-08-05 16:41:07.602792184 +0000 UTC m=+132.087450119" Aug 05 16:41:07.723849 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:07.723817 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-62pb9"] Aug 05 16:41:07.726769 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:41:07.726745 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984e95d2_f85a_4c81_a6a0_4f766eaf8c48.slice/crio-6fd5ce713c3ced4edabf6777538b536eb590d6c8b2337a15a44a251de65b99b4 WatchSource:0}: Error finding container 6fd5ce713c3ced4edabf6777538b536eb590d6c8b2337a15a44a251de65b99b4: Status 404 returned error can't find the container with id 6fd5ce713c3ced4edabf6777538b536eb590d6c8b2337a15a44a251de65b99b4 Aug 05 16:41:08.588126 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:08.588085 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-62pb9" event={"ID":"984e95d2-f85a-4c81-a6a0-4f766eaf8c48","Type":"ContainerStarted","Data":"6fd5ce713c3ced4edabf6777538b536eb590d6c8b2337a15a44a251de65b99b4"} Aug 05 16:41:19.001296 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.001261 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d557cf4b7-2557w"] Aug 05 16:41:19.005702 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.005678 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.009147 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.009097 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Aug 05 16:41:19.009285 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.009152 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Aug 05 16:41:19.009441 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.009420 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Aug 05 16:41:19.009557 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.009420 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Aug 05 16:41:19.009619 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.009579 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r6xzw\"" Aug 05 16:41:19.009619 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.009580 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Aug 05 16:41:19.019905 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.019878 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d557cf4b7-2557w"] Aug 05 16:41:19.112406 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.112369 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-service-ca\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.112585 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.112443 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-oauth-serving-cert\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.112585 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.112517 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19b48bdd-86e7-41a1-bd67-64430d88befa-console-serving-cert\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.112585 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.112546 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qltnl\" (UniqueName: \"kubernetes.io/projected/19b48bdd-86e7-41a1-bd67-64430d88befa-kube-api-access-qltnl\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.112719 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.112614 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19b48bdd-86e7-41a1-bd67-64430d88befa-console-oauth-config\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.112719 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.112662 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-console-config\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.213158 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.213124 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-service-ca\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.213158 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.213167 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-oauth-serving-cert\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.213428 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.213208 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19b48bdd-86e7-41a1-bd67-64430d88befa-console-serving-cert\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.213428 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.213255 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qltnl\" (UniqueName: \"kubernetes.io/projected/19b48bdd-86e7-41a1-bd67-64430d88befa-kube-api-access-qltnl\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.213428 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.213295 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19b48bdd-86e7-41a1-bd67-64430d88befa-console-oauth-config\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.213428 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.213336 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-console-config\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.213855 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.213826 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-service-ca\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.213970 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.213916 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-oauth-serving-cert\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.214046 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.214023 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-console-config\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.216139 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.216120 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19b48bdd-86e7-41a1-bd67-64430d88befa-console-oauth-config\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.216290 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.216272 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19b48bdd-86e7-41a1-bd67-64430d88befa-console-serving-cert\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.222893 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.222870 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qltnl\" (UniqueName: \"kubernetes.io/projected/19b48bdd-86e7-41a1-bd67-64430d88befa-kube-api-access-qltnl\") pod \"console-6d557cf4b7-2557w\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:19.317589 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:19.317508 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:25.027768 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:25.027743 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d557cf4b7-2557w"] Aug 05 16:41:25.030208 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:41:25.030178 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b48bdd_86e7_41a1_bd67_64430d88befa.slice/crio-9b8eb7ab537ee809865514e665c41ab7f04cad9c6156ff6d9ef21265ff6ef904 WatchSource:0}: Error finding container 9b8eb7ab537ee809865514e665c41ab7f04cad9c6156ff6d9ef21265ff6ef904: Status 404 returned error can't find the container with id 9b8eb7ab537ee809865514e665c41ab7f04cad9c6156ff6d9ef21265ff6ef904 Aug 05 16:41:25.669808 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:25.669506 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-62pb9" event={"ID":"984e95d2-f85a-4c81-a6a0-4f766eaf8c48","Type":"ContainerStarted","Data":"d13700ee9105d70a0fe780c75b8f2a18400e1bca45d868d8e5cdc58e405d4b6d"} Aug 05 16:41:25.669808 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:25.669636 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-62pb9" Aug 05 16:41:25.672563 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:25.672530 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d557cf4b7-2557w" event={"ID":"19b48bdd-86e7-41a1-bd67-64430d88befa","Type":"ContainerStarted","Data":"9b8eb7ab537ee809865514e665c41ab7f04cad9c6156ff6d9ef21265ff6ef904"} Aug 05 16:41:25.682836 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:25.682809 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-62pb9" Aug 05 16:41:25.692010 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:25.691864 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-62pb9" podStartSLOduration=1.415852424 podStartE2EDuration="18.691844504s" totalImagesPullingTime="17.27599208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:25.690523581 +0000 UTC m=+150.175181485" watchObservedRunningTime="2026-08-05 16:41:25.691844504 +0000 UTC m=+150.176502410" Aug 05 16:41:28.774648 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:28.774614 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84cf4f55b7-qkzjp"] Aug 05 16:41:28.795203 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:28.795164 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84cf4f55b7-qkzjp"] Aug 05 16:41:28.795383 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:28.795300 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:28.805627 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:28.805599 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Aug 05 16:41:28.903600 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:28.903558 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-config\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:28.903771 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:28.903610 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-trusted-ca-bundle\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:28.903771 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:28.903686 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-oauth-config\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:28.903771 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:28.903742 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-oauth-serving-cert\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:28.903907 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:28.903832 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-serving-cert\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:28.903907 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:28.903868 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-service-ca\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:28.903907 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:28.903888 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgkm9\" (UniqueName: \"kubernetes.io/projected/7ecfecba-33a6-416d-9051-aabbb25ebd3d-kube-api-access-fgkm9\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.004586 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.004556 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-config\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.004779 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.004601 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-trusted-ca-bundle\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.004779 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.004636 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-oauth-config\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.004779 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.004674 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-oauth-serving-cert\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.004779 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.004719 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-serving-cert\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.004779 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.004760 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-service-ca\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.005037 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.004791 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgkm9\" (UniqueName: \"kubernetes.io/projected/7ecfecba-33a6-416d-9051-aabbb25ebd3d-kube-api-access-fgkm9\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.005692 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.005623 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-oauth-serving-cert\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.005692 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.005623 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-service-ca\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.005883 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.005858 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-config\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.005946 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.005921 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-trusted-ca-bundle\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.008035 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.008012 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-oauth-config\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.008162 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.008142 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-serving-cert\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.015756 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.015729 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgkm9\" (UniqueName: \"kubernetes.io/projected/7ecfecba-33a6-416d-9051-aabbb25ebd3d-kube-api-access-fgkm9\") pod \"console-84cf4f55b7-qkzjp\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.108598 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.108556 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:29.376166 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.376071 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84cf4f55b7-qkzjp"] Aug 05 16:41:29.379802 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:41:29.379769 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ecfecba_33a6_416d_9051_aabbb25ebd3d.slice/crio-4490ca2a81a656f72f8836d298493178dd3b370d7ee4226d7445c0f84e3f533a WatchSource:0}: Error finding container 4490ca2a81a656f72f8836d298493178dd3b370d7ee4226d7445c0f84e3f533a: Status 404 returned error can't find the container with id 4490ca2a81a656f72f8836d298493178dd3b370d7ee4226d7445c0f84e3f533a Aug 05 16:41:29.694987 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.694881 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d557cf4b7-2557w" event={"ID":"19b48bdd-86e7-41a1-bd67-64430d88befa","Type":"ContainerStarted","Data":"8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843"} Aug 05 16:41:29.697188 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.697162 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84cf4f55b7-qkzjp" event={"ID":"7ecfecba-33a6-416d-9051-aabbb25ebd3d","Type":"ContainerStarted","Data":"19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076"} Aug 05 16:41:29.697323 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.697208 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84cf4f55b7-qkzjp" event={"ID":"7ecfecba-33a6-416d-9051-aabbb25ebd3d","Type":"ContainerStarted","Data":"4490ca2a81a656f72f8836d298493178dd3b370d7ee4226d7445c0f84e3f533a"} Aug 05 16:41:29.721902 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.721842 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d557cf4b7-2557w" podStartSLOduration=7.534047532 podStartE2EDuration="11.721826577s" totalImagesPullingTime="4.187779045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:29.719931837 +0000 UTC m=+154.204589741" watchObservedRunningTime="2026-08-05 16:41:29.721826577 +0000 UTC m=+154.206484479" Aug 05 16:41:29.744648 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:29.744602 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84cf4f55b7-qkzjp" podStartSLOduration=1.744581575 podStartE2EDuration="1.744581575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:41:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:29.742295158 +0000 UTC m=+154.226953061" watchObservedRunningTime="2026-08-05 16:41:29.744581575 +0000 UTC m=+154.229239508" Aug 05 16:41:39.109284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:39.109252 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:39.109741 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:39.109310 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:39.113994 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:39.113971 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:39.318438 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:39.317684 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:39.318438 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:39.317764 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:39.322992 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:39.322962 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:39.744152 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:39.744126 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:41:39.744506 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:39.744486 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:41:39.820556 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:41:39.820524 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d557cf4b7-2557w"] Aug 05 16:42:06.767839 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:06.767747 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d557cf4b7-2557w" podUID="19b48bdd-86e7-41a1-bd67-64430d88befa" containerName="console" containerID="cri-o://8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843" gracePeriod=15 Aug 05 16:42:07.042341 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.042279 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:42:07.134809 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.134772 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qltnl\" (UniqueName: \"kubernetes.io/projected/19b48bdd-86e7-41a1-bd67-64430d88befa-kube-api-access-qltnl\") pod \"19b48bdd-86e7-41a1-bd67-64430d88befa\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " Aug 05 16:42:07.134991 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.134839 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19b48bdd-86e7-41a1-bd67-64430d88befa-console-oauth-config\") pod \"19b48bdd-86e7-41a1-bd67-64430d88befa\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " Aug 05 16:42:07.134991 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.134862 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-service-ca\") pod \"19b48bdd-86e7-41a1-bd67-64430d88befa\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " Aug 05 16:42:07.134991 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.134887 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19b48bdd-86e7-41a1-bd67-64430d88befa-console-serving-cert\") pod \"19b48bdd-86e7-41a1-bd67-64430d88befa\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " Aug 05 16:42:07.134991 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.134901 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-console-config\") pod \"19b48bdd-86e7-41a1-bd67-64430d88befa\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " Aug 05 16:42:07.134991 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.134937 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-oauth-serving-cert\") pod \"19b48bdd-86e7-41a1-bd67-64430d88befa\" (UID: \"19b48bdd-86e7-41a1-bd67-64430d88befa\") " Aug 05 16:42:07.135411 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.135376 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-service-ca" (OuterVolumeSpecName: "service-ca") pod "19b48bdd-86e7-41a1-bd67-64430d88befa" (UID: "19b48bdd-86e7-41a1-bd67-64430d88befa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 16:42:07.135535 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.135423 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-console-config" (OuterVolumeSpecName: "console-config") pod "19b48bdd-86e7-41a1-bd67-64430d88befa" (UID: "19b48bdd-86e7-41a1-bd67-64430d88befa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 16:42:07.135535 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.135461 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "19b48bdd-86e7-41a1-bd67-64430d88befa" (UID: "19b48bdd-86e7-41a1-bd67-64430d88befa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 16:42:07.137165 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.137135 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19b48bdd-86e7-41a1-bd67-64430d88befa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "19b48bdd-86e7-41a1-bd67-64430d88befa" (UID: "19b48bdd-86e7-41a1-bd67-64430d88befa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 16:42:07.137321 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.137180 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19b48bdd-86e7-41a1-bd67-64430d88befa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "19b48bdd-86e7-41a1-bd67-64430d88befa" (UID: "19b48bdd-86e7-41a1-bd67-64430d88befa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 16:42:07.137321 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.137205 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b48bdd-86e7-41a1-bd67-64430d88befa-kube-api-access-qltnl" (OuterVolumeSpecName: "kube-api-access-qltnl") pod "19b48bdd-86e7-41a1-bd67-64430d88befa" (UID: "19b48bdd-86e7-41a1-bd67-64430d88befa"). InnerVolumeSpecName "kube-api-access-qltnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 16:42:07.235785 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.235747 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19b48bdd-86e7-41a1-bd67-64430d88befa-console-oauth-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:42:07.235785 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.235777 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:42:07.235785 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.235786 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19b48bdd-86e7-41a1-bd67-64430d88befa-console-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:42:07.240850 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.235795 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-console-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:42:07.240850 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.236332 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19b48bdd-86e7-41a1-bd67-64430d88befa-oauth-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:42:07.240850 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.236358 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qltnl\" (UniqueName: \"kubernetes.io/projected/19b48bdd-86e7-41a1-bd67-64430d88befa-kube-api-access-qltnl\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:42:07.854966 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.854931 2583 generic.go:356] "Generic (PLEG): container finished" podID="19b48bdd-86e7-41a1-bd67-64430d88befa" containerID="8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843" exitCode=0 Aug 05 16:42:07.855400 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.854993 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d557cf4b7-2557w" Aug 05 16:42:07.855400 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.855012 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d557cf4b7-2557w" event={"ID":"19b48bdd-86e7-41a1-bd67-64430d88befa","Type":"ContainerDied","Data":"8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843"} Aug 05 16:42:07.855400 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.855092 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d557cf4b7-2557w" event={"ID":"19b48bdd-86e7-41a1-bd67-64430d88befa","Type":"ContainerDied","Data":"9b8eb7ab537ee809865514e665c41ab7f04cad9c6156ff6d9ef21265ff6ef904"} Aug 05 16:42:07.855400 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.855114 2583 scope.go:117] "RemoveContainer" containerID="8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843" Aug 05 16:42:07.863662 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.863647 2583 scope.go:117] "RemoveContainer" containerID="8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843" Aug 05 16:42:07.863925 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:42:07.863905 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843\": container with ID starting with 8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843 not found: ID does not exist" containerID="8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843" Aug 05 16:42:07.863992 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.863937 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843"} err="failed to get container status \"8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843\": rpc error: code = NotFound desc = could not find container \"8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843\": container with ID starting with 8f10664b39bd76ac43980988706e8359b65d178e3b05c1eb3cc5d1623f656843 not found: ID does not exist" Aug 05 16:42:07.877604 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.877576 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d557cf4b7-2557w"] Aug 05 16:42:07.882552 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:07.882532 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d557cf4b7-2557w"] Aug 05 16:42:08.021953 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:08.021916 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19b48bdd-86e7-41a1-bd67-64430d88befa" path="/var/lib/kubelet/pods/19b48bdd-86e7-41a1-bd67-64430d88befa/volumes" Aug 05 16:42:30.342912 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.342880 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b566f85b5-z5l52"] Aug 05 16:42:30.343365 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.343191 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b48bdd-86e7-41a1-bd67-64430d88befa" containerName="console" Aug 05 16:42:30.343365 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.343202 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b48bdd-86e7-41a1-bd67-64430d88befa" containerName="console" Aug 05 16:42:30.343365 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.343300 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b48bdd-86e7-41a1-bd67-64430d88befa" containerName="console" Aug 05 16:42:30.345732 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.345712 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.373738 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.373706 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b566f85b5-z5l52"] Aug 05 16:42:30.430909 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.430873 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-serving-cert\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.430909 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.430904 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-oauth-serving-cert\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.431145 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.430939 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-oauth-config\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.431145 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.431045 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmm5n\" (UniqueName: \"kubernetes.io/projected/fbbd95e7-5707-4b4a-acea-a332161fb59c-kube-api-access-lmm5n\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.431145 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.431091 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-trusted-ca-bundle\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.431145 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.431117 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-service-ca\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.431295 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.431192 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-config\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.531911 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.531880 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-serving-cert\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.532054 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.531924 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-oauth-serving-cert\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.532054 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.531958 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-oauth-config\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.532054 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.531979 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmm5n\" (UniqueName: \"kubernetes.io/projected/fbbd95e7-5707-4b4a-acea-a332161fb59c-kube-api-access-lmm5n\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.532054 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.532001 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-trusted-ca-bundle\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.532054 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.532018 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-service-ca\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.532331 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.532054 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-config\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.532892 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.532865 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-config\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.532892 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.532882 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-oauth-serving-cert\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.533054 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.532861 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-service-ca\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.533054 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.532927 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-trusted-ca-bundle\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.534368 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.534345 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-oauth-config\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.534523 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.534503 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-serving-cert\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.544298 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.544273 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmm5n\" (UniqueName: \"kubernetes.io/projected/fbbd95e7-5707-4b4a-acea-a332161fb59c-kube-api-access-lmm5n\") pod \"console-7b566f85b5-z5l52\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:30.655236 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:30.655138 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:31.047135 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:31.047062 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b566f85b5-z5l52"] Aug 05 16:42:31.049798 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:42:31.049773 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbd95e7_5707_4b4a_acea_a332161fb59c.slice/crio-1323b929800a9da3e9bb8bc6b806f7347d8c996df70c1773e84d7ee2a753a5f3 WatchSource:0}: Error finding container 1323b929800a9da3e9bb8bc6b806f7347d8c996df70c1773e84d7ee2a753a5f3: Status 404 returned error can't find the container with id 1323b929800a9da3e9bb8bc6b806f7347d8c996df70c1773e84d7ee2a753a5f3 Aug 05 16:42:31.955936 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:31.955899 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b566f85b5-z5l52" event={"ID":"fbbd95e7-5707-4b4a-acea-a332161fb59c","Type":"ContainerStarted","Data":"890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d"} Aug 05 16:42:31.956392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:31.955980 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b566f85b5-z5l52" event={"ID":"fbbd95e7-5707-4b4a-acea-a332161fb59c","Type":"ContainerStarted","Data":"1323b929800a9da3e9bb8bc6b806f7347d8c996df70c1773e84d7ee2a753a5f3"} Aug 05 16:42:31.978856 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:31.978800 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b566f85b5-z5l52" podStartSLOduration=1.978783821 podStartE2EDuration="1.978783821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:42:31.978281696 +0000 UTC m=+216.462939610" watchObservedRunningTime="2026-08-05 16:42:31.978783821 +0000 UTC m=+216.463441725" Aug 05 16:42:40.655776 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:40.655731 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:40.656570 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:40.655804 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:40.660310 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:40.660289 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:40.994584 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:40.994510 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:42:41.047999 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:42:41.047968 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84cf4f55b7-qkzjp"] Aug 05 16:43:06.074259 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.074179 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84cf4f55b7-qkzjp" podUID="7ecfecba-33a6-416d-9051-aabbb25ebd3d" containerName="console" containerID="cri-o://19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076" gracePeriod=15 Aug 05 16:43:06.322167 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.322142 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:43:06.419013 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.418978 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgkm9\" (UniqueName: \"kubernetes.io/projected/7ecfecba-33a6-416d-9051-aabbb25ebd3d-kube-api-access-fgkm9\") pod \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " Aug 05 16:43:06.419161 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.419028 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-oauth-serving-cert\") pod \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " Aug 05 16:43:06.419161 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.419050 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-serving-cert\") pod \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " Aug 05 16:43:06.419161 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.419081 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-config\") pod \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " Aug 05 16:43:06.419161 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.419119 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-oauth-config\") pod \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " Aug 05 16:43:06.419406 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.419162 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-trusted-ca-bundle\") pod \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " Aug 05 16:43:06.419406 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.419184 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-service-ca\") pod \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\" (UID: \"7ecfecba-33a6-416d-9051-aabbb25ebd3d\") " Aug 05 16:43:06.419593 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.419562 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7ecfecba-33a6-416d-9051-aabbb25ebd3d" (UID: "7ecfecba-33a6-416d-9051-aabbb25ebd3d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 16:43:06.419701 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.419666 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7ecfecba-33a6-416d-9051-aabbb25ebd3d" (UID: "7ecfecba-33a6-416d-9051-aabbb25ebd3d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 16:43:06.419701 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.419570 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-config" (OuterVolumeSpecName: "console-config") pod "7ecfecba-33a6-416d-9051-aabbb25ebd3d" (UID: "7ecfecba-33a6-416d-9051-aabbb25ebd3d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 16:43:06.419806 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.419766 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-service-ca" (OuterVolumeSpecName: "service-ca") pod "7ecfecba-33a6-416d-9051-aabbb25ebd3d" (UID: "7ecfecba-33a6-416d-9051-aabbb25ebd3d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 16:43:06.421266 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.421237 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ecfecba-33a6-416d-9051-aabbb25ebd3d-kube-api-access-fgkm9" (OuterVolumeSpecName: "kube-api-access-fgkm9") pod "7ecfecba-33a6-416d-9051-aabbb25ebd3d" (UID: "7ecfecba-33a6-416d-9051-aabbb25ebd3d"). InnerVolumeSpecName "kube-api-access-fgkm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 16:43:06.421266 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.421250 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7ecfecba-33a6-416d-9051-aabbb25ebd3d" (UID: "7ecfecba-33a6-416d-9051-aabbb25ebd3d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 16:43:06.421383 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.421286 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7ecfecba-33a6-416d-9051-aabbb25ebd3d" (UID: "7ecfecba-33a6-416d-9051-aabbb25ebd3d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 16:43:06.520492 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.520444 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgkm9\" (UniqueName: \"kubernetes.io/projected/7ecfecba-33a6-416d-9051-aabbb25ebd3d-kube-api-access-fgkm9\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:43:06.520492 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.520485 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-oauth-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:43:06.520492 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.520494 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:43:06.520492 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.520505 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:43:06.520492 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.520514 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ecfecba-33a6-416d-9051-aabbb25ebd3d-console-oauth-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:43:06.520792 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.520521 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-trusted-ca-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:43:06.520792 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:06.520531 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ecfecba-33a6-416d-9051-aabbb25ebd3d-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:43:07.095254 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:07.095209 2583 generic.go:356] "Generic (PLEG): container finished" podID="7ecfecba-33a6-416d-9051-aabbb25ebd3d" containerID="19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076" exitCode=0 Aug 05 16:43:07.095723 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:07.095271 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84cf4f55b7-qkzjp" Aug 05 16:43:07.095723 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:07.095316 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84cf4f55b7-qkzjp" event={"ID":"7ecfecba-33a6-416d-9051-aabbb25ebd3d","Type":"ContainerDied","Data":"19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076"} Aug 05 16:43:07.095723 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:07.095374 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84cf4f55b7-qkzjp" event={"ID":"7ecfecba-33a6-416d-9051-aabbb25ebd3d","Type":"ContainerDied","Data":"4490ca2a81a656f72f8836d298493178dd3b370d7ee4226d7445c0f84e3f533a"} Aug 05 16:43:07.095723 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:07.095405 2583 scope.go:117] "RemoveContainer" containerID="19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076" Aug 05 16:43:07.106484 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:07.106461 2583 scope.go:117] "RemoveContainer" containerID="19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076" Aug 05 16:43:07.106783 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:43:07.106752 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076\": container with ID starting with 19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076 not found: ID does not exist" containerID="19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076" Aug 05 16:43:07.106889 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:07.106786 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076"} err="failed to get container status \"19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076\": rpc error: code = NotFound desc = could not find container \"19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076\": container with ID starting with 19ae36f11f3c2742e0c53c12a4aaff1990675ed8204a00bf0d9df931d0f5d076 not found: ID does not exist" Aug 05 16:43:07.125205 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:07.125170 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84cf4f55b7-qkzjp"] Aug 05 16:43:07.128235 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:07.128198 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84cf4f55b7-qkzjp"] Aug 05 16:43:08.019587 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:08.019556 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ecfecba-33a6-416d-9051-aabbb25ebd3d" path="/var/lib/kubelet/pods/7ecfecba-33a6-416d-9051-aabbb25ebd3d/volumes" Aug 05 16:43:27.551546 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.551465 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp"] Aug 05 16:43:27.552097 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.551946 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ecfecba-33a6-416d-9051-aabbb25ebd3d" containerName="console" Aug 05 16:43:27.552097 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.551963 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ecfecba-33a6-416d-9051-aabbb25ebd3d" containerName="console" Aug 05 16:43:27.552097 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.552051 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ecfecba-33a6-416d-9051-aabbb25ebd3d" containerName="console" Aug 05 16:43:27.554168 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.554148 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:27.557605 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.557578 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vpzkn\"" Aug 05 16:43:27.557605 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.557591 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 05 16:43:27.558692 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.558673 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 05 16:43:27.571433 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.571411 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp"] Aug 05 16:43:27.697070 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.697033 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2c4v\" (UniqueName: \"kubernetes.io/projected/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-kube-api-access-z2c4v\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp\" (UID: \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:27.697269 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.697098 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp\" (UID: \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:27.697269 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.697126 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp\" (UID: \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:27.798023 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.797992 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp\" (UID: \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:27.798116 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.798034 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp\" (UID: \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:27.798116 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.798079 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2c4v\" (UniqueName: \"kubernetes.io/projected/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-kube-api-access-z2c4v\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp\" (UID: \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:27.798394 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.798377 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp\" (UID: \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:27.798436 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.798422 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp\" (UID: \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:27.809407 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.809351 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2c4v\" (UniqueName: \"kubernetes.io/projected/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-kube-api-access-z2c4v\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp\" (UID: \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:27.863005 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:27.862972 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:28.020309 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:28.020285 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp"] Aug 05 16:43:28.021947 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:43:28.021918 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f00f4b_b268_42bf_9fa2_e84a40d0d70b.slice/crio-35ffff2d860fc5f4704bab5cfef6bb3ab49e7bf444f5e05acc6cf092a880b5bc WatchSource:0}: Error finding container 35ffff2d860fc5f4704bab5cfef6bb3ab49e7bf444f5e05acc6cf092a880b5bc: Status 404 returned error can't find the container with id 35ffff2d860fc5f4704bab5cfef6bb3ab49e7bf444f5e05acc6cf092a880b5bc Aug 05 16:43:28.177975 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:28.177944 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" event={"ID":"65f00f4b-b268-42bf-9fa2-e84a40d0d70b","Type":"ContainerStarted","Data":"35ffff2d860fc5f4704bab5cfef6bb3ab49e7bf444f5e05acc6cf092a880b5bc"} Aug 05 16:43:35.208644 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:35.208606 2583 generic.go:356] "Generic (PLEG): container finished" podID="65f00f4b-b268-42bf-9fa2-e84a40d0d70b" containerID="786513d07433ab01bdd62b3c7e55e402041dd52bf71f0a82e2284394db8e62f1" exitCode=0 Aug 05 16:43:35.209066 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:35.208702 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" event={"ID":"65f00f4b-b268-42bf-9fa2-e84a40d0d70b","Type":"ContainerDied","Data":"786513d07433ab01bdd62b3c7e55e402041dd52bf71f0a82e2284394db8e62f1"} Aug 05 16:43:38.223498 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:38.223461 2583 generic.go:356] "Generic (PLEG): container finished" podID="65f00f4b-b268-42bf-9fa2-e84a40d0d70b" containerID="fbf8a84a7f45414b98136e96daa57375b235d6a5872d6e2b3b60aeb5718c4e73" exitCode=0 Aug 05 16:43:38.223856 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:38.223527 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" event={"ID":"65f00f4b-b268-42bf-9fa2-e84a40d0d70b","Type":"ContainerDied","Data":"fbf8a84a7f45414b98136e96daa57375b235d6a5872d6e2b3b60aeb5718c4e73"} Aug 05 16:43:45.263087 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:45.263050 2583 generic.go:356] "Generic (PLEG): container finished" podID="65f00f4b-b268-42bf-9fa2-e84a40d0d70b" containerID="35a2c6782656c8a38290af380e7afb8223e07a5ce95d1fff1ccd8d629268c826" exitCode=0 Aug 05 16:43:45.263583 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:45.263115 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" event={"ID":"65f00f4b-b268-42bf-9fa2-e84a40d0d70b","Type":"ContainerDied","Data":"35a2c6782656c8a38290af380e7afb8223e07a5ce95d1fff1ccd8d629268c826"} Aug 05 16:43:46.396128 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:46.396097 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:46.456096 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:46.456066 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-bundle\") pod \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\" (UID: \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\") " Aug 05 16:43:46.456266 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:46.456118 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-util\") pod \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\" (UID: \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\") " Aug 05 16:43:46.456266 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:46.456145 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2c4v\" (UniqueName: \"kubernetes.io/projected/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-kube-api-access-z2c4v\") pod \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\" (UID: \"65f00f4b-b268-42bf-9fa2-e84a40d0d70b\") " Aug 05 16:43:46.456695 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:46.456670 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-bundle" (OuterVolumeSpecName: "bundle") pod "65f00f4b-b268-42bf-9fa2-e84a40d0d70b" (UID: "65f00f4b-b268-42bf-9fa2-e84a40d0d70b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 16:43:46.458299 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:46.458273 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-kube-api-access-z2c4v" (OuterVolumeSpecName: "kube-api-access-z2c4v") pod "65f00f4b-b268-42bf-9fa2-e84a40d0d70b" (UID: "65f00f4b-b268-42bf-9fa2-e84a40d0d70b"). InnerVolumeSpecName "kube-api-access-z2c4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 16:43:46.460785 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:46.460766 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-util" (OuterVolumeSpecName: "util") pod "65f00f4b-b268-42bf-9fa2-e84a40d0d70b" (UID: "65f00f4b-b268-42bf-9fa2-e84a40d0d70b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 16:43:46.557495 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:46.557420 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2c4v\" (UniqueName: \"kubernetes.io/projected/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-kube-api-access-z2c4v\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:43:46.557495 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:46.557445 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:43:46.557495 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:46.557454 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65f00f4b-b268-42bf-9fa2-e84a40d0d70b-util\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:43:47.273229 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:47.273198 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" Aug 05 16:43:47.273399 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:47.273194 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404dfvp" event={"ID":"65f00f4b-b268-42bf-9fa2-e84a40d0d70b","Type":"ContainerDied","Data":"35ffff2d860fc5f4704bab5cfef6bb3ab49e7bf444f5e05acc6cf092a880b5bc"} Aug 05 16:43:47.273399 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:47.273331 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35ffff2d860fc5f4704bab5cfef6bb3ab49e7bf444f5e05acc6cf092a880b5bc" Aug 05 16:43:50.522224 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.522192 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9"] Aug 05 16:43:50.522591 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.522553 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f00f4b-b268-42bf-9fa2-e84a40d0d70b" containerName="extract" Aug 05 16:43:50.522591 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.522564 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f00f4b-b268-42bf-9fa2-e84a40d0d70b" containerName="extract" Aug 05 16:43:50.522591 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.522576 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f00f4b-b268-42bf-9fa2-e84a40d0d70b" containerName="util" Aug 05 16:43:50.522591 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.522582 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f00f4b-b268-42bf-9fa2-e84a40d0d70b" containerName="util" Aug 05 16:43:50.522591 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.522590 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f00f4b-b268-42bf-9fa2-e84a40d0d70b" containerName="pull" Aug 05 16:43:50.522591 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.522595 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f00f4b-b268-42bf-9fa2-e84a40d0d70b" containerName="pull" Aug 05 16:43:50.522770 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.522657 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="65f00f4b-b268-42bf-9fa2-e84a40d0d70b" containerName="extract" Aug 05 16:43:50.525607 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.525591 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9" Aug 05 16:43:50.528658 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.528632 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Aug 05 16:43:50.529099 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.529079 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-b88kv\"" Aug 05 16:43:50.529158 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.529079 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Aug 05 16:43:50.547956 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.544696 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9"] Aug 05 16:43:50.584561 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.584538 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e5c2af2-3c51-4104-8875-359379b3e8fa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-flfg9\" (UID: \"8e5c2af2-3c51-4104-8875-359379b3e8fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9" Aug 05 16:43:50.584695 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.584597 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddfr7\" (UniqueName: \"kubernetes.io/projected/8e5c2af2-3c51-4104-8875-359379b3e8fa-kube-api-access-ddfr7\") pod \"cert-manager-operator-controller-manager-55c444bf86-flfg9\" (UID: \"8e5c2af2-3c51-4104-8875-359379b3e8fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9" Aug 05 16:43:50.685647 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.685613 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddfr7\" (UniqueName: \"kubernetes.io/projected/8e5c2af2-3c51-4104-8875-359379b3e8fa-kube-api-access-ddfr7\") pod \"cert-manager-operator-controller-manager-55c444bf86-flfg9\" (UID: \"8e5c2af2-3c51-4104-8875-359379b3e8fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9" Aug 05 16:43:50.685783 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.685670 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e5c2af2-3c51-4104-8875-359379b3e8fa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-flfg9\" (UID: \"8e5c2af2-3c51-4104-8875-359379b3e8fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9" Aug 05 16:43:50.686024 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.686002 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e5c2af2-3c51-4104-8875-359379b3e8fa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-flfg9\" (UID: \"8e5c2af2-3c51-4104-8875-359379b3e8fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9" Aug 05 16:43:50.697511 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.697489 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddfr7\" (UniqueName: \"kubernetes.io/projected/8e5c2af2-3c51-4104-8875-359379b3e8fa-kube-api-access-ddfr7\") pod \"cert-manager-operator-controller-manager-55c444bf86-flfg9\" (UID: \"8e5c2af2-3c51-4104-8875-359379b3e8fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9" Aug 05 16:43:50.835016 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.834925 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9" Aug 05 16:43:50.984859 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:50.984836 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9"] Aug 05 16:43:50.987100 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:43:50.987070 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5c2af2_3c51_4104_8875_359379b3e8fa.slice/crio-d6a5366bcf55be4d48fff47d2531d8b3a2188128f31913dbb96d9a0ad653d259 WatchSource:0}: Error finding container d6a5366bcf55be4d48fff47d2531d8b3a2188128f31913dbb96d9a0ad653d259: Status 404 returned error can't find the container with id d6a5366bcf55be4d48fff47d2531d8b3a2188128f31913dbb96d9a0ad653d259 Aug 05 16:43:51.291784 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:51.291751 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9" event={"ID":"8e5c2af2-3c51-4104-8875-359379b3e8fa","Type":"ContainerStarted","Data":"d6a5366bcf55be4d48fff47d2531d8b3a2188128f31913dbb96d9a0ad653d259"} Aug 05 16:43:54.307504 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.307466 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9" event={"ID":"8e5c2af2-3c51-4104-8875-359379b3e8fa","Type":"ContainerStarted","Data":"a3b89c095405b74f5def0c22075e62e30a7b3fe43e1a6311c54145ec83831fde"} Aug 05 16:43:54.338440 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.338392 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-flfg9" podStartSLOduration=1.933544529 podStartE2EDuration="4.338375653s" totalImagesPullingTime="2.404831124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:43:54.337632185 +0000 UTC m=+298.822290087" watchObservedRunningTime="2026-08-05 16:43:54.338375653 +0000 UTC m=+298.823033556" Aug 05 16:43:54.364164 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.364131 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2xsjx"] Aug 05 16:43:54.367531 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.367510 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" Aug 05 16:43:54.370367 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.370343 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Aug 05 16:43:54.370479 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.370404 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Aug 05 16:43:54.370544 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.370528 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lzd9d\"" Aug 05 16:43:54.388411 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.388385 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2xsjx"] Aug 05 16:43:54.416418 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.416389 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/807715e1-afde-4929-8c6a-8d102dc1c50b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2xsjx\" (UID: \"807715e1-afde-4929-8c6a-8d102dc1c50b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" Aug 05 16:43:54.416548 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.416437 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl46x\" (UniqueName: \"kubernetes.io/projected/807715e1-afde-4929-8c6a-8d102dc1c50b-kube-api-access-kl46x\") pod \"cert-manager-webhook-6486ffd997-2xsjx\" (UID: \"807715e1-afde-4929-8c6a-8d102dc1c50b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" Aug 05 16:43:54.516795 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.516759 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/807715e1-afde-4929-8c6a-8d102dc1c50b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2xsjx\" (UID: \"807715e1-afde-4929-8c6a-8d102dc1c50b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" Aug 05 16:43:54.516940 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.516813 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl46x\" (UniqueName: \"kubernetes.io/projected/807715e1-afde-4929-8c6a-8d102dc1c50b-kube-api-access-kl46x\") pod \"cert-manager-webhook-6486ffd997-2xsjx\" (UID: \"807715e1-afde-4929-8c6a-8d102dc1c50b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" Aug 05 16:43:54.531867 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.531834 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl46x\" (UniqueName: \"kubernetes.io/projected/807715e1-afde-4929-8c6a-8d102dc1c50b-kube-api-access-kl46x\") pod \"cert-manager-webhook-6486ffd997-2xsjx\" (UID: \"807715e1-afde-4929-8c6a-8d102dc1c50b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" Aug 05 16:43:54.531972 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.531897 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/807715e1-afde-4929-8c6a-8d102dc1c50b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2xsjx\" (UID: \"807715e1-afde-4929-8c6a-8d102dc1c50b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" Aug 05 16:43:54.689006 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.688973 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" Aug 05 16:43:54.839375 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:54.839247 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2xsjx"] Aug 05 16:43:54.841878 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:43:54.841841 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod807715e1_afde_4929_8c6a_8d102dc1c50b.slice/crio-f70258616780e2b290b535381e9f6e26384b58ca095235bb6d391587e2e8efd4 WatchSource:0}: Error finding container f70258616780e2b290b535381e9f6e26384b58ca095235bb6d391587e2e8efd4: Status 404 returned error can't find the container with id f70258616780e2b290b535381e9f6e26384b58ca095235bb6d391587e2e8efd4 Aug 05 16:43:55.312497 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:55.312449 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" event={"ID":"807715e1-afde-4929-8c6a-8d102dc1c50b","Type":"ContainerStarted","Data":"f70258616780e2b290b535381e9f6e26384b58ca095235bb6d391587e2e8efd4"} Aug 05 16:43:55.904845 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:55.904811 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 16:43:55.907607 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:55.907584 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 16:43:55.917098 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:55.917077 2583 kubelet.go:1648] "Image garbage collection succeeded" Aug 05 16:43:58.330467 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:58.330432 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" event={"ID":"807715e1-afde-4929-8c6a-8d102dc1c50b","Type":"ContainerStarted","Data":"d85a17083305c22f58fdd4d8206d674f2eb064101d7ebd659300db30bd5e33aa"} Aug 05 16:43:58.330965 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:58.330563 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" Aug 05 16:43:58.351491 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:43:58.351443 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" podStartSLOduration=1.64466542 podStartE2EDuration="4.351428206s" totalImagesPullingTime="2.706762786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:43:58.349686857 +0000 UTC m=+302.834344759" watchObservedRunningTime="2026-08-05 16:43:58.351428206 +0000 UTC m=+302.836086110" Aug 05 16:44:02.054895 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:02.054862 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-smqfj"] Aug 05 16:44:02.058296 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:02.058276 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-smqfj" Aug 05 16:44:02.061630 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:02.061608 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7wqjz\"" Aug 05 16:44:02.073895 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:02.073870 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-smqfj"] Aug 05 16:44:02.081604 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:02.081579 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9td7\" (UniqueName: \"kubernetes.io/projected/fe3be866-453d-4665-b2c2-5d0c5da8b5c0-kube-api-access-f9td7\") pod \"cert-manager-cainjector-559cdd8c87-smqfj\" (UID: \"fe3be866-453d-4665-b2c2-5d0c5da8b5c0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-smqfj" Aug 05 16:44:02.081737 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:02.081620 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe3be866-453d-4665-b2c2-5d0c5da8b5c0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-smqfj\" (UID: \"fe3be866-453d-4665-b2c2-5d0c5da8b5c0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-smqfj" Aug 05 16:44:02.182112 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:02.182085 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9td7\" (UniqueName: \"kubernetes.io/projected/fe3be866-453d-4665-b2c2-5d0c5da8b5c0-kube-api-access-f9td7\") pod \"cert-manager-cainjector-559cdd8c87-smqfj\" (UID: \"fe3be866-453d-4665-b2c2-5d0c5da8b5c0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-smqfj" Aug 05 16:44:02.182296 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:02.182125 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe3be866-453d-4665-b2c2-5d0c5da8b5c0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-smqfj\" (UID: \"fe3be866-453d-4665-b2c2-5d0c5da8b5c0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-smqfj" Aug 05 16:44:02.192749 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:02.192723 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe3be866-453d-4665-b2c2-5d0c5da8b5c0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-smqfj\" (UID: \"fe3be866-453d-4665-b2c2-5d0c5da8b5c0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-smqfj" Aug 05 16:44:02.193197 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:02.193179 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9td7\" (UniqueName: \"kubernetes.io/projected/fe3be866-453d-4665-b2c2-5d0c5da8b5c0-kube-api-access-f9td7\") pod \"cert-manager-cainjector-559cdd8c87-smqfj\" (UID: \"fe3be866-453d-4665-b2c2-5d0c5da8b5c0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-smqfj" Aug 05 16:44:02.367068 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:02.367036 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-smqfj" Aug 05 16:44:02.503973 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:02.503951 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-smqfj"] Aug 05 16:44:02.506021 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:44:02.505994 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe3be866_453d_4665_b2c2_5d0c5da8b5c0.slice/crio-ee0e91ecc5d99ba5f95c17bd16bf39dff7e5a0ab28804fa7ff5ded7a5c5e6b0b WatchSource:0}: Error finding container ee0e91ecc5d99ba5f95c17bd16bf39dff7e5a0ab28804fa7ff5ded7a5c5e6b0b: Status 404 returned error can't find the container with id ee0e91ecc5d99ba5f95c17bd16bf39dff7e5a0ab28804fa7ff5ded7a5c5e6b0b Aug 05 16:44:03.355462 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:03.355425 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-smqfj" event={"ID":"fe3be866-453d-4665-b2c2-5d0c5da8b5c0","Type":"ContainerStarted","Data":"bb48312dfe1d03b7cdfaefa03d0e4ff8607768c5bcf02fd8d0ce9bba7af31d4f"} Aug 05 16:44:03.355462 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:03.355467 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-smqfj" event={"ID":"fe3be866-453d-4665-b2c2-5d0c5da8b5c0","Type":"ContainerStarted","Data":"ee0e91ecc5d99ba5f95c17bd16bf39dff7e5a0ab28804fa7ff5ded7a5c5e6b0b"} Aug 05 16:44:03.385935 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:03.385873 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-smqfj" podStartSLOduration=1.385852096 podStartE2EDuration="1.385852096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:44:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:44:03.384778541 +0000 UTC m=+307.869436448" watchObservedRunningTime="2026-08-05 16:44:03.385852096 +0000 UTC m=+307.870510001" Aug 05 16:44:04.337026 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:04.336991 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2xsjx" Aug 05 16:44:38.880798 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.880758 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr"] Aug 05 16:44:38.883671 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.883655 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:38.887595 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.887573 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Aug 05 16:44:38.889916 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.889895 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Aug 05 16:44:38.890023 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.889982 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Aug 05 16:44:38.891169 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.890985 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-knfx2\"" Aug 05 16:44:38.891169 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.890986 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Aug 05 16:44:38.917638 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.917612 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr"] Aug 05 16:44:38.984937 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.984908 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:38.984937 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.984938 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:38.985130 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.984976 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9qr\" (UniqueName: \"kubernetes.io/projected/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-kube-api-access-nk9qr\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:38.985130 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.985058 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-manifests\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:38.985130 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:38.985105 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-tmp\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:39.085763 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.085723 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9qr\" (UniqueName: \"kubernetes.io/projected/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-kube-api-access-nk9qr\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:39.085921 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.085772 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-manifests\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:39.085921 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.085805 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-tmp\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:39.086005 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.085973 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:39.086054 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.086013 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:39.086284 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.086254 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-manifests\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:39.088015 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.087985 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-tmp\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:39.088339 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.088322 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:39.088388 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.088322 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:39.098409 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.098387 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9qr\" (UniqueName: \"kubernetes.io/projected/d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a-kube-api-access-nk9qr\") pod \"opendatahub-operator-controller-manager-7b469b89cc-t8qnr\" (UID: \"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:39.194407 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.194333 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:39.337175 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.337150 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr"] Aug 05 16:44:39.341656 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:44:39.341622 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08b4b0c_8deb_4356_9bcd_e0fc6cafe29a.slice/crio-b0e38569e74196dfbb470e108ebee9b39154487c763addbd7e30f9cb0105ce11 WatchSource:0}: Error finding container b0e38569e74196dfbb470e108ebee9b39154487c763addbd7e30f9cb0105ce11: Status 404 returned error can't find the container with id b0e38569e74196dfbb470e108ebee9b39154487c763addbd7e30f9cb0105ce11 Aug 05 16:44:39.343518 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.343499 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 16:44:39.514511 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:39.514419 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" event={"ID":"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a","Type":"ContainerStarted","Data":"b0e38569e74196dfbb470e108ebee9b39154487c763addbd7e30f9cb0105ce11"} Aug 05 16:44:42.533249 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:42.533187 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" event={"ID":"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a","Type":"ContainerStarted","Data":"bd441e367243ee8bea178f188f92311ed4efb4fceaf0e52a4dec20cfd59dd45d"} Aug 05 16:44:43.539906 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:43.539866 2583 generic.go:356] "Generic (PLEG): container finished" podID="d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a" containerID="bd441e367243ee8bea178f188f92311ed4efb4fceaf0e52a4dec20cfd59dd45d" exitCode=0 Aug 05 16:44:43.540291 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:43.539954 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" event={"ID":"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a","Type":"ContainerDied","Data":"bd441e367243ee8bea178f188f92311ed4efb4fceaf0e52a4dec20cfd59dd45d"} Aug 05 16:44:44.546115 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:44.546079 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" event={"ID":"d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a","Type":"ContainerStarted","Data":"c2e773e7b161b2c1407dd965f1c2c2a844149d3e644c0fd102d92670be6d0e35"} Aug 05 16:44:44.546511 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:44.546187 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:44:44.574756 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:44.574707 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" podStartSLOduration=2.076360828 podStartE2EDuration="6.574691622s" totalImagesPullingTime="3.467378495s" totalInitContainerRuntime="1.030952299s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:44:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:44:44.573027673 +0000 UTC m=+349.057685576" watchObservedRunningTime="2026-08-05 16:44:44.574691622 +0000 UTC m=+349.059349524" Aug 05 16:44:55.554925 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:44:55.554840 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-t8qnr" Aug 05 16:45:01.659154 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.659120 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-558bb69c48-9t77z"] Aug 05 16:45:01.666802 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.666781 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" Aug 05 16:45:01.671501 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.671479 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Aug 05 16:45:01.672672 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.672642 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Aug 05 16:45:01.672792 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.672712 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Aug 05 16:45:01.672792 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.672752 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4nsxk\"" Aug 05 16:45:01.672792 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.672712 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Aug 05 16:45:01.682242 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.682190 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-558bb69c48-9t77z"] Aug 05 16:45:01.763281 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.763247 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee73bceb-b365-49c8-965b-e09eb1157386-tls-certs\") pod \"kube-auth-proxy-558bb69c48-9t77z\" (UID: \"ee73bceb-b365-49c8-965b-e09eb1157386\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" Aug 05 16:45:01.763456 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.763291 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee73bceb-b365-49c8-965b-e09eb1157386-tmp\") pod \"kube-auth-proxy-558bb69c48-9t77z\" (UID: \"ee73bceb-b365-49c8-965b-e09eb1157386\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" Aug 05 16:45:01.763456 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.763319 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-822bt\" (UniqueName: \"kubernetes.io/projected/ee73bceb-b365-49c8-965b-e09eb1157386-kube-api-access-822bt\") pod \"kube-auth-proxy-558bb69c48-9t77z\" (UID: \"ee73bceb-b365-49c8-965b-e09eb1157386\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" Aug 05 16:45:01.864417 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.864380 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee73bceb-b365-49c8-965b-e09eb1157386-tmp\") pod \"kube-auth-proxy-558bb69c48-9t77z\" (UID: \"ee73bceb-b365-49c8-965b-e09eb1157386\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" Aug 05 16:45:01.864558 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.864428 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-822bt\" (UniqueName: \"kubernetes.io/projected/ee73bceb-b365-49c8-965b-e09eb1157386-kube-api-access-822bt\") pod \"kube-auth-proxy-558bb69c48-9t77z\" (UID: \"ee73bceb-b365-49c8-965b-e09eb1157386\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" Aug 05 16:45:01.864617 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.864566 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee73bceb-b365-49c8-965b-e09eb1157386-tls-certs\") pod \"kube-auth-proxy-558bb69c48-9t77z\" (UID: \"ee73bceb-b365-49c8-965b-e09eb1157386\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" Aug 05 16:45:01.866626 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.866596 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee73bceb-b365-49c8-965b-e09eb1157386-tmp\") pod \"kube-auth-proxy-558bb69c48-9t77z\" (UID: \"ee73bceb-b365-49c8-965b-e09eb1157386\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" Aug 05 16:45:01.866868 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.866848 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee73bceb-b365-49c8-965b-e09eb1157386-tls-certs\") pod \"kube-auth-proxy-558bb69c48-9t77z\" (UID: \"ee73bceb-b365-49c8-965b-e09eb1157386\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" Aug 05 16:45:01.877841 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.877817 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-822bt\" (UniqueName: \"kubernetes.io/projected/ee73bceb-b365-49c8-965b-e09eb1157386-kube-api-access-822bt\") pod \"kube-auth-proxy-558bb69c48-9t77z\" (UID: \"ee73bceb-b365-49c8-965b-e09eb1157386\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" Aug 05 16:45:01.976079 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:01.975994 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" Aug 05 16:45:02.108570 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:02.108545 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-558bb69c48-9t77z"] Aug 05 16:45:02.110160 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:45:02.110132 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee73bceb_b365_49c8_965b_e09eb1157386.slice/crio-6e3781975f70b77dbf82376ef09f76c5a4a1565c63f576862a8d3a607f6ca7e0 WatchSource:0}: Error finding container 6e3781975f70b77dbf82376ef09f76c5a4a1565c63f576862a8d3a607f6ca7e0: Status 404 returned error can't find the container with id 6e3781975f70b77dbf82376ef09f76c5a4a1565c63f576862a8d3a607f6ca7e0 Aug 05 16:45:02.628352 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:02.628313 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" event={"ID":"ee73bceb-b365-49c8-965b-e09eb1157386","Type":"ContainerStarted","Data":"6e3781975f70b77dbf82376ef09f76c5a4a1565c63f576862a8d3a607f6ca7e0"} Aug 05 16:45:06.098955 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.098920 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-598789449f-tpzrl"] Aug 05 16:45:06.102330 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.102309 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.106624 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.106593 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Aug 05 16:45:06.106740 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.106654 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Aug 05 16:45:06.106740 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.106653 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Aug 05 16:45:06.106740 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.106655 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4bdhp\"" Aug 05 16:45:06.106900 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.106792 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Aug 05 16:45:06.111366 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.111349 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Aug 05 16:45:06.117279 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.117256 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-598789449f-tpzrl"] Aug 05 16:45:06.203378 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.203343 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75c38173-cc3f-4614-82f6-2b7b6260a610-cert\") pod \"lws-controller-manager-598789449f-tpzrl\" (UID: \"75c38173-cc3f-4614-82f6-2b7b6260a610\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.203378 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.203378 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/75c38173-cc3f-4614-82f6-2b7b6260a610-manager-config\") pod \"lws-controller-manager-598789449f-tpzrl\" (UID: \"75c38173-cc3f-4614-82f6-2b7b6260a610\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.203598 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.203404 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/75c38173-cc3f-4614-82f6-2b7b6260a610-metrics-cert\") pod \"lws-controller-manager-598789449f-tpzrl\" (UID: \"75c38173-cc3f-4614-82f6-2b7b6260a610\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.203598 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.203499 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d88n8\" (UniqueName: \"kubernetes.io/projected/75c38173-cc3f-4614-82f6-2b7b6260a610-kube-api-access-d88n8\") pod \"lws-controller-manager-598789449f-tpzrl\" (UID: \"75c38173-cc3f-4614-82f6-2b7b6260a610\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.304719 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.304666 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d88n8\" (UniqueName: \"kubernetes.io/projected/75c38173-cc3f-4614-82f6-2b7b6260a610-kube-api-access-d88n8\") pod \"lws-controller-manager-598789449f-tpzrl\" (UID: \"75c38173-cc3f-4614-82f6-2b7b6260a610\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.304904 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.304776 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75c38173-cc3f-4614-82f6-2b7b6260a610-cert\") pod \"lws-controller-manager-598789449f-tpzrl\" (UID: \"75c38173-cc3f-4614-82f6-2b7b6260a610\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.304904 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.304800 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/75c38173-cc3f-4614-82f6-2b7b6260a610-manager-config\") pod \"lws-controller-manager-598789449f-tpzrl\" (UID: \"75c38173-cc3f-4614-82f6-2b7b6260a610\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.304904 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.304825 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/75c38173-cc3f-4614-82f6-2b7b6260a610-metrics-cert\") pod \"lws-controller-manager-598789449f-tpzrl\" (UID: \"75c38173-cc3f-4614-82f6-2b7b6260a610\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.305505 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.305481 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/75c38173-cc3f-4614-82f6-2b7b6260a610-manager-config\") pod \"lws-controller-manager-598789449f-tpzrl\" (UID: \"75c38173-cc3f-4614-82f6-2b7b6260a610\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.307442 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.307420 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/75c38173-cc3f-4614-82f6-2b7b6260a610-metrics-cert\") pod \"lws-controller-manager-598789449f-tpzrl\" (UID: \"75c38173-cc3f-4614-82f6-2b7b6260a610\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.307556 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.307452 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75c38173-cc3f-4614-82f6-2b7b6260a610-cert\") pod \"lws-controller-manager-598789449f-tpzrl\" (UID: \"75c38173-cc3f-4614-82f6-2b7b6260a610\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.317880 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.317855 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d88n8\" (UniqueName: \"kubernetes.io/projected/75c38173-cc3f-4614-82f6-2b7b6260a610-kube-api-access-d88n8\") pod \"lws-controller-manager-598789449f-tpzrl\" (UID: \"75c38173-cc3f-4614-82f6-2b7b6260a610\") " pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.412091 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.412000 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:06.554570 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.554544 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-598789449f-tpzrl"] Aug 05 16:45:06.556673 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:45:06.556645 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c38173_cc3f_4614_82f6_2b7b6260a610.slice/crio-a01514ea87197187970cbe91e9a96e556d947100157e02f4b441ae93a470e973 WatchSource:0}: Error finding container a01514ea87197187970cbe91e9a96e556d947100157e02f4b441ae93a470e973: Status 404 returned error can't find the container with id a01514ea87197187970cbe91e9a96e556d947100157e02f4b441ae93a470e973 Aug 05 16:45:06.650162 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.650131 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" event={"ID":"ee73bceb-b365-49c8-965b-e09eb1157386","Type":"ContainerStarted","Data":"5911e9a26819081c638c5d4538df77832049c99f045d35b677d3c4b457be86ab"} Aug 05 16:45:06.651437 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.651415 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" event={"ID":"75c38173-cc3f-4614-82f6-2b7b6260a610","Type":"ContainerStarted","Data":"a01514ea87197187970cbe91e9a96e556d947100157e02f4b441ae93a470e973"} Aug 05 16:45:06.673081 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:06.672995 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-558bb69c48-9t77z" podStartSLOduration=2.160884763 podStartE2EDuration="5.672978939s" totalImagesPullingTime="3.512094176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:45:06.670160421 +0000 UTC m=+371.154818325" watchObservedRunningTime="2026-08-05 16:45:06.672978939 +0000 UTC m=+371.157636844" Aug 05 16:45:09.668491 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:09.668451 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" event={"ID":"75c38173-cc3f-4614-82f6-2b7b6260a610","Type":"ContainerStarted","Data":"85b67e95e87e55924392a0181f4578d8c38a6f0e2c4befeca96731ae965d695c"} Aug 05 16:45:09.668918 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:09.668550 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:20.674759 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:20.674728 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" Aug 05 16:45:20.695438 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:45:20.695383 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-598789449f-tpzrl" podStartSLOduration=12.160627975 podStartE2EDuration="14.695366989s" totalImagesPullingTime="2.534739014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:45:09.711611026 +0000 UTC m=+374.196268928" watchObservedRunningTime="2026-08-05 16:45:20.695366989 +0000 UTC m=+385.180024960" Aug 05 16:46:27.677792 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.677720 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9f869d5c5-vjtxc"] Aug 05 16:46:27.681074 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.681052 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.695666 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.695643 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9f869d5c5-vjtxc"] Aug 05 16:46:27.799256 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.799199 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f5c3e3-6ed2-4823-9151-e281b3120971-service-ca\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.799256 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.799266 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5f5c3e3-6ed2-4823-9151-e281b3120971-console-config\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.799479 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.799282 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5f5c3e3-6ed2-4823-9151-e281b3120971-oauth-serving-cert\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.799479 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.799313 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5f5c3e3-6ed2-4823-9151-e281b3120971-console-oauth-config\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.799479 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.799336 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lgrb\" (UniqueName: \"kubernetes.io/projected/d5f5c3e3-6ed2-4823-9151-e281b3120971-kube-api-access-5lgrb\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.799479 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.799400 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f5c3e3-6ed2-4823-9151-e281b3120971-console-serving-cert\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.799479 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.799429 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f5c3e3-6ed2-4823-9151-e281b3120971-trusted-ca-bundle\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.900552 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.900522 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f5c3e3-6ed2-4823-9151-e281b3120971-service-ca\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.900730 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.900566 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5f5c3e3-6ed2-4823-9151-e281b3120971-console-config\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.900730 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.900590 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5f5c3e3-6ed2-4823-9151-e281b3120971-oauth-serving-cert\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.900730 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.900626 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5f5c3e3-6ed2-4823-9151-e281b3120971-console-oauth-config\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.900730 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.900659 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lgrb\" (UniqueName: \"kubernetes.io/projected/d5f5c3e3-6ed2-4823-9151-e281b3120971-kube-api-access-5lgrb\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.900978 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.900947 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f5c3e3-6ed2-4823-9151-e281b3120971-console-serving-cert\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.901068 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.901027 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f5c3e3-6ed2-4823-9151-e281b3120971-trusted-ca-bundle\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.901409 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.901379 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5f5c3e3-6ed2-4823-9151-e281b3120971-console-config\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.901409 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.901393 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5f5c3e3-6ed2-4823-9151-e281b3120971-oauth-serving-cert\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.901609 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.901453 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f5c3e3-6ed2-4823-9151-e281b3120971-service-ca\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.901777 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.901757 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5f5c3e3-6ed2-4823-9151-e281b3120971-trusted-ca-bundle\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.903230 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.903193 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5f5c3e3-6ed2-4823-9151-e281b3120971-console-oauth-config\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.903330 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.903314 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f5c3e3-6ed2-4823-9151-e281b3120971-console-serving-cert\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.909309 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.909293 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lgrb\" (UniqueName: \"kubernetes.io/projected/d5f5c3e3-6ed2-4823-9151-e281b3120971-kube-api-access-5lgrb\") pod \"console-9f869d5c5-vjtxc\" (UID: \"d5f5c3e3-6ed2-4823-9151-e281b3120971\") " pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:27.991452 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:27.991367 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:28.126957 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:28.126932 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9f869d5c5-vjtxc"] Aug 05 16:46:28.128637 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:46:28.128610 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f5c3e3_6ed2_4823_9151_e281b3120971.slice/crio-156e7af75d7543a214fdbac0ecad65c493a092fb8548323491f25a70fe684143 WatchSource:0}: Error finding container 156e7af75d7543a214fdbac0ecad65c493a092fb8548323491f25a70fe684143: Status 404 returned error can't find the container with id 156e7af75d7543a214fdbac0ecad65c493a092fb8548323491f25a70fe684143 Aug 05 16:46:29.027437 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:29.027401 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f869d5c5-vjtxc" event={"ID":"d5f5c3e3-6ed2-4823-9151-e281b3120971","Type":"ContainerStarted","Data":"c686e7c284c9b51656535c5e01a2359bef0a8b9a2aa3382f4746f6bce165f68b"} Aug 05 16:46:29.027816 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:29.027451 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f869d5c5-vjtxc" event={"ID":"d5f5c3e3-6ed2-4823-9151-e281b3120971","Type":"ContainerStarted","Data":"156e7af75d7543a214fdbac0ecad65c493a092fb8548323491f25a70fe684143"} Aug 05 16:46:29.050346 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:29.050296 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9f869d5c5-vjtxc" podStartSLOduration=2.050281728 podStartE2EDuration="2.050281728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:46:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:46:29.049032855 +0000 UTC m=+453.533690777" watchObservedRunningTime="2026-08-05 16:46:29.050281728 +0000 UTC m=+453.534939630" Aug 05 16:46:30.577287 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.577252 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts"] Aug 05 16:46:30.580619 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.580602 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" Aug 05 16:46:30.583425 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.583399 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Aug 05 16:46:30.583651 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.583425 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Aug 05 16:46:30.583651 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.583452 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g7n27\"" Aug 05 16:46:30.584561 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.584543 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Aug 05 16:46:30.584656 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.584551 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Aug 05 16:46:30.590357 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.590334 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts"] Aug 05 16:46:30.725576 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.725545 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b21406-594b-4885-a45c-6e683b685136-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-hzgts\" (UID: \"74b21406-594b-4885-a45c-6e683b685136\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" Aug 05 16:46:30.725775 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.725686 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56p5g\" (UniqueName: \"kubernetes.io/projected/74b21406-594b-4885-a45c-6e683b685136-kube-api-access-56p5g\") pod \"kuadrant-console-plugin-598f86468b-hzgts\" (UID: \"74b21406-594b-4885-a45c-6e683b685136\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" Aug 05 16:46:30.725775 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.725744 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/74b21406-594b-4885-a45c-6e683b685136-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-hzgts\" (UID: \"74b21406-594b-4885-a45c-6e683b685136\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" Aug 05 16:46:30.827171 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.827133 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56p5g\" (UniqueName: \"kubernetes.io/projected/74b21406-594b-4885-a45c-6e683b685136-kube-api-access-56p5g\") pod \"kuadrant-console-plugin-598f86468b-hzgts\" (UID: \"74b21406-594b-4885-a45c-6e683b685136\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" Aug 05 16:46:30.827379 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.827191 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/74b21406-594b-4885-a45c-6e683b685136-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-hzgts\" (UID: \"74b21406-594b-4885-a45c-6e683b685136\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" Aug 05 16:46:30.827379 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.827272 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b21406-594b-4885-a45c-6e683b685136-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-hzgts\" (UID: \"74b21406-594b-4885-a45c-6e683b685136\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" Aug 05 16:46:30.827487 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:46:30.827391 2583 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Aug 05 16:46:30.827487 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:46:30.827465 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74b21406-594b-4885-a45c-6e683b685136-plugin-serving-cert podName:74b21406-594b-4885-a45c-6e683b685136 nodeName:}" failed. No retries permitted until 2026-08-05 16:46:31.327443843 +0000 UTC m=+455.812101731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/74b21406-594b-4885-a45c-6e683b685136-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-hzgts" (UID: "74b21406-594b-4885-a45c-6e683b685136") : secret "plugin-serving-cert" not found Aug 05 16:46:30.827747 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.827728 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/74b21406-594b-4885-a45c-6e683b685136-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-hzgts\" (UID: \"74b21406-594b-4885-a45c-6e683b685136\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" Aug 05 16:46:30.836706 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:30.836687 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56p5g\" (UniqueName: \"kubernetes.io/projected/74b21406-594b-4885-a45c-6e683b685136-kube-api-access-56p5g\") pod \"kuadrant-console-plugin-598f86468b-hzgts\" (UID: \"74b21406-594b-4885-a45c-6e683b685136\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" Aug 05 16:46:31.330514 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:31.330481 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b21406-594b-4885-a45c-6e683b685136-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-hzgts\" (UID: \"74b21406-594b-4885-a45c-6e683b685136\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" Aug 05 16:46:31.332858 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:31.332837 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b21406-594b-4885-a45c-6e683b685136-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-hzgts\" (UID: \"74b21406-594b-4885-a45c-6e683b685136\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" Aug 05 16:46:31.491463 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:31.491433 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" Aug 05 16:46:31.630184 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:31.630160 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts"] Aug 05 16:46:31.632858 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:46:31.632824 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74b21406_594b_4885_a45c_6e683b685136.slice/crio-ee3511156b822305522c0df0a07bf8fc152fba2cedfec0d8708758d876a6e8f2 WatchSource:0}: Error finding container ee3511156b822305522c0df0a07bf8fc152fba2cedfec0d8708758d876a6e8f2: Status 404 returned error can't find the container with id ee3511156b822305522c0df0a07bf8fc152fba2cedfec0d8708758d876a6e8f2 Aug 05 16:46:32.041333 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:32.041253 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" event={"ID":"74b21406-594b-4885-a45c-6e683b685136","Type":"ContainerStarted","Data":"ee3511156b822305522c0df0a07bf8fc152fba2cedfec0d8708758d876a6e8f2"} Aug 05 16:46:37.992011 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:37.991971 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:37.992470 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:37.992058 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:37.997203 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:37.997176 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:38.072961 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:38.072937 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9f869d5c5-vjtxc" Aug 05 16:46:38.145559 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:38.145527 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b566f85b5-z5l52"] Aug 05 16:46:41.870268 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:41.870236 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh"] Aug 05 16:46:41.877091 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:41.877061 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:41.880173 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:41.880148 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-69w5h\"" Aug 05 16:46:41.909126 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:41.909088 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh"] Aug 05 16:46:41.919603 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:41.919386 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9d168cd-6e80-4616-8cd6-8538a39208f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-28vqh\" (UID: \"c9d168cd-6e80-4616-8cd6-8538a39208f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:41.919603 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:41.919449 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trfgj\" (UniqueName: \"kubernetes.io/projected/c9d168cd-6e80-4616-8cd6-8538a39208f9-kube-api-access-trfgj\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-28vqh\" (UID: \"c9d168cd-6e80-4616-8cd6-8538a39208f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:41.995857 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:41.995813 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh"] Aug 05 16:46:41.996194 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:46:41.996163 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-trfgj], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" podUID="c9d168cd-6e80-4616-8cd6-8538a39208f9" Aug 05 16:46:42.014124 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.014091 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh"] Aug 05 16:46:42.020995 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.020113 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9d168cd-6e80-4616-8cd6-8538a39208f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-28vqh\" (UID: \"c9d168cd-6e80-4616-8cd6-8538a39208f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:42.020995 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.020176 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trfgj\" (UniqueName: \"kubernetes.io/projected/c9d168cd-6e80-4616-8cd6-8538a39208f9-kube-api-access-trfgj\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-28vqh\" (UID: \"c9d168cd-6e80-4616-8cd6-8538a39208f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:42.020995 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.020950 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9d168cd-6e80-4616-8cd6-8538a39208f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-28vqh\" (UID: \"c9d168cd-6e80-4616-8cd6-8538a39208f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:42.023991 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:46:42.023919 2583 projected.go:196] Error preparing data for projected volume kube-api-access-trfgj for pod kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-132-4.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-132-4.ec2.internal' and this object Aug 05 16:46:42.024143 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:46:42.024006 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9d168cd-6e80-4616-8cd6-8538a39208f9-kube-api-access-trfgj podName:c9d168cd-6e80-4616-8cd6-8538a39208f9 nodeName:}" failed. No retries permitted until 2026-08-05 16:46:42.523977768 +0000 UTC m=+467.008635688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-trfgj" (UniqueName: "kubernetes.io/projected/c9d168cd-6e80-4616-8cd6-8538a39208f9-kube-api-access-trfgj") pod "kuadrant-operator-controller-manager-5b65f94d4c-28vqh" (UID: "c9d168cd-6e80-4616-8cd6-8538a39208f9") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-132-4.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-132-4.ec2.internal' and this object Aug 05 16:46:42.090065 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.090036 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:42.094757 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.094726 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g"] Aug 05 16:46:42.098718 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.098695 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:42.098868 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.098851 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g" Aug 05 16:46:42.101785 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:46:42.101737 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5b65f94d4c-28vqh\" is forbidden: User \"system:node:ip-10-0-132-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-4.ec2.internal' and this object" podUID="c9d168cd-6e80-4616-8cd6-8538a39208f9" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:42.102106 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.102085 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fmfgq\"" Aug 05 16:46:42.104610 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:46:42.104373 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5b65f94d4c-28vqh\" is forbidden: User \"system:node:ip-10-0-132-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-4.ec2.internal' and this object" podUID="c9d168cd-6e80-4616-8cd6-8538a39208f9" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:42.119331 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.119303 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g"] Aug 05 16:46:42.120642 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.120576 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9d168cd-6e80-4616-8cd6-8538a39208f9-extensions-socket-volume\") pod \"c9d168cd-6e80-4616-8cd6-8538a39208f9\" (UID: \"c9d168cd-6e80-4616-8cd6-8538a39208f9\") " Aug 05 16:46:42.120760 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.120722 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmbt6\" (UniqueName: \"kubernetes.io/projected/d5507cb3-4357-4ec3-a57a-34760a0cd5bb-kube-api-access-mmbt6\") pod \"limitador-operator-controller-manager-6c549b6d85-f2n9g\" (UID: \"d5507cb3-4357-4ec3-a57a-34760a0cd5bb\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g" Aug 05 16:46:42.120814 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.120775 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trfgj\" (UniqueName: \"kubernetes.io/projected/c9d168cd-6e80-4616-8cd6-8538a39208f9-kube-api-access-trfgj\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:46:42.120892 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.120865 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d168cd-6e80-4616-8cd6-8538a39208f9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c9d168cd-6e80-4616-8cd6-8538a39208f9" (UID: "c9d168cd-6e80-4616-8cd6-8538a39208f9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 16:46:42.222023 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.221986 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmbt6\" (UniqueName: \"kubernetes.io/projected/d5507cb3-4357-4ec3-a57a-34760a0cd5bb-kube-api-access-mmbt6\") pod \"limitador-operator-controller-manager-6c549b6d85-f2n9g\" (UID: \"d5507cb3-4357-4ec3-a57a-34760a0cd5bb\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g" Aug 05 16:46:42.222168 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.222078 2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c9d168cd-6e80-4616-8cd6-8538a39208f9-extensions-socket-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:46:42.236835 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.236805 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmbt6\" (UniqueName: \"kubernetes.io/projected/d5507cb3-4357-4ec3-a57a-34760a0cd5bb-kube-api-access-mmbt6\") pod \"limitador-operator-controller-manager-6c549b6d85-f2n9g\" (UID: \"d5507cb3-4357-4ec3-a57a-34760a0cd5bb\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g" Aug 05 16:46:42.409931 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.409838 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g" Aug 05 16:46:42.550864 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:42.550841 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g"] Aug 05 16:46:42.552622 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:46:42.552589 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5507cb3_4357_4ec3_a57a_34760a0cd5bb.slice/crio-31731ad3c428bb4bf0480e7e6702d9940ef3be3c094c888e6f2530db001a83b4 WatchSource:0}: Error finding container 31731ad3c428bb4bf0480e7e6702d9940ef3be3c094c888e6f2530db001a83b4: Status 404 returned error can't find the container with id 31731ad3c428bb4bf0480e7e6702d9940ef3be3c094c888e6f2530db001a83b4 Aug 05 16:46:43.095511 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:43.095468 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g" event={"ID":"d5507cb3-4357-4ec3-a57a-34760a0cd5bb","Type":"ContainerStarted","Data":"31731ad3c428bb4bf0480e7e6702d9940ef3be3c094c888e6f2530db001a83b4"} Aug 05 16:46:43.096866 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:43.096847 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:43.096938 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:43.096871 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" event={"ID":"74b21406-594b-4885-a45c-6e683b685136","Type":"ContainerStarted","Data":"4f0a46343092a7a64e8946e28e08c567c1c5e7b10efed8da652823bdcab7dbeb"} Aug 05 16:46:43.120679 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:43.120626 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hzgts" podStartSLOduration=2.500999894 podStartE2EDuration="13.120609142s" totalImagesPullingTime="10.619609248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:46:43.119816908 +0000 UTC m=+467.604474816" watchObservedRunningTime="2026-08-05 16:46:43.120609142 +0000 UTC m=+467.605267049" Aug 05 16:46:43.121841 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:46:43.121810 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5b65f94d4c-28vqh\" is forbidden: User \"system:node:ip-10-0-132-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-4.ec2.internal' and this object" podUID="c9d168cd-6e80-4616-8cd6-8538a39208f9" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:43.123898 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:46:43.123875 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5b65f94d4c-28vqh\" is forbidden: User \"system:node:ip-10-0-132-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-4.ec2.internal' and this object" podUID="c9d168cd-6e80-4616-8cd6-8538a39208f9" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-28vqh" Aug 05 16:46:44.023641 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:44.023603 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9d168cd-6e80-4616-8cd6-8538a39208f9" path="/var/lib/kubelet/pods/c9d168cd-6e80-4616-8cd6-8538a39208f9/volumes" Aug 05 16:46:46.114131 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:46.114096 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g" event={"ID":"d5507cb3-4357-4ec3-a57a-34760a0cd5bb","Type":"ContainerStarted","Data":"0a92b7d03f84756a05c419e0e89efe4b19cdfba96e24b176a28ebe51506d822c"} Aug 05 16:46:46.114582 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:46.114294 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g" Aug 05 16:46:46.139775 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:46.139723 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g" podStartSLOduration=1.333406251 podStartE2EDuration="4.139706509s" totalImagesPullingTime="2.806300258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:46:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:46:46.138538801 +0000 UTC m=+470.623196707" watchObservedRunningTime="2026-08-05 16:46:46.139706509 +0000 UTC m=+470.624364412" Aug 05 16:46:57.121129 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:46:57.121101 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f2n9g" Aug 05 16:47:03.169059 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.168986 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b566f85b5-z5l52" podUID="fbbd95e7-5707-4b4a-acea-a332161fb59c" containerName="console" containerID="cri-o://890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d" gracePeriod=15 Aug 05 16:47:03.421874 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.421816 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:47:03.518810 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.518774 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-config\") pod \"fbbd95e7-5707-4b4a-acea-a332161fb59c\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " Aug 05 16:47:03.518985 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.518820 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-oauth-config\") pod \"fbbd95e7-5707-4b4a-acea-a332161fb59c\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " Aug 05 16:47:03.519058 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.519013 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmm5n\" (UniqueName: \"kubernetes.io/projected/fbbd95e7-5707-4b4a-acea-a332161fb59c-kube-api-access-lmm5n\") pod \"fbbd95e7-5707-4b4a-acea-a332161fb59c\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " Aug 05 16:47:03.519116 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.519088 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-config" (OuterVolumeSpecName: "console-config") pod "fbbd95e7-5707-4b4a-acea-a332161fb59c" (UID: "fbbd95e7-5707-4b4a-acea-a332161fb59c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 16:47:03.519169 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.519130 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-service-ca\") pod \"fbbd95e7-5707-4b4a-acea-a332161fb59c\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " Aug 05 16:47:03.519248 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.519177 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-trusted-ca-bundle\") pod \"fbbd95e7-5707-4b4a-acea-a332161fb59c\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " Aug 05 16:47:03.519248 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.519241 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-serving-cert\") pod \"fbbd95e7-5707-4b4a-acea-a332161fb59c\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " Aug 05 16:47:03.519351 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.519268 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-oauth-serving-cert\") pod \"fbbd95e7-5707-4b4a-acea-a332161fb59c\" (UID: \"fbbd95e7-5707-4b4a-acea-a332161fb59c\") " Aug 05 16:47:03.519536 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.519519 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:47:03.519613 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.519593 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-service-ca" (OuterVolumeSpecName: "service-ca") pod "fbbd95e7-5707-4b4a-acea-a332161fb59c" (UID: "fbbd95e7-5707-4b4a-acea-a332161fb59c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 16:47:03.519651 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.519601 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fbbd95e7-5707-4b4a-acea-a332161fb59c" (UID: "fbbd95e7-5707-4b4a-acea-a332161fb59c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 16:47:03.519713 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.519682 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fbbd95e7-5707-4b4a-acea-a332161fb59c" (UID: "fbbd95e7-5707-4b4a-acea-a332161fb59c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 16:47:03.521030 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.521007 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fbbd95e7-5707-4b4a-acea-a332161fb59c" (UID: "fbbd95e7-5707-4b4a-acea-a332161fb59c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 16:47:03.521301 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.521272 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fbbd95e7-5707-4b4a-acea-a332161fb59c" (UID: "fbbd95e7-5707-4b4a-acea-a332161fb59c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 16:47:03.521526 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.521508 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbbd95e7-5707-4b4a-acea-a332161fb59c-kube-api-access-lmm5n" (OuterVolumeSpecName: "kube-api-access-lmm5n") pod "fbbd95e7-5707-4b4a-acea-a332161fb59c" (UID: "fbbd95e7-5707-4b4a-acea-a332161fb59c"). InnerVolumeSpecName "kube-api-access-lmm5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 16:47:03.620827 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.620793 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:47:03.620827 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.620820 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-trusted-ca-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:47:03.620827 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.620829 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:47:03.621061 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.620840 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbbd95e7-5707-4b4a-acea-a332161fb59c-oauth-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:47:03.621061 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.620849 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbbd95e7-5707-4b4a-acea-a332161fb59c-console-oauth-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:47:03.621061 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:03.620857 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmm5n\" (UniqueName: \"kubernetes.io/projected/fbbd95e7-5707-4b4a-acea-a332161fb59c-kube-api-access-lmm5n\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:47:04.202549 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:04.202516 2583 generic.go:356] "Generic (PLEG): container finished" podID="fbbd95e7-5707-4b4a-acea-a332161fb59c" containerID="890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d" exitCode=0 Aug 05 16:47:04.203020 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:04.202569 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b566f85b5-z5l52" Aug 05 16:47:04.203020 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:04.202568 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b566f85b5-z5l52" event={"ID":"fbbd95e7-5707-4b4a-acea-a332161fb59c","Type":"ContainerDied","Data":"890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d"} Aug 05 16:47:04.203020 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:04.202690 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b566f85b5-z5l52" event={"ID":"fbbd95e7-5707-4b4a-acea-a332161fb59c","Type":"ContainerDied","Data":"1323b929800a9da3e9bb8bc6b806f7347d8c996df70c1773e84d7ee2a753a5f3"} Aug 05 16:47:04.203020 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:04.202720 2583 scope.go:117] "RemoveContainer" containerID="890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d" Aug 05 16:47:04.211692 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:04.211650 2583 scope.go:117] "RemoveContainer" containerID="890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d" Aug 05 16:47:04.212032 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:47:04.212002 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d\": container with ID starting with 890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d not found: ID does not exist" containerID="890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d" Aug 05 16:47:04.212124 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:04.212037 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d"} err="failed to get container status \"890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d\": rpc error: code = NotFound desc = could not find container \"890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d\": container with ID starting with 890a4118178ff933cf4bcf2651bc4bac777c1287b5fd17e3f7e66c4d4da8de1d not found: ID does not exist" Aug 05 16:47:04.221750 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:04.221727 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b566f85b5-z5l52"] Aug 05 16:47:04.227776 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:04.227754 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b566f85b5-z5l52"] Aug 05 16:47:06.020074 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:06.020039 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbbd95e7-5707-4b4a-acea-a332161fb59c" path="/var/lib/kubelet/pods/fbbd95e7-5707-4b4a-acea-a332161fb59c/volumes" Aug 05 16:47:13.081354 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:13.081320 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-w86vx"] Aug 05 16:47:13.081726 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:13.081679 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbbd95e7-5707-4b4a-acea-a332161fb59c" containerName="console" Aug 05 16:47:13.081726 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:13.081691 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbbd95e7-5707-4b4a-acea-a332161fb59c" containerName="console" Aug 05 16:47:13.081795 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:13.081766 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbbd95e7-5707-4b4a-acea-a332161fb59c" containerName="console" Aug 05 16:47:13.099707 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:13.099676 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-w86vx"] Aug 05 16:47:13.099876 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:13.099775 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-w86vx" Aug 05 16:47:13.103315 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:13.103287 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-d2pgd\"" Aug 05 16:47:13.209566 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:13.209533 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jt98\" (UniqueName: \"kubernetes.io/projected/3c76ccf4-9088-49ff-95b2-e83bd1455e6a-kube-api-access-4jt98\") pod \"authorino-c548b5d7d-w86vx\" (UID: \"3c76ccf4-9088-49ff-95b2-e83bd1455e6a\") " pod="kuadrant-system/authorino-c548b5d7d-w86vx" Aug 05 16:47:13.310424 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:13.310387 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jt98\" (UniqueName: \"kubernetes.io/projected/3c76ccf4-9088-49ff-95b2-e83bd1455e6a-kube-api-access-4jt98\") pod \"authorino-c548b5d7d-w86vx\" (UID: \"3c76ccf4-9088-49ff-95b2-e83bd1455e6a\") " pod="kuadrant-system/authorino-c548b5d7d-w86vx" Aug 05 16:47:13.320946 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:13.320915 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jt98\" (UniqueName: \"kubernetes.io/projected/3c76ccf4-9088-49ff-95b2-e83bd1455e6a-kube-api-access-4jt98\") pod \"authorino-c548b5d7d-w86vx\" (UID: \"3c76ccf4-9088-49ff-95b2-e83bd1455e6a\") " pod="kuadrant-system/authorino-c548b5d7d-w86vx" Aug 05 16:47:13.408773 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:13.408737 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-w86vx" Aug 05 16:47:13.540039 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:13.540013 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-w86vx"] Aug 05 16:47:13.542968 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:47:13.542940 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c76ccf4_9088_49ff_95b2_e83bd1455e6a.slice/crio-28af1287e0a6fea7f2b5471fed26f58640d07e75bf6b2d0e1751ac0c66a2ed0d WatchSource:0}: Error finding container 28af1287e0a6fea7f2b5471fed26f58640d07e75bf6b2d0e1751ac0c66a2ed0d: Status 404 returned error can't find the container with id 28af1287e0a6fea7f2b5471fed26f58640d07e75bf6b2d0e1751ac0c66a2ed0d Aug 05 16:47:14.257030 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:14.256996 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-w86vx" event={"ID":"3c76ccf4-9088-49ff-95b2-e83bd1455e6a","Type":"ContainerStarted","Data":"28af1287e0a6fea7f2b5471fed26f58640d07e75bf6b2d0e1751ac0c66a2ed0d"} Aug 05 16:47:18.278448 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:18.278410 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-w86vx" event={"ID":"3c76ccf4-9088-49ff-95b2-e83bd1455e6a","Type":"ContainerStarted","Data":"dacc0bcc53c12880a6c954eddecb150c8147a3efc6f646b954fcc84d00805d36"} Aug 05 16:47:18.297777 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:18.297730 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-w86vx" podStartSLOduration=1.4696968830000001 podStartE2EDuration="5.297714636s" totalImagesPullingTime="3.828017753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:47:18.296077475 +0000 UTC m=+502.780735391" watchObservedRunningTime="2026-08-05 16:47:18.297714636 +0000 UTC m=+502.782372538" Aug 05 16:47:49.227472 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:49.227390 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-w86vx"] Aug 05 16:47:49.227974 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:49.227588 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-w86vx" podUID="3c76ccf4-9088-49ff-95b2-e83bd1455e6a" containerName="authorino" containerID="cri-o://dacc0bcc53c12880a6c954eddecb150c8147a3efc6f646b954fcc84d00805d36" gracePeriod=30 Aug 05 16:47:49.427709 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:49.427676 2583 generic.go:356] "Generic (PLEG): container finished" podID="3c76ccf4-9088-49ff-95b2-e83bd1455e6a" containerID="dacc0bcc53c12880a6c954eddecb150c8147a3efc6f646b954fcc84d00805d36" exitCode=0 Aug 05 16:47:49.427833 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:49.427744 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-w86vx" event={"ID":"3c76ccf4-9088-49ff-95b2-e83bd1455e6a","Type":"ContainerDied","Data":"dacc0bcc53c12880a6c954eddecb150c8147a3efc6f646b954fcc84d00805d36"} Aug 05 16:47:49.485621 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:49.485560 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-w86vx" Aug 05 16:47:49.617088 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:49.617050 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jt98\" (UniqueName: \"kubernetes.io/projected/3c76ccf4-9088-49ff-95b2-e83bd1455e6a-kube-api-access-4jt98\") pod \"3c76ccf4-9088-49ff-95b2-e83bd1455e6a\" (UID: \"3c76ccf4-9088-49ff-95b2-e83bd1455e6a\") " Aug 05 16:47:49.619926 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:49.619865 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c76ccf4-9088-49ff-95b2-e83bd1455e6a-kube-api-access-4jt98" (OuterVolumeSpecName: "kube-api-access-4jt98") pod "3c76ccf4-9088-49ff-95b2-e83bd1455e6a" (UID: "3c76ccf4-9088-49ff-95b2-e83bd1455e6a"). InnerVolumeSpecName "kube-api-access-4jt98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 16:47:49.718207 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:49.718178 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jt98\" (UniqueName: \"kubernetes.io/projected/3c76ccf4-9088-49ff-95b2-e83bd1455e6a-kube-api-access-4jt98\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 16:47:50.434614 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:50.434576 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-w86vx" event={"ID":"3c76ccf4-9088-49ff-95b2-e83bd1455e6a","Type":"ContainerDied","Data":"28af1287e0a6fea7f2b5471fed26f58640d07e75bf6b2d0e1751ac0c66a2ed0d"} Aug 05 16:47:50.434614 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:50.434612 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-w86vx" Aug 05 16:47:50.434614 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:50.434624 2583 scope.go:117] "RemoveContainer" containerID="dacc0bcc53c12880a6c954eddecb150c8147a3efc6f646b954fcc84d00805d36" Aug 05 16:47:50.452060 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:50.452036 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-w86vx"] Aug 05 16:47:50.456558 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:50.456535 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-w86vx"] Aug 05 16:47:52.020129 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:47:52.020096 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c76ccf4-9088-49ff-95b2-e83bd1455e6a" path="/var/lib/kubelet/pods/3c76ccf4-9088-49ff-95b2-e83bd1455e6a/volumes" Aug 05 16:48:30.485660 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.485620 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55"] Aug 05 16:48:30.486282 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.486173 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c76ccf4-9088-49ff-95b2-e83bd1455e6a" containerName="authorino" Aug 05 16:48:30.486282 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.486195 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c76ccf4-9088-49ff-95b2-e83bd1455e6a" containerName="authorino" Aug 05 16:48:30.486412 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.486307 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c76ccf4-9088-49ff-95b2-e83bd1455e6a" containerName="authorino" Aug 05 16:48:30.489540 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.489520 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:30.492161 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.492139 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Aug 05 16:48:30.492314 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.492178 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 05 16:48:30.492314 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.492249 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Aug 05 16:48:30.505387 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.505360 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55"] Aug 05 16:48:30.572523 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.572491 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23d9e567-b3ac-435e-b081-99a7efb7fc51-openshift-service-ca\") pod \"maas-api-5fb54d6f74-wmg55\" (UID: \"23d9e567-b3ac-435e-b081-99a7efb7fc51\") " pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:30.572755 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.572537 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23d9e567-b3ac-435e-b081-99a7efb7fc51-maas-api-tls\") pod \"maas-api-5fb54d6f74-wmg55\" (UID: \"23d9e567-b3ac-435e-b081-99a7efb7fc51\") " pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:30.572755 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.572574 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2p2x\" (UniqueName: \"kubernetes.io/projected/23d9e567-b3ac-435e-b081-99a7efb7fc51-kube-api-access-q2p2x\") pod \"maas-api-5fb54d6f74-wmg55\" (UID: \"23d9e567-b3ac-435e-b081-99a7efb7fc51\") " pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:30.673617 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.673576 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23d9e567-b3ac-435e-b081-99a7efb7fc51-maas-api-tls\") pod \"maas-api-5fb54d6f74-wmg55\" (UID: \"23d9e567-b3ac-435e-b081-99a7efb7fc51\") " pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:30.673827 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.673644 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2p2x\" (UniqueName: \"kubernetes.io/projected/23d9e567-b3ac-435e-b081-99a7efb7fc51-kube-api-access-q2p2x\") pod \"maas-api-5fb54d6f74-wmg55\" (UID: \"23d9e567-b3ac-435e-b081-99a7efb7fc51\") " pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:30.673827 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:48:30.673690 2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Aug 05 16:48:30.673827 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.673712 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23d9e567-b3ac-435e-b081-99a7efb7fc51-openshift-service-ca\") pod \"maas-api-5fb54d6f74-wmg55\" (UID: \"23d9e567-b3ac-435e-b081-99a7efb7fc51\") " pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:30.673827 ip-10-0-132-4 kubenswrapper[2583]: E0805 16:48:30.673759 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d9e567-b3ac-435e-b081-99a7efb7fc51-maas-api-tls podName:23d9e567-b3ac-435e-b081-99a7efb7fc51 nodeName:}" failed. No retries permitted until 2026-08-05 16:48:31.17373644 +0000 UTC m=+575.658394340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/23d9e567-b3ac-435e-b081-99a7efb7fc51-maas-api-tls") pod "maas-api-5fb54d6f74-wmg55" (UID: "23d9e567-b3ac-435e-b081-99a7efb7fc51") : secret "maas-api-serving-cert" not found Aug 05 16:48:30.674392 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.674374 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23d9e567-b3ac-435e-b081-99a7efb7fc51-openshift-service-ca\") pod \"maas-api-5fb54d6f74-wmg55\" (UID: \"23d9e567-b3ac-435e-b081-99a7efb7fc51\") " pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:30.684877 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:30.684850 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2p2x\" (UniqueName: \"kubernetes.io/projected/23d9e567-b3ac-435e-b081-99a7efb7fc51-kube-api-access-q2p2x\") pod \"maas-api-5fb54d6f74-wmg55\" (UID: \"23d9e567-b3ac-435e-b081-99a7efb7fc51\") " pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:31.178837 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:31.178802 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23d9e567-b3ac-435e-b081-99a7efb7fc51-maas-api-tls\") pod \"maas-api-5fb54d6f74-wmg55\" (UID: \"23d9e567-b3ac-435e-b081-99a7efb7fc51\") " pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:31.181150 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:31.181125 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23d9e567-b3ac-435e-b081-99a7efb7fc51-maas-api-tls\") pod \"maas-api-5fb54d6f74-wmg55\" (UID: \"23d9e567-b3ac-435e-b081-99a7efb7fc51\") " pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:31.399879 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:31.399845 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:31.535655 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:31.535627 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55"] Aug 05 16:48:31.537909 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:48:31.537882 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d9e567_b3ac_435e_b081_99a7efb7fc51.slice/crio-b7ad2426a9f8654fcb260698f849d574e0e9cb75f1171e9c2403aaa3ab1d36ba WatchSource:0}: Error finding container b7ad2426a9f8654fcb260698f849d574e0e9cb75f1171e9c2403aaa3ab1d36ba: Status 404 returned error can't find the container with id b7ad2426a9f8654fcb260698f849d574e0e9cb75f1171e9c2403aaa3ab1d36ba Aug 05 16:48:31.625954 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:31.625922 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" event={"ID":"23d9e567-b3ac-435e-b081-99a7efb7fc51","Type":"ContainerStarted","Data":"b7ad2426a9f8654fcb260698f849d574e0e9cb75f1171e9c2403aaa3ab1d36ba"} Aug 05 16:48:34.644522 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:34.644487 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" event={"ID":"23d9e567-b3ac-435e-b081-99a7efb7fc51","Type":"ContainerStarted","Data":"1945253a54545b7ee03bdc866c8167513c768f619030a5e90539acf044ad014c"} Aug 05 16:48:34.644911 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:34.644547 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:34.665771 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:34.665723 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" podStartSLOduration=2.42170783 podStartE2EDuration="4.665709515s" totalImagesPullingTime="2.244001685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:48:34.663169447 +0000 UTC m=+579.147827352" watchObservedRunningTime="2026-08-05 16:48:34.665709515 +0000 UTC m=+579.150367417" Aug 05 16:48:40.654778 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:40.654747 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5fb54d6f74-wmg55" Aug 05 16:48:50.995644 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:50.995613 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-68kws"] Aug 05 16:48:50.999139 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:50.999119 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.003777 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.003731 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Aug 05 16:48:51.003907 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.003787 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5pwrv\"" Aug 05 16:48:51.003907 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.003807 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Aug 05 16:48:51.004096 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.004083 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Aug 05 16:48:51.012300 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.012278 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-68kws"] Aug 05 16:48:51.160514 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.160482 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/042a7159-e6b4-43f4-90af-565ca86e920b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.160672 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.160525 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/042a7159-e6b4-43f4-90af-565ca86e920b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.160672 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.160603 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/042a7159-e6b4-43f4-90af-565ca86e920b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.160672 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.160635 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/042a7159-e6b4-43f4-90af-565ca86e920b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.160775 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.160684 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkcv7\" (UniqueName: \"kubernetes.io/projected/042a7159-e6b4-43f4-90af-565ca86e920b-kube-api-access-wkcv7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.160775 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.160733 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/042a7159-e6b4-43f4-90af-565ca86e920b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.261205 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.261115 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/042a7159-e6b4-43f4-90af-565ca86e920b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.261205 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.261150 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/042a7159-e6b4-43f4-90af-565ca86e920b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.261205 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.261177 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/042a7159-e6b4-43f4-90af-565ca86e920b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.261516 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.261295 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/042a7159-e6b4-43f4-90af-565ca86e920b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.261516 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.261351 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkcv7\" (UniqueName: \"kubernetes.io/projected/042a7159-e6b4-43f4-90af-565ca86e920b-kube-api-access-wkcv7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.261516 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.261491 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/042a7159-e6b4-43f4-90af-565ca86e920b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.261676 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.261563 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/042a7159-e6b4-43f4-90af-565ca86e920b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.261739 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.261674 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/042a7159-e6b4-43f4-90af-565ca86e920b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.261803 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.261784 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/042a7159-e6b4-43f4-90af-565ca86e920b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.263543 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.263516 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/042a7159-e6b4-43f4-90af-565ca86e920b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.263777 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.263761 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/042a7159-e6b4-43f4-90af-565ca86e920b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.270946 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.270922 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkcv7\" (UniqueName: \"kubernetes.io/projected/042a7159-e6b4-43f4-90af-565ca86e920b-kube-api-access-wkcv7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-68kws\" (UID: \"042a7159-e6b4-43f4-90af-565ca86e920b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.310136 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.310104 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:48:51.445487 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.445463 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-68kws"] Aug 05 16:48:51.447630 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:48:51.447599 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042a7159_e6b4_43f4_90af_565ca86e920b.slice/crio-38fa725b45badc58ddeb4dfdf5ec06fdf5b79e0fd7a059cd4ea2a2b34e224a4a WatchSource:0}: Error finding container 38fa725b45badc58ddeb4dfdf5ec06fdf5b79e0fd7a059cd4ea2a2b34e224a4a: Status 404 returned error can't find the container with id 38fa725b45badc58ddeb4dfdf5ec06fdf5b79e0fd7a059cd4ea2a2b34e224a4a Aug 05 16:48:51.728079 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:51.728049 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" event={"ID":"042a7159-e6b4-43f4-90af-565ca86e920b","Type":"ContainerStarted","Data":"38fa725b45badc58ddeb4dfdf5ec06fdf5b79e0fd7a059cd4ea2a2b34e224a4a"} Aug 05 16:48:53.743130 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:53.743095 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" event={"ID":"042a7159-e6b4-43f4-90af-565ca86e920b","Type":"ContainerStarted","Data":"a977a898f713c121f2d5c93079ae102b71f49ebc84d01f15767c3dbcfde62b8e"} Aug 05 16:48:53.770803 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:53.770750 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" podStartSLOduration=2.341119527 podStartE2EDuration="3.770735765s" totalImagesPullingTime="1.429616238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:48:53.76910766 +0000 UTC m=+598.253765562" watchObservedRunningTime="2026-08-05 16:48:53.770735765 +0000 UTC m=+598.255393700" Aug 05 16:48:55.938108 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:55.938081 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 16:48:55.938532 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:48:55.938361 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 16:49:01.311100 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:01.311062 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:49:01.313595 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:01.311415 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:49:01.323946 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:01.323927 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:49:01.792550 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:01.792523 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-68kws" Aug 05 16:49:42.102191 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.102162 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8"] Aug 05 16:49:42.107492 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.107469 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.110199 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.110174 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Aug 05 16:49:42.116245 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.116209 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8"] Aug 05 16:49:42.206775 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.206736 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a67c933-5723-4390-a0fb-09955b24103e-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.206922 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.206786 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a67c933-5723-4390-a0fb-09955b24103e-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.206922 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.206810 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a67c933-5723-4390-a0fb-09955b24103e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.206922 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.206852 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrd8j\" (UniqueName: \"kubernetes.io/projected/5a67c933-5723-4390-a0fb-09955b24103e-kube-api-access-vrd8j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.206922 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.206903 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a67c933-5723-4390-a0fb-09955b24103e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.207066 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.206934 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a67c933-5723-4390-a0fb-09955b24103e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.308023 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.307985 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a67c933-5723-4390-a0fb-09955b24103e-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.308023 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.308024 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a67c933-5723-4390-a0fb-09955b24103e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.308241 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.308044 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrd8j\" (UniqueName: \"kubernetes.io/projected/5a67c933-5723-4390-a0fb-09955b24103e-kube-api-access-vrd8j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.308241 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.308084 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a67c933-5723-4390-a0fb-09955b24103e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.308241 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.308125 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a67c933-5723-4390-a0fb-09955b24103e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.308241 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.308209 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a67c933-5723-4390-a0fb-09955b24103e-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.308428 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.308398 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a67c933-5723-4390-a0fb-09955b24103e-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.308502 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.308482 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a67c933-5723-4390-a0fb-09955b24103e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.308543 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.308518 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a67c933-5723-4390-a0fb-09955b24103e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.310390 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.310366 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a67c933-5723-4390-a0fb-09955b24103e-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.310646 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.310628 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a67c933-5723-4390-a0fb-09955b24103e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.316681 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.316660 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrd8j\" (UniqueName: \"kubernetes.io/projected/5a67c933-5723-4390-a0fb-09955b24103e-kube-api-access-vrd8j\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8\" (UID: \"5a67c933-5723-4390-a0fb-09955b24103e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.416887 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.416826 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:42.553754 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.553730 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8"] Aug 05 16:49:42.555615 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:49:42.555588 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a67c933_5723_4390_a0fb_09955b24103e.slice/crio-e8e3702fc6d927de29eb5e9a69994dce27f9c0ce3834fa5ce52b5b6f9e9cc03f WatchSource:0}: Error finding container e8e3702fc6d927de29eb5e9a69994dce27f9c0ce3834fa5ce52b5b6f9e9cc03f: Status 404 returned error can't find the container with id e8e3702fc6d927de29eb5e9a69994dce27f9c0ce3834fa5ce52b5b6f9e9cc03f Aug 05 16:49:42.556988 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.556968 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 16:49:42.976170 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.976137 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" event={"ID":"5a67c933-5723-4390-a0fb-09955b24103e","Type":"ContainerStarted","Data":"7a238741cb27187fcee9f9ce3005c356385c06a0d716cd33e5bd63544fbb19be"} Aug 05 16:49:42.976170 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.976177 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" event={"ID":"5a67c933-5723-4390-a0fb-09955b24103e","Type":"ContainerStarted","Data":"e8e3702fc6d927de29eb5e9a69994dce27f9c0ce3834fa5ce52b5b6f9e9cc03f"} Aug 05 16:49:42.999124 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:42.999080 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" podStartSLOduration=0.788950905 podStartE2EDuration="999.064243ms" totalImagesPullingTime="210.113338ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:49:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:49:42.996037757 +0000 UTC m=+647.480695659" watchObservedRunningTime="2026-08-05 16:49:42.999064243 +0000 UTC m=+647.483722145" Aug 05 16:49:52.417563 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:52.417523 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:52.417928 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:52.417585 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:52.429795 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:52.429772 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:49:53.035521 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:49:53.035494 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8" Aug 05 16:50:19.354740 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.354701 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79b885fbd5-4cglt"] Aug 05 16:50:19.358435 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.358414 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79b885fbd5-4cglt" Aug 05 16:50:19.362450 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.362424 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Aug 05 16:50:19.362580 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.362465 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-d2pgd\"" Aug 05 16:50:19.366921 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.366900 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79b885fbd5-4cglt"] Aug 05 16:50:19.446127 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.446096 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j652h\" (UniqueName: \"kubernetes.io/projected/e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c-kube-api-access-j652h\") pod \"authorino-79b885fbd5-4cglt\" (UID: \"e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c\") " pod="kuadrant-system/authorino-79b885fbd5-4cglt" Aug 05 16:50:19.446127 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.446133 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c-tls-cert\") pod \"authorino-79b885fbd5-4cglt\" (UID: \"e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c\") " pod="kuadrant-system/authorino-79b885fbd5-4cglt" Aug 05 16:50:19.546977 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.546938 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j652h\" (UniqueName: \"kubernetes.io/projected/e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c-kube-api-access-j652h\") pod \"authorino-79b885fbd5-4cglt\" (UID: \"e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c\") " pod="kuadrant-system/authorino-79b885fbd5-4cglt" Aug 05 16:50:19.546977 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.546989 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c-tls-cert\") pod \"authorino-79b885fbd5-4cglt\" (UID: \"e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c\") " pod="kuadrant-system/authorino-79b885fbd5-4cglt" Aug 05 16:50:19.549537 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.549508 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c-tls-cert\") pod \"authorino-79b885fbd5-4cglt\" (UID: \"e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c\") " pod="kuadrant-system/authorino-79b885fbd5-4cglt" Aug 05 16:50:19.555968 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.555949 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j652h\" (UniqueName: \"kubernetes.io/projected/e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c-kube-api-access-j652h\") pod \"authorino-79b885fbd5-4cglt\" (UID: \"e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c\") " pod="kuadrant-system/authorino-79b885fbd5-4cglt" Aug 05 16:50:19.668937 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.668858 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79b885fbd5-4cglt" Aug 05 16:50:19.803313 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:19.803286 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79b885fbd5-4cglt"] Aug 05 16:50:19.804852 ip-10-0-132-4 kubenswrapper[2583]: W0805 16:50:19.804822 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0d3cafa_fb1a_4c35_b822_1a89d4d53d4c.slice/crio-b23cd4720a2964c43d4d3af492d2f854c3c78e791e33d81adc181ee4e837c9b9 WatchSource:0}: Error finding container b23cd4720a2964c43d4d3af492d2f854c3c78e791e33d81adc181ee4e837c9b9: Status 404 returned error can't find the container with id b23cd4720a2964c43d4d3af492d2f854c3c78e791e33d81adc181ee4e837c9b9 Aug 05 16:50:20.155529 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:20.155493 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79b885fbd5-4cglt" event={"ID":"e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c","Type":"ContainerStarted","Data":"b23cd4720a2964c43d4d3af492d2f854c3c78e791e33d81adc181ee4e837c9b9"} Aug 05 16:50:21.161718 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:21.161684 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79b885fbd5-4cglt" event={"ID":"e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c","Type":"ContainerStarted","Data":"86f9f3a2f484c2e0229f458e9fffe7b4499002507ddc76d41d2eed3114b4b12e"} Aug 05 16:50:21.187024 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:50:21.186961 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79b885fbd5-4cglt" podStartSLOduration=1.6443606339999999 podStartE2EDuration="2.186943907s" totalImagesPullingTime="542.583273ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:50:21.185754951 +0000 UTC m=+685.670412856" watchObservedRunningTime="2026-08-05 16:50:21.186943907 +0000 UTC m=+685.671601809" Aug 05 16:53:55.968702 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:53:55.968667 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 16:53:55.971919 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:53:55.971895 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 16:58:56.003941 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:58:56.003908 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 16:58:56.006130 ip-10-0-132-4 kubenswrapper[2583]: I0805 16:58:56.006105 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:03:32.349298 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.349265 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2"] Aug 05 17:03:32.352497 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.352481 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.355948 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.355926 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-707ffd07-kserve-self-signed-certs\"" Aug 05 17:03:32.388117 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.388089 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-model-cache\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.388293 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.388132 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-dshm\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.388293 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.388156 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npzhz\" (UniqueName: \"kubernetes.io/projected/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-kube-api-access-npzhz\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.388409 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.388285 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-home\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.388409 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.388327 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-tls-certs\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.388409 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.388388 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-tmp-dir\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.389233 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.389202 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2"] Aug 05 17:03:32.489421 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.489390 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-home\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.489421 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.489422 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-tls-certs\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.489655 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.489451 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-tmp-dir\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.489655 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.489599 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-model-cache\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.489655 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.489648 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-dshm\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.489817 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.489685 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npzhz\" (UniqueName: \"kubernetes.io/projected/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-kube-api-access-npzhz\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.489880 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.489860 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-home\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.489926 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.489899 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-tmp-dir\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.489961 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.489935 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-model-cache\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.491770 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.491744 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-dshm\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.492040 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.492024 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-tls-certs\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.500256 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.500232 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npzhz\" (UniqueName: \"kubernetes.io/projected/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-kube-api-access-npzhz\") pod \"e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.661447 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.661365 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:32.804242 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:32.804205 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2"] Aug 05 17:03:32.806825 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:03:32.806795 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f9db3e3_a81d_4be9_8c72_fb5e2c16f7a1.slice/crio-a26e01e56204952b1fd5550d8fbf0b07ca9403e853e0adcac7df6a830bdc47b2 WatchSource:0}: Error finding container a26e01e56204952b1fd5550d8fbf0b07ca9403e853e0adcac7df6a830bdc47b2: Status 404 returned error can't find the container with id a26e01e56204952b1fd5550d8fbf0b07ca9403e853e0adcac7df6a830bdc47b2 Aug 05 17:03:33.164575 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:33.164535 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" event={"ID":"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1","Type":"ContainerStarted","Data":"92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4"} Aug 05 17:03:33.164735 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:33.164588 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" event={"ID":"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1","Type":"ContainerStarted","Data":"a26e01e56204952b1fd5550d8fbf0b07ca9403e853e0adcac7df6a830bdc47b2"} Aug 05 17:03:33.187992 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:33.187945 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" podStartSLOduration=1.187929102 podStartE2EDuration="1.187929102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:03:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:03:33.187567955 +0000 UTC m=+1477.672225855" watchObservedRunningTime="2026-08-05 17:03:33.187929102 +0000 UTC m=+1477.672587006" Aug 05 17:03:42.662465 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:42.662431 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:42.662465 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:42.662472 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:42.674869 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:42.674840 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:43.222756 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:43.222727 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:03:53.364065 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:53.364032 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2"] Aug 05 17:03:56.036491 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:56.036457 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:03:56.042064 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:03:56.042038 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:04:08.383069 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.383018 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" podUID="9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1" containerName="main" containerID="cri-o://92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4" gracePeriod=45 Aug 05 17:04:08.625392 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.625363 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:04:08.721902 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.721817 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-tls-certs\") pod \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " Aug 05 17:04:08.721902 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.721880 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-tmp-dir\") pod \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " Aug 05 17:04:08.722088 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.722005 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-dshm\") pod \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " Aug 05 17:04:08.722088 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.722042 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-model-cache\") pod \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " Aug 05 17:04:08.722088 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.722071 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npzhz\" (UniqueName: \"kubernetes.io/projected/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-kube-api-access-npzhz\") pod \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " Aug 05 17:04:08.722265 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.722096 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-home\") pod \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\" (UID: \"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1\") " Aug 05 17:04:08.722265 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.722113 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1" (UID: "9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:04:08.722396 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.722360 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-model-cache" (OuterVolumeSpecName: "model-cache") pod "9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1" (UID: "9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:04:08.722455 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.722437 2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:04:08.722498 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.722447 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-home" (OuterVolumeSpecName: "home") pod "9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1" (UID: "9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:04:08.724193 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.724167 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-dshm" (OuterVolumeSpecName: "dshm") pod "9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1" (UID: "9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:04:08.724340 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.724274 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1" (UID: "9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:04:08.724340 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.724296 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-kube-api-access-npzhz" (OuterVolumeSpecName: "kube-api-access-npzhz") pod "9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1" (UID: "9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1"). InnerVolumeSpecName "kube-api-access-npzhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:04:08.823552 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.823523 2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:04:08.823552 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.823547 2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:04:08.823552 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.823555 2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:04:08.823740 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.823565 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npzhz\" (UniqueName: \"kubernetes.io/projected/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-kube-api-access-npzhz\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:04:08.823740 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:08.823574 2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:04:09.338313 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:09.338281 2583 generic.go:356] "Generic (PLEG): container finished" podID="9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1" containerID="92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4" exitCode=0 Aug 05 17:04:09.338499 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:09.338325 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" Aug 05 17:04:09.338499 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:09.338361 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" event={"ID":"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1","Type":"ContainerDied","Data":"92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4"} Aug 05 17:04:09.338499 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:09.338402 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2" event={"ID":"9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1","Type":"ContainerDied","Data":"a26e01e56204952b1fd5550d8fbf0b07ca9403e853e0adcac7df6a830bdc47b2"} Aug 05 17:04:09.338499 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:09.338420 2583 scope.go:117] "RemoveContainer" containerID="92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4" Aug 05 17:04:09.347623 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:09.347608 2583 scope.go:117] "RemoveContainer" containerID="92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4" Aug 05 17:04:09.347877 ip-10-0-132-4 kubenswrapper[2583]: E0805 17:04:09.347861 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4\": container with ID starting with 92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4 not found: ID does not exist" containerID="92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4" Aug 05 17:04:09.347917 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:09.347886 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4"} err="failed to get container status \"92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4\": rpc error: code = NotFound desc = could not find container \"92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4\": container with ID starting with 92df1603cab7a99f50d5f4c6b4022d2bf29683b6e2e6fcd0948c1eeab1f137f4 not found: ID does not exist" Aug 05 17:04:09.369293 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:09.369264 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2"] Aug 05 17:04:09.374186 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:09.374165 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-707ffd07-kserve-6648f6f6c9-nrkj2"] Aug 05 17:04:10.020293 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:04:10.020259 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1" path="/var/lib/kubelet/pods/9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1/volumes" Aug 05 17:08:56.070821 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:08:56.070791 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:08:56.074399 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:08:56.074378 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:13:56.101940 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:13:56.101901 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:13:56.104556 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:13:56.104532 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:16:14.581750 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.581708 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv"] Aug 05 17:16:14.584029 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.582292 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1" containerName="main" Aug 05 17:16:14.584029 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.582310 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1" containerName="main" Aug 05 17:16:14.584029 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.582386 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f9db3e3-a81d-4be9-8c72-fb5e2c16f7a1" containerName="main" Aug 05 17:16:14.585134 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.585114 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.588009 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.587980 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-dcd532bc\"/\"e2e-lifecycle-model-dcd532bc-kserve-self-signed-certs\"" Aug 05 17:16:14.588128 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.588007 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-dcd532bc\"/\"openshift-service-ca.crt\"" Aug 05 17:16:14.589275 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.589254 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-dcd532bc\"/\"default-dockercfg-sngfn\"" Aug 05 17:16:14.589406 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.589292 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-dcd532bc\"/\"kube-root-ca.crt\"" Aug 05 17:16:14.599094 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.599069 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv"] Aug 05 17:16:14.718990 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.718951 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-tmp-dir\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.719188 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.719003 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74bn4\" (UniqueName: \"kubernetes.io/projected/7683d56a-95b9-45b5-9b5e-9a19755a1928-kube-api-access-74bn4\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.719188 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.719065 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-model-cache\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.719188 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.719162 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7683d56a-95b9-45b5-9b5e-9a19755a1928-tls-certs\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.719363 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.719205 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-dshm\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.719363 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.719266 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-home\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.820311 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.820263 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-dshm\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.820311 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.820313 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-home\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.820533 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.820367 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-tmp-dir\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.820533 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.820394 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74bn4\" (UniqueName: \"kubernetes.io/projected/7683d56a-95b9-45b5-9b5e-9a19755a1928-kube-api-access-74bn4\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.820533 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.820417 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-model-cache\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.820695 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.820546 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7683d56a-95b9-45b5-9b5e-9a19755a1928-tls-certs\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.820831 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.820798 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-home\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.820950 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.820841 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-tmp-dir\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.820950 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.820880 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-model-cache\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.822643 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.822618 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-dshm\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.822756 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.822740 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7683d56a-95b9-45b5-9b5e-9a19755a1928-tls-certs\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.829382 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.829365 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74bn4\" (UniqueName: \"kubernetes.io/projected/7683d56a-95b9-45b5-9b5e-9a19755a1928-kube-api-access-74bn4\") pod \"e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:14.895050 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:14.895011 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:15.034163 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:15.034137 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv"] Aug 05 17:16:15.036583 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:16:15.036555 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7683d56a_95b9_45b5_9b5e_9a19755a1928.slice/crio-63ceb7dc482040a5271248fa76fc505728a019d706c7cb8f9e4a333ddbe8ebac WatchSource:0}: Error finding container 63ceb7dc482040a5271248fa76fc505728a019d706c7cb8f9e4a333ddbe8ebac: Status 404 returned error can't find the container with id 63ceb7dc482040a5271248fa76fc505728a019d706c7cb8f9e4a333ddbe8ebac Aug 05 17:16:15.935621 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:15.935581 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" event={"ID":"7683d56a-95b9-45b5-9b5e-9a19755a1928","Type":"ContainerStarted","Data":"b985ab384c2680a890bfe7b1fa4775cd9dcd6a6780bf64a9dd5dcb3c848629f3"} Aug 05 17:16:15.936077 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:15.935631 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" event={"ID":"7683d56a-95b9-45b5-9b5e-9a19755a1928","Type":"ContainerStarted","Data":"63ceb7dc482040a5271248fa76fc505728a019d706c7cb8f9e4a333ddbe8ebac"} Aug 05 17:16:15.955611 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:15.955561 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" podStartSLOduration=1.955544728 podStartE2EDuration="1.955544728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:16:15.952804474 +0000 UTC m=+2240.437462377" watchObservedRunningTime="2026-08-05 17:16:15.955544728 +0000 UTC m=+2240.440202676" Aug 05 17:16:24.895276 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:24.895172 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:24.895276 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:24.895238 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:24.907766 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:24.907740 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:16:24.992662 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:16:24.992633 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:17:10.104970 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:10.104937 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv"] Aug 05 17:17:25.124298 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.124250 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" podUID="7683d56a-95b9-45b5-9b5e-9a19755a1928" containerName="main" containerID="cri-o://b985ab384c2680a890bfe7b1fa4775cd9dcd6a6780bf64a9dd5dcb3c848629f3" gracePeriod=45 Aug 05 17:17:25.293424 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.293321 2583 generic.go:356] "Generic (PLEG): container finished" podID="7683d56a-95b9-45b5-9b5e-9a19755a1928" containerID="b985ab384c2680a890bfe7b1fa4775cd9dcd6a6780bf64a9dd5dcb3c848629f3" exitCode=0 Aug 05 17:17:25.293521 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.293435 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" event={"ID":"7683d56a-95b9-45b5-9b5e-9a19755a1928","Type":"ContainerDied","Data":"b985ab384c2680a890bfe7b1fa4775cd9dcd6a6780bf64a9dd5dcb3c848629f3"} Aug 05 17:17:25.379156 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.379095 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:17:25.440815 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.440788 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-home\") pod \"7683d56a-95b9-45b5-9b5e-9a19755a1928\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " Aug 05 17:17:25.440976 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.440851 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74bn4\" (UniqueName: \"kubernetes.io/projected/7683d56a-95b9-45b5-9b5e-9a19755a1928-kube-api-access-74bn4\") pod \"7683d56a-95b9-45b5-9b5e-9a19755a1928\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " Aug 05 17:17:25.440976 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.440878 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-tmp-dir\") pod \"7683d56a-95b9-45b5-9b5e-9a19755a1928\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " Aug 05 17:17:25.440976 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.440893 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-model-cache\") pod \"7683d56a-95b9-45b5-9b5e-9a19755a1928\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " Aug 05 17:17:25.440976 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.440914 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7683d56a-95b9-45b5-9b5e-9a19755a1928-tls-certs\") pod \"7683d56a-95b9-45b5-9b5e-9a19755a1928\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " Aug 05 17:17:25.441184 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.440992 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-dshm\") pod \"7683d56a-95b9-45b5-9b5e-9a19755a1928\" (UID: \"7683d56a-95b9-45b5-9b5e-9a19755a1928\") " Aug 05 17:17:25.441184 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.441066 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-home" (OuterVolumeSpecName: "home") pod "7683d56a-95b9-45b5-9b5e-9a19755a1928" (UID: "7683d56a-95b9-45b5-9b5e-9a19755a1928"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:17:25.441184 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.441108 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7683d56a-95b9-45b5-9b5e-9a19755a1928" (UID: "7683d56a-95b9-45b5-9b5e-9a19755a1928"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:17:25.441184 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.441117 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-model-cache" (OuterVolumeSpecName: "model-cache") pod "7683d56a-95b9-45b5-9b5e-9a19755a1928" (UID: "7683d56a-95b9-45b5-9b5e-9a19755a1928"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:17:25.441405 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.441271 2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:17:25.441405 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.441286 2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:17:25.441405 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.441300 2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:17:25.443240 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.443186 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-dshm" (OuterVolumeSpecName: "dshm") pod "7683d56a-95b9-45b5-9b5e-9a19755a1928" (UID: "7683d56a-95b9-45b5-9b5e-9a19755a1928"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:17:25.443240 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.443225 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7683d56a-95b9-45b5-9b5e-9a19755a1928-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7683d56a-95b9-45b5-9b5e-9a19755a1928" (UID: "7683d56a-95b9-45b5-9b5e-9a19755a1928"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:17:25.443387 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.443353 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7683d56a-95b9-45b5-9b5e-9a19755a1928-kube-api-access-74bn4" (OuterVolumeSpecName: "kube-api-access-74bn4") pod "7683d56a-95b9-45b5-9b5e-9a19755a1928" (UID: "7683d56a-95b9-45b5-9b5e-9a19755a1928"). InnerVolumeSpecName "kube-api-access-74bn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:17:25.541880 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.541841 2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7683d56a-95b9-45b5-9b5e-9a19755a1928-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:17:25.541880 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.541871 2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7683d56a-95b9-45b5-9b5e-9a19755a1928-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:17:25.541880 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:25.541884 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74bn4\" (UniqueName: \"kubernetes.io/projected/7683d56a-95b9-45b5-9b5e-9a19755a1928-kube-api-access-74bn4\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:17:26.300263 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:26.300151 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" event={"ID":"7683d56a-95b9-45b5-9b5e-9a19755a1928","Type":"ContainerDied","Data":"63ceb7dc482040a5271248fa76fc505728a019d706c7cb8f9e4a333ddbe8ebac"} Aug 05 17:17:26.300263 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:26.300171 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv" Aug 05 17:17:26.300263 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:26.300208 2583 scope.go:117] "RemoveContainer" containerID="b985ab384c2680a890bfe7b1fa4775cd9dcd6a6780bf64a9dd5dcb3c848629f3" Aug 05 17:17:26.319460 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:26.319429 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv"] Aug 05 17:17:26.322553 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:26.322529 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-dcd532bc/e2e-lifecycle-model-dcd532bc-kserve-5454c595bc-b5wcv"] Aug 05 17:17:28.021082 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:17:28.021045 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7683d56a-95b9-45b5-9b5e-9a19755a1928" path="/var/lib/kubelet/pods/7683d56a-95b9-45b5-9b5e-9a19755a1928/volumes" Aug 05 17:18:56.131931 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:18:56.131901 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:18:56.136439 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:18:56.136414 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:20:14.594477 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.594441 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz"] Aug 05 17:20:14.594878 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.594848 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7683d56a-95b9-45b5-9b5e-9a19755a1928" containerName="main" Aug 05 17:20:14.594878 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.594860 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7683d56a-95b9-45b5-9b5e-9a19755a1928" containerName="main" Aug 05 17:20:14.594951 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.594930 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7683d56a-95b9-45b5-9b5e-9a19755a1928" containerName="main" Aug 05 17:20:14.597942 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.597925 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.602253 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.602193 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c15c3d\"/\"default-dockercfg-j8p8r\"" Aug 05 17:20:14.602402 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.602237 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c15c3d\"/\"kube-root-ca.crt\"" Aug 05 17:20:14.602402 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.602289 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c15c3d\"/\"openshift-service-ca.crt\"" Aug 05 17:20:14.602531 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.602328 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c15c3d\"/\"test-model-c15c3d-kserve-self-signed-certs\"" Aug 05 17:20:14.608445 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.608422 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz"] Aug 05 17:20:14.659650 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.659619 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-dshm\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.659810 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.659672 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lww2\" (UniqueName: \"kubernetes.io/projected/173e6580-1747-4ba6-a847-7ea856f32dc6-kube-api-access-2lww2\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.659810 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.659764 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-home\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.659810 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.659793 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-model-cache\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.659912 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.659810 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-tmp-dir\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.659912 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.659894 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/173e6580-1747-4ba6-a847-7ea856f32dc6-tls-certs\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.761152 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.761110 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-dshm\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.761364 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.761179 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lww2\" (UniqueName: \"kubernetes.io/projected/173e6580-1747-4ba6-a847-7ea856f32dc6-kube-api-access-2lww2\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.761364 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.761246 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-home\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.761364 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.761281 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-model-cache\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.761364 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.761302 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-tmp-dir\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.761364 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.761348 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/173e6580-1747-4ba6-a847-7ea856f32dc6-tls-certs\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.761727 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.761638 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-home\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.761778 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.761721 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-tmp-dir\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.761778 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.761734 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-model-cache\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.763425 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.763395 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-dshm\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.763802 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.763781 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/173e6580-1747-4ba6-a847-7ea856f32dc6-tls-certs\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.769738 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.769722 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lww2\" (UniqueName: \"kubernetes.io/projected/173e6580-1747-4ba6-a847-7ea856f32dc6-kube-api-access-2lww2\") pod \"test-model-c15c3d-kserve-c5bbbdfff-v2tlz\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:14.908425 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:14.908344 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:15.054092 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:15.054067 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz"] Aug 05 17:20:15.055753 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:20:15.055730 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod173e6580_1747_4ba6_a847_7ea856f32dc6.slice/crio-521efba5f0782042494506d8dd1afaa2f9e105a510ef84832004457ef04eaecd WatchSource:0}: Error finding container 521efba5f0782042494506d8dd1afaa2f9e105a510ef84832004457ef04eaecd: Status 404 returned error can't find the container with id 521efba5f0782042494506d8dd1afaa2f9e105a510ef84832004457ef04eaecd Aug 05 17:20:15.140048 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:15.140010 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" event={"ID":"173e6580-1747-4ba6-a847-7ea856f32dc6","Type":"ContainerStarted","Data":"f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987"} Aug 05 17:20:15.140048 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:15.140052 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" event={"ID":"173e6580-1747-4ba6-a847-7ea856f32dc6","Type":"ContainerStarted","Data":"521efba5f0782042494506d8dd1afaa2f9e105a510ef84832004457ef04eaecd"} Aug 05 17:20:15.159176 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:15.159076 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" podStartSLOduration=1.15905979 podStartE2EDuration="1.15905979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:20:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:20:15.157967905 +0000 UTC m=+2479.642625809" watchObservedRunningTime="2026-08-05 17:20:15.15905979 +0000 UTC m=+2479.643717692" Aug 05 17:20:24.909209 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:24.909172 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:24.909805 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:24.909248 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:24.921730 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:24.921705 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:20:25.210253 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:20:25.210164 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:21:19.731603 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:19.731567 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz"] Aug 05 17:21:34.750598 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:34.750557 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" podUID="173e6580-1747-4ba6-a847-7ea856f32dc6" containerName="main" containerID="cri-o://f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987" gracePeriod=45 Aug 05 17:21:34.992798 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:34.992774 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:21:35.099631 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.099598 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-model-cache\") pod \"173e6580-1747-4ba6-a847-7ea856f32dc6\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " Aug 05 17:21:35.099817 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.099641 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-dshm\") pod \"173e6580-1747-4ba6-a847-7ea856f32dc6\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " Aug 05 17:21:35.099817 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.099665 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-home\") pod \"173e6580-1747-4ba6-a847-7ea856f32dc6\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " Aug 05 17:21:35.099817 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.099694 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-tmp-dir\") pod \"173e6580-1747-4ba6-a847-7ea856f32dc6\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " Aug 05 17:21:35.099817 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.099746 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lww2\" (UniqueName: \"kubernetes.io/projected/173e6580-1747-4ba6-a847-7ea856f32dc6-kube-api-access-2lww2\") pod \"173e6580-1747-4ba6-a847-7ea856f32dc6\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " Aug 05 17:21:35.099817 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.099796 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/173e6580-1747-4ba6-a847-7ea856f32dc6-tls-certs\") pod \"173e6580-1747-4ba6-a847-7ea856f32dc6\" (UID: \"173e6580-1747-4ba6-a847-7ea856f32dc6\") " Aug 05 17:21:35.100078 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.099940 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-home" (OuterVolumeSpecName: "home") pod "173e6580-1747-4ba6-a847-7ea856f32dc6" (UID: "173e6580-1747-4ba6-a847-7ea856f32dc6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:21:35.100078 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.099973 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-model-cache" (OuterVolumeSpecName: "model-cache") pod "173e6580-1747-4ba6-a847-7ea856f32dc6" (UID: "173e6580-1747-4ba6-a847-7ea856f32dc6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:21:35.100078 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.100014 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "173e6580-1747-4ba6-a847-7ea856f32dc6" (UID: "173e6580-1747-4ba6-a847-7ea856f32dc6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:21:35.100271 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.100126 2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:21:35.100271 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.100146 2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:21:35.100271 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.100161 2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:21:35.102016 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.101992 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-dshm" (OuterVolumeSpecName: "dshm") pod "173e6580-1747-4ba6-a847-7ea856f32dc6" (UID: "173e6580-1747-4ba6-a847-7ea856f32dc6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:21:35.102145 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.102036 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/173e6580-1747-4ba6-a847-7ea856f32dc6-kube-api-access-2lww2" (OuterVolumeSpecName: "kube-api-access-2lww2") pod "173e6580-1747-4ba6-a847-7ea856f32dc6" (UID: "173e6580-1747-4ba6-a847-7ea856f32dc6"). InnerVolumeSpecName "kube-api-access-2lww2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:21:35.102145 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.102036 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/173e6580-1747-4ba6-a847-7ea856f32dc6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "173e6580-1747-4ba6-a847-7ea856f32dc6" (UID: "173e6580-1747-4ba6-a847-7ea856f32dc6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:21:35.201083 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.201044 2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/173e6580-1747-4ba6-a847-7ea856f32dc6-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:21:35.201083 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.201074 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lww2\" (UniqueName: \"kubernetes.io/projected/173e6580-1747-4ba6-a847-7ea856f32dc6-kube-api-access-2lww2\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:21:35.201083 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.201087 2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/173e6580-1747-4ba6-a847-7ea856f32dc6-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:21:35.546512 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.546417 2583 generic.go:356] "Generic (PLEG): container finished" podID="173e6580-1747-4ba6-a847-7ea856f32dc6" containerID="f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987" exitCode=0 Aug 05 17:21:35.546512 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.546456 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" Aug 05 17:21:35.546727 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.546460 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" event={"ID":"173e6580-1747-4ba6-a847-7ea856f32dc6","Type":"ContainerDied","Data":"f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987"} Aug 05 17:21:35.546727 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.546571 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz" event={"ID":"173e6580-1747-4ba6-a847-7ea856f32dc6","Type":"ContainerDied","Data":"521efba5f0782042494506d8dd1afaa2f9e105a510ef84832004457ef04eaecd"} Aug 05 17:21:35.546727 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.546593 2583 scope.go:117] "RemoveContainer" containerID="f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987" Aug 05 17:21:35.556346 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.556324 2583 scope.go:117] "RemoveContainer" containerID="f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987" Aug 05 17:21:35.556606 ip-10-0-132-4 kubenswrapper[2583]: E0805 17:21:35.556586 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987\": container with ID starting with f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987 not found: ID does not exist" containerID="f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987" Aug 05 17:21:35.556673 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.556613 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987"} err="failed to get container status \"f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987\": rpc error: code = NotFound desc = could not find container \"f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987\": container with ID starting with f8bdaa7003afda38f9bfc29148dd8845e32995dcebcd52c29e441f7ce4c71987 not found: ID does not exist" Aug 05 17:21:35.572398 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.572371 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz"] Aug 05 17:21:35.579725 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:35.579698 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c15c3d/test-model-c15c3d-kserve-c5bbbdfff-v2tlz"] Aug 05 17:21:36.021076 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:21:36.021042 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="173e6580-1747-4ba6-a847-7ea856f32dc6" path="/var/lib/kubelet/pods/173e6580-1747-4ba6-a847-7ea856f32dc6/volumes" Aug 05 17:23:56.162136 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:23:56.162051 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:23:56.167533 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:23:56.167513 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:25:34.409641 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.409569 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c"] Aug 05 17:25:34.410081 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.409958 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173e6580-1747-4ba6-a847-7ea856f32dc6" containerName="main" Aug 05 17:25:34.410081 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.409969 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="173e6580-1747-4ba6-a847-7ea856f32dc6" containerName="main" Aug 05 17:25:34.410081 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.410027 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="173e6580-1747-4ba6-a847-7ea856f32dc6" containerName="main" Aug 05 17:25:34.413097 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.413079 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.416104 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.416083 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a1e09f\"/\"openshift-service-ca.crt\"" Aug 05 17:25:34.416262 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.416112 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a1e09f\"/\"kube-root-ca.crt\"" Aug 05 17:25:34.417347 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.417323 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1e09f\"/\"auth-test-model-a1e09f-kserve-self-signed-certs\"" Aug 05 17:25:34.417456 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.417361 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1e09f\"/\"default-dockercfg-b5sd6\"" Aug 05 17:25:34.422018 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.421995 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c"] Aug 05 17:25:34.535594 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.535562 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-home\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.535594 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.535594 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-tmp-dir\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.535836 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.535619 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-model-cache\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.535836 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.535724 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d8jg\" (UniqueName: \"kubernetes.io/projected/07d8c541-1fea-4156-a3ec-74c288bc2b26-kube-api-access-7d8jg\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.535836 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.535788 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07d8c541-1fea-4156-a3ec-74c288bc2b26-tls-certs\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.535946 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.535897 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-dshm\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.637334 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.637304 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-dshm\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.637492 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.637342 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-home\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.637492 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.637360 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-tmp-dir\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.637492 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.637390 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-model-cache\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.637492 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.637440 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d8jg\" (UniqueName: \"kubernetes.io/projected/07d8c541-1fea-4156-a3ec-74c288bc2b26-kube-api-access-7d8jg\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.637492 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.637483 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07d8c541-1fea-4156-a3ec-74c288bc2b26-tls-certs\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.637801 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.637776 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-home\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.637883 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.637824 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-model-cache\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.637883 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.637873 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-tmp-dir\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.639690 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.639670 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-dshm\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.639843 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.639827 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07d8c541-1fea-4156-a3ec-74c288bc2b26-tls-certs\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.667575 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.667519 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d8jg\" (UniqueName: \"kubernetes.io/projected/07d8c541-1fea-4156-a3ec-74c288bc2b26-kube-api-access-7d8jg\") pod \"auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.722844 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.722807 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:34.860565 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:34.860532 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c"] Aug 05 17:25:34.862267 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:25:34.862240 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07d8c541_1fea_4156_a3ec_74c288bc2b26.slice/crio-7b85b4214af021cc1f28d55ee5ddbc281528768c67922b08dd1fbd5d6bd4b9a2 WatchSource:0}: Error finding container 7b85b4214af021cc1f28d55ee5ddbc281528768c67922b08dd1fbd5d6bd4b9a2: Status 404 returned error can't find the container with id 7b85b4214af021cc1f28d55ee5ddbc281528768c67922b08dd1fbd5d6bd4b9a2 Aug 05 17:25:35.738233 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:35.738182 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" event={"ID":"07d8c541-1fea-4156-a3ec-74c288bc2b26","Type":"ContainerStarted","Data":"0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38"} Aug 05 17:25:35.738615 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:35.738254 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" event={"ID":"07d8c541-1fea-4156-a3ec-74c288bc2b26","Type":"ContainerStarted","Data":"7b85b4214af021cc1f28d55ee5ddbc281528768c67922b08dd1fbd5d6bd4b9a2"} Aug 05 17:25:35.766069 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:35.766015 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" podStartSLOduration=1.765997798 podStartE2EDuration="1.765997798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:25:35.76491686 +0000 UTC m=+2800.249574763" watchObservedRunningTime="2026-08-05 17:25:35.765997798 +0000 UTC m=+2800.250655761" Aug 05 17:25:44.723490 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:44.723447 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:44.723855 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:44.723506 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:44.736270 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:44.736244 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:25:44.792508 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:25:44.792478 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:26:05.010544 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.010505 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw"] Aug 05 17:26:05.013872 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.013850 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.016871 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.016854 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a81ee3\"/\"kube-root-ca.crt\"" Aug 05 17:26:05.017953 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.017935 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a81ee3\"/\"default-dockercfg-46qzr\"" Aug 05 17:26:05.018010 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.017994 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a81ee3\"/\"openshift-service-ca.crt\"" Aug 05 17:26:05.018065 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.018043 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a81ee3\"/\"auth-test-model-a81ee3-kserve-self-signed-certs\"" Aug 05 17:26:05.026072 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.026047 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw"] Aug 05 17:26:05.105567 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.105532 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91337662-ac2e-41a9-a978-19534f0aa8b0-tls-certs\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.105750 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.105576 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-dshm\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.105750 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.105663 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-tmp-dir\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.105750 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.105709 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cd2d\" (UniqueName: \"kubernetes.io/projected/91337662-ac2e-41a9-a978-19534f0aa8b0-kube-api-access-2cd2d\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.105877 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.105762 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-home\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.105877 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.105780 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-model-cache\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.206765 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.206728 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91337662-ac2e-41a9-a978-19534f0aa8b0-tls-certs\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.206765 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.206778 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-dshm\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.207056 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.206825 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-tmp-dir\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.207056 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.206866 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cd2d\" (UniqueName: \"kubernetes.io/projected/91337662-ac2e-41a9-a978-19534f0aa8b0-kube-api-access-2cd2d\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.207056 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.206907 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-home\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.207056 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.206932 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-model-cache\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.207356 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.207331 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-tmp-dir\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.207458 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.207391 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-home\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.207458 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.207423 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-model-cache\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.209278 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.209255 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-dshm\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.209423 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.209408 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91337662-ac2e-41a9-a978-19534f0aa8b0-tls-certs\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.217101 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.217079 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cd2d\" (UniqueName: \"kubernetes.io/projected/91337662-ac2e-41a9-a978-19534f0aa8b0-kube-api-access-2cd2d\") pod \"auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.323929 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.323854 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:05.475570 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.475361 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw"] Aug 05 17:26:05.478043 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:26:05.478014 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91337662_ac2e_41a9_a978_19534f0aa8b0.slice/crio-a312c9b26184c51901642db65917565508899b3bc2c58b57a06639f31cc52677 WatchSource:0}: Error finding container a312c9b26184c51901642db65917565508899b3bc2c58b57a06639f31cc52677: Status 404 returned error can't find the container with id a312c9b26184c51901642db65917565508899b3bc2c58b57a06639f31cc52677 Aug 05 17:26:05.885583 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.885550 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" event={"ID":"91337662-ac2e-41a9-a978-19534f0aa8b0","Type":"ContainerStarted","Data":"399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d"} Aug 05 17:26:05.885583 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.885588 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" event={"ID":"91337662-ac2e-41a9-a978-19534f0aa8b0","Type":"ContainerStarted","Data":"a312c9b26184c51901642db65917565508899b3bc2c58b57a06639f31cc52677"} Aug 05 17:26:05.905758 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:05.905707 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" podStartSLOduration=1.905688979 podStartE2EDuration="1.905688979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:26:05.905125849 +0000 UTC m=+2830.389783755" watchObservedRunningTime="2026-08-05 17:26:05.905688979 +0000 UTC m=+2830.390346882" Aug 05 17:26:15.324478 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:15.324435 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:15.324903 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:15.324492 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:15.337135 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:15.337110 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:26:15.946894 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:26:15.946865 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:28:56.194293 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:28:56.194260 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:28:56.200931 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:28:56.200904 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:30:16.198499 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:16.198462 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c"] Aug 05 17:30:17.340606 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:17.340570 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw"] Aug 05 17:30:31.217809 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.217768 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" podUID="07d8c541-1fea-4156-a3ec-74c288bc2b26" containerName="main" containerID="cri-o://0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38" gracePeriod=45 Aug 05 17:30:31.257740 ip-10-0-132-4 kubenswrapper[2583]: E0805 17:30:31.257707 2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07d8c541_1fea_4156_a3ec_74c288bc2b26.slice/crio-0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07d8c541_1fea_4156_a3ec_74c288bc2b26.slice/crio-conmon-0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38.scope\": RecentStats: unable to find data in memory cache]" Aug 05 17:30:31.463562 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.463534 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:30:31.568083 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.568001 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d8jg\" (UniqueName: \"kubernetes.io/projected/07d8c541-1fea-4156-a3ec-74c288bc2b26-kube-api-access-7d8jg\") pod \"07d8c541-1fea-4156-a3ec-74c288bc2b26\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " Aug 05 17:30:31.568083 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.568035 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-model-cache\") pod \"07d8c541-1fea-4156-a3ec-74c288bc2b26\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " Aug 05 17:30:31.568083 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.568085 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-home\") pod \"07d8c541-1fea-4156-a3ec-74c288bc2b26\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " Aug 05 17:30:31.568398 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.568120 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-dshm\") pod \"07d8c541-1fea-4156-a3ec-74c288bc2b26\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " Aug 05 17:30:31.568398 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.568178 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-tmp-dir\") pod \"07d8c541-1fea-4156-a3ec-74c288bc2b26\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " Aug 05 17:30:31.568398 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.568193 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07d8c541-1fea-4156-a3ec-74c288bc2b26-tls-certs\") pod \"07d8c541-1fea-4156-a3ec-74c288bc2b26\" (UID: \"07d8c541-1fea-4156-a3ec-74c288bc2b26\") " Aug 05 17:30:31.568398 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.568384 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-home" (OuterVolumeSpecName: "home") pod "07d8c541-1fea-4156-a3ec-74c288bc2b26" (UID: "07d8c541-1fea-4156-a3ec-74c288bc2b26"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:30:31.568603 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.568400 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-model-cache" (OuterVolumeSpecName: "model-cache") pod "07d8c541-1fea-4156-a3ec-74c288bc2b26" (UID: "07d8c541-1fea-4156-a3ec-74c288bc2b26"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:30:31.568603 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.568498 2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:30:31.568603 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.568514 2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:30:31.568724 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.568604 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "07d8c541-1fea-4156-a3ec-74c288bc2b26" (UID: "07d8c541-1fea-4156-a3ec-74c288bc2b26"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:30:31.570356 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.570324 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-dshm" (OuterVolumeSpecName: "dshm") pod "07d8c541-1fea-4156-a3ec-74c288bc2b26" (UID: "07d8c541-1fea-4156-a3ec-74c288bc2b26"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:30:31.570468 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.570375 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07d8c541-1fea-4156-a3ec-74c288bc2b26-kube-api-access-7d8jg" (OuterVolumeSpecName: "kube-api-access-7d8jg") pod "07d8c541-1fea-4156-a3ec-74c288bc2b26" (UID: "07d8c541-1fea-4156-a3ec-74c288bc2b26"). InnerVolumeSpecName "kube-api-access-7d8jg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:30:31.570468 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.570411 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07d8c541-1fea-4156-a3ec-74c288bc2b26-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "07d8c541-1fea-4156-a3ec-74c288bc2b26" (UID: "07d8c541-1fea-4156-a3ec-74c288bc2b26"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:30:31.670020 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.669986 2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:30:31.670171 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.670031 2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07d8c541-1fea-4156-a3ec-74c288bc2b26-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:30:31.670171 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.670041 2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07d8c541-1fea-4156-a3ec-74c288bc2b26-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:30:31.670171 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.670057 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d8jg\" (UniqueName: \"kubernetes.io/projected/07d8c541-1fea-4156-a3ec-74c288bc2b26-kube-api-access-7d8jg\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:30:31.699111 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.699081 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt"] Aug 05 17:30:31.699491 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.699479 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d8c541-1fea-4156-a3ec-74c288bc2b26" containerName="main" Aug 05 17:30:31.699547 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.699492 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d8c541-1fea-4156-a3ec-74c288bc2b26" containerName="main" Aug 05 17:30:31.699597 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.699587 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="07d8c541-1fea-4156-a3ec-74c288bc2b26" containerName="main" Aug 05 17:30:31.702706 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.702692 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.705815 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.705792 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1e09f\"/\"sub-test-model-a1e09f-kserve-self-signed-certs\"" Aug 05 17:30:31.713710 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.713688 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt"] Aug 05 17:30:31.771348 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.771317 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-model-cache\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.771348 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.771352 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqf7d\" (UniqueName: \"kubernetes.io/projected/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-kube-api-access-rqf7d\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.771533 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.771375 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-tmp-dir\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.771533 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.771446 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-dshm\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.771533 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.771485 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-tls-certs\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.771533 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.771519 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-home\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.872417 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.872384 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-model-cache\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.872417 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.872418 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqf7d\" (UniqueName: \"kubernetes.io/projected/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-kube-api-access-rqf7d\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.872664 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.872446 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-tmp-dir\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.872664 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.872575 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-dshm\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.872664 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.872654 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-tls-certs\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.872817 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.872721 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-home\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.872870 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.872813 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-tmp-dir\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.872870 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.872831 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-model-cache\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.873092 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.873072 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-home\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.874884 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.874863 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-dshm\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.875169 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.875151 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-tls-certs\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:31.882963 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:31.882945 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqf7d\" (UniqueName: \"kubernetes.io/projected/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-kube-api-access-rqf7d\") pod \"sub-test-model-a1e09f-kserve-77854dfc79-4v9vt\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:32.013016 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.012973 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:32.152736 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.152712 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt"] Aug 05 17:30:32.154671 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:30:32.154644 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e52ecaa_c5d1_4b66_afbf_5cce6d7ffe99.slice/crio-a1a884b1a680846b247cbd6d7136f851cff3b3a8fcc6129950965f7cd553b3cc WatchSource:0}: Error finding container a1a884b1a680846b247cbd6d7136f851cff3b3a8fcc6129950965f7cd553b3cc: Status 404 returned error can't find the container with id a1a884b1a680846b247cbd6d7136f851cff3b3a8fcc6129950965f7cd553b3cc Aug 05 17:30:32.243421 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.243389 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" event={"ID":"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99","Type":"ContainerStarted","Data":"5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f"} Aug 05 17:30:32.243830 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.243439 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" event={"ID":"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99","Type":"ContainerStarted","Data":"a1a884b1a680846b247cbd6d7136f851cff3b3a8fcc6129950965f7cd553b3cc"} Aug 05 17:30:32.244837 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.244805 2583 generic.go:356] "Generic (PLEG): container finished" podID="07d8c541-1fea-4156-a3ec-74c288bc2b26" containerID="0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38" exitCode=0 Aug 05 17:30:32.244961 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.244870 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" event={"ID":"07d8c541-1fea-4156-a3ec-74c288bc2b26","Type":"ContainerDied","Data":"0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38"} Aug 05 17:30:32.244961 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.244900 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" event={"ID":"07d8c541-1fea-4156-a3ec-74c288bc2b26","Type":"ContainerDied","Data":"7b85b4214af021cc1f28d55ee5ddbc281528768c67922b08dd1fbd5d6bd4b9a2"} Aug 05 17:30:32.244961 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.244922 2583 scope.go:117] "RemoveContainer" containerID="0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38" Aug 05 17:30:32.245120 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.245081 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c" Aug 05 17:30:32.256363 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.256338 2583 scope.go:117] "RemoveContainer" containerID="0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38" Aug 05 17:30:32.256690 ip-10-0-132-4 kubenswrapper[2583]: E0805 17:30:32.256660 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38\": container with ID starting with 0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38 not found: ID does not exist" containerID="0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38" Aug 05 17:30:32.256745 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.256700 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38"} err="failed to get container status \"0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38\": rpc error: code = NotFound desc = could not find container \"0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38\": container with ID starting with 0076c6322c793bc61583ba43bde0e9501db82e7716cf7019e3326e3b78734a38 not found: ID does not exist" Aug 05 17:30:32.265751 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.265707 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" podStartSLOduration=1.2656933129999999 podStartE2EDuration="1.265693313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:32.264562692 +0000 UTC m=+3096.749220595" watchObservedRunningTime="2026-08-05 17:30:32.265693313 +0000 UTC m=+3096.750351215" Aug 05 17:30:32.283005 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.282982 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c"] Aug 05 17:30:32.288129 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.288102 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/auth-test-model-a1e09f-kserve-7ccf66c4f5-dtz2c"] Aug 05 17:30:32.359593 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.359554 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" podUID="91337662-ac2e-41a9-a978-19534f0aa8b0" containerName="main" containerID="cri-o://399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d" gracePeriod=45 Aug 05 17:30:32.607128 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.607103 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:30:32.680968 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.680936 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-home\") pod \"91337662-ac2e-41a9-a978-19534f0aa8b0\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " Aug 05 17:30:32.680968 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.680974 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91337662-ac2e-41a9-a978-19534f0aa8b0-tls-certs\") pod \"91337662-ac2e-41a9-a978-19534f0aa8b0\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " Aug 05 17:30:32.681242 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.681035 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-tmp-dir\") pod \"91337662-ac2e-41a9-a978-19534f0aa8b0\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " Aug 05 17:30:32.681242 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.681050 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-model-cache\") pod \"91337662-ac2e-41a9-a978-19534f0aa8b0\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " Aug 05 17:30:32.681242 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.681087 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cd2d\" (UniqueName: \"kubernetes.io/projected/91337662-ac2e-41a9-a978-19534f0aa8b0-kube-api-access-2cd2d\") pod \"91337662-ac2e-41a9-a978-19534f0aa8b0\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " Aug 05 17:30:32.681242 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.681145 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-dshm\") pod \"91337662-ac2e-41a9-a978-19534f0aa8b0\" (UID: \"91337662-ac2e-41a9-a978-19534f0aa8b0\") " Aug 05 17:30:32.681681 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.681202 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-home" (OuterVolumeSpecName: "home") pod "91337662-ac2e-41a9-a978-19534f0aa8b0" (UID: "91337662-ac2e-41a9-a978-19534f0aa8b0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:30:32.681681 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.681355 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "91337662-ac2e-41a9-a978-19534f0aa8b0" (UID: "91337662-ac2e-41a9-a978-19534f0aa8b0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:30:32.681681 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.681431 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-model-cache" (OuterVolumeSpecName: "model-cache") pod "91337662-ac2e-41a9-a978-19534f0aa8b0" (UID: "91337662-ac2e-41a9-a978-19534f0aa8b0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:30:32.681681 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.681557 2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:30:32.681681 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.681576 2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:30:32.681681 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.681589 2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:30:32.683421 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.683391 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91337662-ac2e-41a9-a978-19534f0aa8b0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "91337662-ac2e-41a9-a978-19534f0aa8b0" (UID: "91337662-ac2e-41a9-a978-19534f0aa8b0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:30:32.683523 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.683427 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91337662-ac2e-41a9-a978-19534f0aa8b0-kube-api-access-2cd2d" (OuterVolumeSpecName: "kube-api-access-2cd2d") pod "91337662-ac2e-41a9-a978-19534f0aa8b0" (UID: "91337662-ac2e-41a9-a978-19534f0aa8b0"). InnerVolumeSpecName "kube-api-access-2cd2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:30:32.683523 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.683433 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-dshm" (OuterVolumeSpecName: "dshm") pod "91337662-ac2e-41a9-a978-19534f0aa8b0" (UID: "91337662-ac2e-41a9-a978-19534f0aa8b0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:30:32.782360 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.782283 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cd2d\" (UniqueName: \"kubernetes.io/projected/91337662-ac2e-41a9-a978-19534f0aa8b0-kube-api-access-2cd2d\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:30:32.782360 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.782308 2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91337662-ac2e-41a9-a978-19534f0aa8b0-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:30:32.782360 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:32.782317 2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91337662-ac2e-41a9-a978-19534f0aa8b0-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:30:33.252279 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:33.252247 2583 generic.go:356] "Generic (PLEG): container finished" podID="91337662-ac2e-41a9-a978-19534f0aa8b0" containerID="399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d" exitCode=0 Aug 05 17:30:33.252731 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:33.252299 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" Aug 05 17:30:33.252731 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:33.252331 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" event={"ID":"91337662-ac2e-41a9-a978-19534f0aa8b0","Type":"ContainerDied","Data":"399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d"} Aug 05 17:30:33.252731 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:33.252373 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw" event={"ID":"91337662-ac2e-41a9-a978-19534f0aa8b0","Type":"ContainerDied","Data":"a312c9b26184c51901642db65917565508899b3bc2c58b57a06639f31cc52677"} Aug 05 17:30:33.252731 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:33.252390 2583 scope.go:117] "RemoveContainer" containerID="399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d" Aug 05 17:30:33.261193 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:33.261178 2583 scope.go:117] "RemoveContainer" containerID="399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d" Aug 05 17:30:33.261485 ip-10-0-132-4 kubenswrapper[2583]: E0805 17:30:33.261466 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d\": container with ID starting with 399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d not found: ID does not exist" containerID="399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d" Aug 05 17:30:33.261534 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:33.261493 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d"} err="failed to get container status \"399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d\": rpc error: code = NotFound desc = could not find container \"399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d\": container with ID starting with 399e6fb0773eb50178b63cbd64b028998041238e85d37837ce809d182590d43d not found: ID does not exist" Aug 05 17:30:33.276317 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:33.276293 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw"] Aug 05 17:30:33.280630 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:33.280608 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/auth-test-model-a81ee3-kserve-7fd9987ff5-l8ncw"] Aug 05 17:30:34.020882 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:34.020848 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07d8c541-1fea-4156-a3ec-74c288bc2b26" path="/var/lib/kubelet/pods/07d8c541-1fea-4156-a3ec-74c288bc2b26/volumes" Aug 05 17:30:34.021279 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:34.021264 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91337662-ac2e-41a9-a978-19534f0aa8b0" path="/var/lib/kubelet/pods/91337662-ac2e-41a9-a978-19534f0aa8b0/volumes" Aug 05 17:30:42.013836 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:42.013789 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:42.013836 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:42.013843 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:42.027152 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:42.027122 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:30:42.309980 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:30:42.309894 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:32:13.544828 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:13.544797 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt"] Aug 05 17:32:21.508672 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.508639 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f"] Aug 05 17:32:21.509156 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.509035 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91337662-ac2e-41a9-a978-19534f0aa8b0" containerName="main" Aug 05 17:32:21.509156 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.509047 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="91337662-ac2e-41a9-a978-19534f0aa8b0" containerName="main" Aug 05 17:32:21.509156 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.509118 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="91337662-ac2e-41a9-a978-19534f0aa8b0" containerName="main" Aug 05 17:32:21.512112 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.512095 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.514869 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.514849 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1e09f\"/\"rate-test-model-a1e09f-kserve-self-signed-certs\"" Aug 05 17:32:21.522744 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.522721 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f"] Aug 05 17:32:21.662502 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.662466 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-model-cache\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.662502 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.662503 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-tmp-dir\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.662723 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.662600 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-home\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.662723 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.662658 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-dshm\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.662723 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.662711 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhq7q\" (UniqueName: \"kubernetes.io/projected/c46f3831-2ad7-45cb-96f6-a004602018d7-kube-api-access-zhq7q\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.662851 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.662751 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c46f3831-2ad7-45cb-96f6-a004602018d7-tls-certs\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.763816 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.763740 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhq7q\" (UniqueName: \"kubernetes.io/projected/c46f3831-2ad7-45cb-96f6-a004602018d7-kube-api-access-zhq7q\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.763816 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.763789 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c46f3831-2ad7-45cb-96f6-a004602018d7-tls-certs\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.764021 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.763837 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-model-cache\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.764021 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.763861 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-tmp-dir\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.764021 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.763918 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-home\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.764021 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.763950 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-dshm\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.764341 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.764316 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-model-cache\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.764414 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.764341 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-tmp-dir\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.764414 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.764375 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-home\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.766095 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.766077 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-dshm\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.766269 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.766251 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c46f3831-2ad7-45cb-96f6-a004602018d7-tls-certs\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.776982 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.776959 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhq7q\" (UniqueName: \"kubernetes.io/projected/c46f3831-2ad7-45cb-96f6-a004602018d7-kube-api-access-zhq7q\") pod \"rate-test-model-a1e09f-kserve-655c55599f-qfk7f\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.821166 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.821138 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:21.971722 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:21.971698 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f"] Aug 05 17:32:21.973862 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:32:21.973841 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc46f3831_2ad7_45cb_96f6_a004602018d7.slice/crio-976dae80d77a195e8a84034819c00428232b033c6cb4334b907446bc1d6a8e3b WatchSource:0}: Error finding container 976dae80d77a195e8a84034819c00428232b033c6cb4334b907446bc1d6a8e3b: Status 404 returned error can't find the container with id 976dae80d77a195e8a84034819c00428232b033c6cb4334b907446bc1d6a8e3b Aug 05 17:32:22.794387 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:22.794353 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" event={"ID":"c46f3831-2ad7-45cb-96f6-a004602018d7","Type":"ContainerStarted","Data":"2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434"} Aug 05 17:32:22.794729 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:22.794395 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" event={"ID":"c46f3831-2ad7-45cb-96f6-a004602018d7","Type":"ContainerStarted","Data":"976dae80d77a195e8a84034819c00428232b033c6cb4334b907446bc1d6a8e3b"} Aug 05 17:32:22.818595 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:22.818545 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" podStartSLOduration=1.8185308 podStartE2EDuration="1.8185308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:22.816581699 +0000 UTC m=+3207.301239602" watchObservedRunningTime="2026-08-05 17:32:22.8185308 +0000 UTC m=+3207.303188715" Aug 05 17:32:28.563818 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.563757 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" podUID="7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99" containerName="main" containerID="cri-o://5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f" gracePeriod=45 Aug 05 17:32:28.818144 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.818087 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:32:28.823557 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.823528 2583 generic.go:356] "Generic (PLEG): container finished" podID="7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99" containerID="5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f" exitCode=0 Aug 05 17:32:28.823678 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.823561 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" Aug 05 17:32:28.823678 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.823585 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" event={"ID":"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99","Type":"ContainerDied","Data":"5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f"} Aug 05 17:32:28.823678 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.823621 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt" event={"ID":"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99","Type":"ContainerDied","Data":"a1a884b1a680846b247cbd6d7136f851cff3b3a8fcc6129950965f7cd553b3cc"} Aug 05 17:32:28.823678 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.823641 2583 scope.go:117] "RemoveContainer" containerID="5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f" Aug 05 17:32:28.831637 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.831618 2583 scope.go:117] "RemoveContainer" containerID="5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f" Aug 05 17:32:28.831867 ip-10-0-132-4 kubenswrapper[2583]: E0805 17:32:28.831851 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f\": container with ID starting with 5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f not found: ID does not exist" containerID="5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f" Aug 05 17:32:28.831910 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.831876 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f"} err="failed to get container status \"5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f\": rpc error: code = NotFound desc = could not find container \"5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f\": container with ID starting with 5b03f570df260aca30f49e51ea5ccbf41854a8a3e9a55224cd14be2b4ca0295f not found: ID does not exist" Aug 05 17:32:28.929867 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.929823 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-tmp-dir\") pod \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " Aug 05 17:32:28.929867 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.929873 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-home\") pod \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " Aug 05 17:32:28.930107 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.929924 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-tls-certs\") pod \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " Aug 05 17:32:28.930107 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.929945 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqf7d\" (UniqueName: \"kubernetes.io/projected/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-kube-api-access-rqf7d\") pod \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " Aug 05 17:32:28.930107 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.929962 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-dshm\") pod \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " Aug 05 17:32:28.930107 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.929992 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-model-cache\") pod \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\" (UID: \"7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99\") " Aug 05 17:32:28.930107 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.930095 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99" (UID: "7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:32:28.930408 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.930239 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-home" (OuterVolumeSpecName: "home") pod "7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99" (UID: "7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:32:28.930408 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.930336 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-model-cache" (OuterVolumeSpecName: "model-cache") pod "7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99" (UID: "7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:32:28.930516 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.930413 2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:32:28.930516 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.930426 2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:32:28.930516 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.930435 2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:32:28.932178 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.932152 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-kube-api-access-rqf7d" (OuterVolumeSpecName: "kube-api-access-rqf7d") pod "7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99" (UID: "7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99"). InnerVolumeSpecName "kube-api-access-rqf7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:32:28.932276 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.932186 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-dshm" (OuterVolumeSpecName: "dshm") pod "7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99" (UID: "7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:32:28.932276 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:28.932246 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99" (UID: "7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:32:29.031460 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:29.031426 2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:32:29.031460 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:29.031454 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqf7d\" (UniqueName: \"kubernetes.io/projected/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-kube-api-access-rqf7d\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:32:29.031460 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:29.031464 2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:32:29.146389 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:29.146357 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt"] Aug 05 17:32:29.154791 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:29.154768 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/sub-test-model-a1e09f-kserve-77854dfc79-4v9vt"] Aug 05 17:32:30.020520 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:30.020484 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99" path="/var/lib/kubelet/pods/7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99/volumes" Aug 05 17:32:31.821642 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:31.821610 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:31.822110 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:31.821660 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:31.833993 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:31.833969 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:32:31.851566 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:32:31.851536 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:33:56.226519 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:33:56.226491 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:33:56.232708 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:33:56.232683 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:34:01.295194 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:01.295153 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f"] Aug 05 17:34:03.094249 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.094202 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7603-140378869123760"] Aug 05 17:34:03.094787 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.094767 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99" containerName="main" Aug 05 17:34:03.094868 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.094790 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99" containerName="main" Aug 05 17:34:03.094922 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.094885 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e52ecaa-c5d1-4b66-afbf-5cce6d7ffe99" containerName="main" Aug 05 17:34:03.097955 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.097934 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869123760" Aug 05 17:34:03.100854 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.100838 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-78czp\"" Aug 05 17:34:03.105316 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.105292 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7603-140378869123760"] Aug 05 17:34:03.189007 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.188977 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4vpc\" (UniqueName: \"kubernetes.io/projected/aac8795d-de45-4a61-85f1-ed96c17cd6c2-kube-api-access-m4vpc\") pod \"test-curl-7603-140378869123760\" (UID: \"aac8795d-de45-4a61-85f1-ed96c17cd6c2\") " pod="opendatahub/test-curl-7603-140378869123760" Aug 05 17:34:03.290461 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.290432 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4vpc\" (UniqueName: \"kubernetes.io/projected/aac8795d-de45-4a61-85f1-ed96c17cd6c2-kube-api-access-m4vpc\") pod \"test-curl-7603-140378869123760\" (UID: \"aac8795d-de45-4a61-85f1-ed96c17cd6c2\") " pod="opendatahub/test-curl-7603-140378869123760" Aug 05 17:34:03.299987 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.299955 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4vpc\" (UniqueName: \"kubernetes.io/projected/aac8795d-de45-4a61-85f1-ed96c17cd6c2-kube-api-access-m4vpc\") pod \"test-curl-7603-140378869123760\" (UID: \"aac8795d-de45-4a61-85f1-ed96c17cd6c2\") " pod="opendatahub/test-curl-7603-140378869123760" Aug 05 17:34:03.407744 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.407661 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869123760" Aug 05 17:34:03.544429 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.544398 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7603-140378869123760"] Aug 05 17:34:03.546902 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:34:03.546873 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaac8795d_de45_4a61_85f1_ed96c17cd6c2.slice/crio-f53de70f00e4ee7804aebe6665bead63aedcc6ecd4cf3b4b2eabe0e54ba0f238 WatchSource:0}: Error finding container f53de70f00e4ee7804aebe6665bead63aedcc6ecd4cf3b4b2eabe0e54ba0f238: Status 404 returned error can't find the container with id f53de70f00e4ee7804aebe6665bead63aedcc6ecd4cf3b4b2eabe0e54ba0f238 Aug 05 17:34:03.548255 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:03.548233 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 17:34:04.293278 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:04.293248 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7603-140378869123760" event={"ID":"aac8795d-de45-4a61-85f1-ed96c17cd6c2","Type":"ContainerStarted","Data":"f53de70f00e4ee7804aebe6665bead63aedcc6ecd4cf3b4b2eabe0e54ba0f238"} Aug 05 17:34:05.302398 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:05.302361 2583 generic.go:356] "Generic (PLEG): container finished" podID="aac8795d-de45-4a61-85f1-ed96c17cd6c2" containerID="862cfbdffd90749a0c4cca48287ab064650a712a3f2411b303dcb6f78915200a" exitCode=0 Aug 05 17:34:05.302790 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:05.302447 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7603-140378869123760" event={"ID":"aac8795d-de45-4a61-85f1-ed96c17cd6c2","Type":"ContainerDied","Data":"862cfbdffd90749a0c4cca48287ab064650a712a3f2411b303dcb6f78915200a"} Aug 05 17:34:06.446556 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.446530 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869123760" Aug 05 17:34:06.492823 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.492794 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7603-140378869123760_aac8795d-de45-4a61-85f1-ed96c17cd6c2/test-curl-7603-140378869123760/0.log" Aug 05 17:34:06.517261 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.517231 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4vpc\" (UniqueName: \"kubernetes.io/projected/aac8795d-de45-4a61-85f1-ed96c17cd6c2-kube-api-access-m4vpc\") pod \"aac8795d-de45-4a61-85f1-ed96c17cd6c2\" (UID: \"aac8795d-de45-4a61-85f1-ed96c17cd6c2\") " Aug 05 17:34:06.518317 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.518290 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7603-140378869123760"] Aug 05 17:34:06.519521 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.519493 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac8795d-de45-4a61-85f1-ed96c17cd6c2-kube-api-access-m4vpc" (OuterVolumeSpecName: "kube-api-access-m4vpc") pod "aac8795d-de45-4a61-85f1-ed96c17cd6c2" (UID: "aac8795d-de45-4a61-85f1-ed96c17cd6c2"). InnerVolumeSpecName "kube-api-access-m4vpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:34:06.520093 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.520077 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7603-140378869123760"] Aug 05 17:34:06.618133 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.618107 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4vpc\" (UniqueName: \"kubernetes.io/projected/aac8795d-de45-4a61-85f1-ed96c17cd6c2-kube-api-access-m4vpc\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:34:06.636145 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.636116 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7603-140378869133616"] Aug 05 17:34:06.636535 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.636519 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac8795d-de45-4a61-85f1-ed96c17cd6c2" containerName="test-curl-7603-140378869123760" Aug 05 17:34:06.636580 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.636536 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac8795d-de45-4a61-85f1-ed96c17cd6c2" containerName="test-curl-7603-140378869123760" Aug 05 17:34:06.636616 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.636610 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac8795d-de45-4a61-85f1-ed96c17cd6c2" containerName="test-curl-7603-140378869123760" Aug 05 17:34:06.639555 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.639540 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869133616" Aug 05 17:34:06.649696 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.649674 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7603-140378869133616"] Aug 05 17:34:06.718922 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.718891 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg2sb\" (UniqueName: \"kubernetes.io/projected/6d190f0b-8385-4836-ac88-ba0ddf55c6c1-kube-api-access-pg2sb\") pod \"test-curl-7603-140378869133616\" (UID: \"6d190f0b-8385-4836-ac88-ba0ddf55c6c1\") " pod="opendatahub/test-curl-7603-140378869133616" Aug 05 17:34:06.820325 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.820283 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg2sb\" (UniqueName: \"kubernetes.io/projected/6d190f0b-8385-4836-ac88-ba0ddf55c6c1-kube-api-access-pg2sb\") pod \"test-curl-7603-140378869133616\" (UID: \"6d190f0b-8385-4836-ac88-ba0ddf55c6c1\") " pod="opendatahub/test-curl-7603-140378869133616" Aug 05 17:34:06.838783 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.838762 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg2sb\" (UniqueName: \"kubernetes.io/projected/6d190f0b-8385-4836-ac88-ba0ddf55c6c1-kube-api-access-pg2sb\") pod \"test-curl-7603-140378869133616\" (UID: \"6d190f0b-8385-4836-ac88-ba0ddf55c6c1\") " pod="opendatahub/test-curl-7603-140378869133616" Aug 05 17:34:06.948801 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:06.948726 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869133616" Aug 05 17:34:07.094517 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:07.088913 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7603-140378869133616"] Aug 05 17:34:07.314185 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:07.314093 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869123760" Aug 05 17:34:07.314185 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:07.314116 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f53de70f00e4ee7804aebe6665bead63aedcc6ecd4cf3b4b2eabe0e54ba0f238" Aug 05 17:34:07.315534 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:07.315498 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7603-140378869133616" event={"ID":"6d190f0b-8385-4836-ac88-ba0ddf55c6c1","Type":"ContainerStarted","Data":"9ed5a0419732d291a47302297d3c1fe0d15dff25935b5a7ac2bb49a827aa2c91"} Aug 05 17:34:07.326535 ip-10-0-132-4 kubenswrapper[2583]: E0805 17:34:07.326509 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7603-140378869123760\" is forbidden: User \"system:node:ip-10-0-132-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-4.ec2.internal' and this object" podUID="aac8795d-de45-4a61-85f1-ed96c17cd6c2" pod="opendatahub/test-curl-7603-140378869123760" Aug 05 17:34:08.021096 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:08.021064 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aac8795d-de45-4a61-85f1-ed96c17cd6c2" path="/var/lib/kubelet/pods/aac8795d-de45-4a61-85f1-ed96c17cd6c2/volumes" Aug 05 17:34:08.321645 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:08.321558 2583 generic.go:356] "Generic (PLEG): container finished" podID="6d190f0b-8385-4836-ac88-ba0ddf55c6c1" containerID="b117580a494c868018cb7bccdd3761f5040303b461bad912da8942cf86b4a779" exitCode=0 Aug 05 17:34:08.321645 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:08.321600 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7603-140378869133616" event={"ID":"6d190f0b-8385-4836-ac88-ba0ddf55c6c1","Type":"ContainerDied","Data":"b117580a494c868018cb7bccdd3761f5040303b461bad912da8942cf86b4a779"} Aug 05 17:34:09.459172 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.459146 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869133616" Aug 05 17:34:09.481676 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.481653 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7603-140378869133616_6d190f0b-8385-4836-ac88-ba0ddf55c6c1/test-curl-7603-140378869133616/0.log" Aug 05 17:34:09.505389 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.505358 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7603-140378869133616"] Aug 05 17:34:09.508095 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.508070 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7603-140378869133616"] Aug 05 17:34:09.541911 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.541886 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg2sb\" (UniqueName: \"kubernetes.io/projected/6d190f0b-8385-4836-ac88-ba0ddf55c6c1-kube-api-access-pg2sb\") pod \"6d190f0b-8385-4836-ac88-ba0ddf55c6c1\" (UID: \"6d190f0b-8385-4836-ac88-ba0ddf55c6c1\") " Aug 05 17:34:09.543983 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.543957 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d190f0b-8385-4836-ac88-ba0ddf55c6c1-kube-api-access-pg2sb" (OuterVolumeSpecName: "kube-api-access-pg2sb") pod "6d190f0b-8385-4836-ac88-ba0ddf55c6c1" (UID: "6d190f0b-8385-4836-ac88-ba0ddf55c6c1"). InnerVolumeSpecName "kube-api-access-pg2sb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:34:09.643108 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.643076 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg2sb\" (UniqueName: \"kubernetes.io/projected/6d190f0b-8385-4836-ac88-ba0ddf55c6c1-kube-api-access-pg2sb\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:34:09.680739 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.680708 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7603-140378868960544"] Aug 05 17:34:09.681112 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.681099 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d190f0b-8385-4836-ac88-ba0ddf55c6c1" containerName="test-curl-7603-140378869133616" Aug 05 17:34:09.681151 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.681114 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d190f0b-8385-4836-ac88-ba0ddf55c6c1" containerName="test-curl-7603-140378869133616" Aug 05 17:34:09.681192 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.681184 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d190f0b-8385-4836-ac88-ba0ddf55c6c1" containerName="test-curl-7603-140378869133616" Aug 05 17:34:09.684296 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.684281 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:09.692387 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.692366 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7603-140378868960544"] Aug 05 17:34:09.743485 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.743453 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8mw9\" (UniqueName: \"kubernetes.io/projected/1ebb72f8-f991-4f14-a84f-5032d4efa140-kube-api-access-d8mw9\") pod \"test-curl-7603-140378868960544\" (UID: \"1ebb72f8-f991-4f14-a84f-5032d4efa140\") " pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:09.844085 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.844051 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8mw9\" (UniqueName: \"kubernetes.io/projected/1ebb72f8-f991-4f14-a84f-5032d4efa140-kube-api-access-d8mw9\") pod \"test-curl-7603-140378868960544\" (UID: \"1ebb72f8-f991-4f14-a84f-5032d4efa140\") " pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:09.852903 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.852876 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8mw9\" (UniqueName: \"kubernetes.io/projected/1ebb72f8-f991-4f14-a84f-5032d4efa140-kube-api-access-d8mw9\") pod \"test-curl-7603-140378868960544\" (UID: \"1ebb72f8-f991-4f14-a84f-5032d4efa140\") " pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:09.994667 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:09.994587 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:10.021433 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:10.021403 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d190f0b-8385-4836-ac88-ba0ddf55c6c1" path="/var/lib/kubelet/pods/6d190f0b-8385-4836-ac88-ba0ddf55c6c1/volumes" Aug 05 17:34:10.127768 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:10.127742 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7603-140378868960544"] Aug 05 17:34:10.129471 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:34:10.129451 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ebb72f8_f991_4f14_a84f_5032d4efa140.slice/crio-301c2db1d6f0eace253ec69fdfb8ea6cf660f4a3947d9620fdbcc8ea734a1ef7 WatchSource:0}: Error finding container 301c2db1d6f0eace253ec69fdfb8ea6cf660f4a3947d9620fdbcc8ea734a1ef7: Status 404 returned error can't find the container with id 301c2db1d6f0eace253ec69fdfb8ea6cf660f4a3947d9620fdbcc8ea734a1ef7 Aug 05 17:34:10.332978 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:10.332893 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869133616" Aug 05 17:34:10.332978 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:10.332951 2583 scope.go:117] "RemoveContainer" containerID="b117580a494c868018cb7bccdd3761f5040303b461bad912da8942cf86b4a779" Aug 05 17:34:10.334253 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:10.334230 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7603-140378868960544" event={"ID":"1ebb72f8-f991-4f14-a84f-5032d4efa140","Type":"ContainerStarted","Data":"301c2db1d6f0eace253ec69fdfb8ea6cf660f4a3947d9620fdbcc8ea734a1ef7"} Aug 05 17:34:11.341365 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:11.341325 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ebb72f8-f991-4f14-a84f-5032d4efa140" containerID="ec2f7d276cb03072db89f9d61cd5aae9dfa89f02bfad34751d9d10b404f7b7fc" exitCode=0 Aug 05 17:34:11.341800 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:11.341390 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7603-140378868960544" event={"ID":"1ebb72f8-f991-4f14-a84f-5032d4efa140","Type":"ContainerDied","Data":"ec2f7d276cb03072db89f9d61cd5aae9dfa89f02bfad34751d9d10b404f7b7fc"} Aug 05 17:34:12.487077 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.487048 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:12.509107 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.509081 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7603-140378868960544_1ebb72f8-f991-4f14-a84f-5032d4efa140/test-curl-7603-140378868960544/0.log" Aug 05 17:34:12.533812 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.533781 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7603-140378868960544"] Aug 05 17:34:12.541429 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.541401 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7603-140378868960544"] Aug 05 17:34:12.567940 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.567918 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8mw9\" (UniqueName: \"kubernetes.io/projected/1ebb72f8-f991-4f14-a84f-5032d4efa140-kube-api-access-d8mw9\") pod \"1ebb72f8-f991-4f14-a84f-5032d4efa140\" (UID: \"1ebb72f8-f991-4f14-a84f-5032d4efa140\") " Aug 05 17:34:12.569956 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.569927 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ebb72f8-f991-4f14-a84f-5032d4efa140-kube-api-access-d8mw9" (OuterVolumeSpecName: "kube-api-access-d8mw9") pod "1ebb72f8-f991-4f14-a84f-5032d4efa140" (UID: "1ebb72f8-f991-4f14-a84f-5032d4efa140"). InnerVolumeSpecName "kube-api-access-d8mw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:34:12.655836 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.655755 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7603-140378868960544"] Aug 05 17:34:12.656163 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.656151 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ebb72f8-f991-4f14-a84f-5032d4efa140" containerName="test-curl-7603-140378868960544" Aug 05 17:34:12.656210 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.656165 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ebb72f8-f991-4f14-a84f-5032d4efa140" containerName="test-curl-7603-140378868960544" Aug 05 17:34:12.656280 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.656264 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ebb72f8-f991-4f14-a84f-5032d4efa140" containerName="test-curl-7603-140378868960544" Aug 05 17:34:12.659124 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.659105 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:12.664571 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.664547 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7603-140378868960544"] Aug 05 17:34:12.668670 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.668645 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8mw9\" (UniqueName: \"kubernetes.io/projected/1ebb72f8-f991-4f14-a84f-5032d4efa140-kube-api-access-d8mw9\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:34:12.769358 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.769314 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg4dq\" (UniqueName: \"kubernetes.io/projected/f6fa9835-7cda-49ca-ab23-bf67a3513c65-kube-api-access-cg4dq\") pod \"test-curl-7603-140378868960544\" (UID: \"f6fa9835-7cda-49ca-ab23-bf67a3513c65\") " pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:12.870092 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.870052 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg4dq\" (UniqueName: \"kubernetes.io/projected/f6fa9835-7cda-49ca-ab23-bf67a3513c65-kube-api-access-cg4dq\") pod \"test-curl-7603-140378868960544\" (UID: \"f6fa9835-7cda-49ca-ab23-bf67a3513c65\") " pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:12.879512 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.879486 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg4dq\" (UniqueName: \"kubernetes.io/projected/f6fa9835-7cda-49ca-ab23-bf67a3513c65-kube-api-access-cg4dq\") pod \"test-curl-7603-140378868960544\" (UID: \"f6fa9835-7cda-49ca-ab23-bf67a3513c65\") " pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:12.968996 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:12.968921 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:13.111351 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:13.111324 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7603-140378868960544"] Aug 05 17:34:13.112658 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:34:13.112632 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6fa9835_7cda_49ca_ab23_bf67a3513c65.slice/crio-539b7bc9dbae4402f46906d481efaa9e2ed80be2a1bdd8e09ef2e9dd10c23d84 WatchSource:0}: Error finding container 539b7bc9dbae4402f46906d481efaa9e2ed80be2a1bdd8e09ef2e9dd10c23d84: Status 404 returned error can't find the container with id 539b7bc9dbae4402f46906d481efaa9e2ed80be2a1bdd8e09ef2e9dd10c23d84 Aug 05 17:34:13.353733 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:13.353694 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7603-140378868960544" event={"ID":"f6fa9835-7cda-49ca-ab23-bf67a3513c65","Type":"ContainerStarted","Data":"539b7bc9dbae4402f46906d481efaa9e2ed80be2a1bdd8e09ef2e9dd10c23d84"} Aug 05 17:34:13.354866 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:13.354842 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:13.354994 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:13.354891 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="301c2db1d6f0eace253ec69fdfb8ea6cf660f4a3947d9620fdbcc8ea734a1ef7" Aug 05 17:34:13.366720 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:13.366687 2583 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7603-140378868960544" oldPodUID="1ebb72f8-f991-4f14-a84f-5032d4efa140" podUID="f6fa9835-7cda-49ca-ab23-bf67a3513c65" Aug 05 17:34:14.020770 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:14.020736 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ebb72f8-f991-4f14-a84f-5032d4efa140" path="/var/lib/kubelet/pods/1ebb72f8-f991-4f14-a84f-5032d4efa140/volumes" Aug 05 17:34:14.362121 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:14.362091 2583 generic.go:356] "Generic (PLEG): container finished" podID="f6fa9835-7cda-49ca-ab23-bf67a3513c65" containerID="73da9dcabfe5d2cd5f69f75b910663128df9742d49a8dbe2b0508d742ab13cab" exitCode=0 Aug 05 17:34:14.362323 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:14.362184 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7603-140378868960544" event={"ID":"f6fa9835-7cda-49ca-ab23-bf67a3513c65","Type":"ContainerDied","Data":"73da9dcabfe5d2cd5f69f75b910663128df9742d49a8dbe2b0508d742ab13cab"} Aug 05 17:34:15.505564 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.505537 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:15.528561 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.528537 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7603-140378868960544_f6fa9835-7cda-49ca-ab23-bf67a3513c65/test-curl-7603-140378868960544/0.log" Aug 05 17:34:15.548718 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.548692 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7603-140378868960544"] Aug 05 17:34:15.553557 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.553536 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7603-140378868960544"] Aug 05 17:34:15.597651 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.597626 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg4dq\" (UniqueName: \"kubernetes.io/projected/f6fa9835-7cda-49ca-ab23-bf67a3513c65-kube-api-access-cg4dq\") pod \"f6fa9835-7cda-49ca-ab23-bf67a3513c65\" (UID: \"f6fa9835-7cda-49ca-ab23-bf67a3513c65\") " Aug 05 17:34:15.599700 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.599676 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6fa9835-7cda-49ca-ab23-bf67a3513c65-kube-api-access-cg4dq" (OuterVolumeSpecName: "kube-api-access-cg4dq") pod "f6fa9835-7cda-49ca-ab23-bf67a3513c65" (UID: "f6fa9835-7cda-49ca-ab23-bf67a3513c65"). InnerVolumeSpecName "kube-api-access-cg4dq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:34:15.672106 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.672037 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7603-140378869047632"] Aug 05 17:34:15.672439 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.672425 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6fa9835-7cda-49ca-ab23-bf67a3513c65" containerName="test-curl-7603-140378868960544" Aug 05 17:34:15.672480 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.672440 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6fa9835-7cda-49ca-ab23-bf67a3513c65" containerName="test-curl-7603-140378868960544" Aug 05 17:34:15.672519 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.672500 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6fa9835-7cda-49ca-ab23-bf67a3513c65" containerName="test-curl-7603-140378868960544" Aug 05 17:34:15.675512 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.675497 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:15.681270 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.681245 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7603-140378869047632"] Aug 05 17:34:15.698763 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.698739 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s4cn\" (UniqueName: \"kubernetes.io/projected/a02ad9d7-b581-4059-a4f5-2c609a92a3a5-kube-api-access-8s4cn\") pod \"test-curl-7603-140378869047632\" (UID: \"a02ad9d7-b581-4059-a4f5-2c609a92a3a5\") " pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:15.698880 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.698784 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg4dq\" (UniqueName: \"kubernetes.io/projected/f6fa9835-7cda-49ca-ab23-bf67a3513c65-kube-api-access-cg4dq\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:34:15.799543 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.799515 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s4cn\" (UniqueName: \"kubernetes.io/projected/a02ad9d7-b581-4059-a4f5-2c609a92a3a5-kube-api-access-8s4cn\") pod \"test-curl-7603-140378869047632\" (UID: \"a02ad9d7-b581-4059-a4f5-2c609a92a3a5\") " pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:15.808274 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.808246 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s4cn\" (UniqueName: \"kubernetes.io/projected/a02ad9d7-b581-4059-a4f5-2c609a92a3a5-kube-api-access-8s4cn\") pod \"test-curl-7603-140378869047632\" (UID: \"a02ad9d7-b581-4059-a4f5-2c609a92a3a5\") " pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:15.986289 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:15.986200 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:16.026873 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.023112 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6fa9835-7cda-49ca-ab23-bf67a3513c65" path="/var/lib/kubelet/pods/f6fa9835-7cda-49ca-ab23-bf67a3513c65/volumes" Aug 05 17:34:16.122059 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.122026 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7603-140378869047632"] Aug 05 17:34:16.125269 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:34:16.125241 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda02ad9d7_b581_4059_a4f5_2c609a92a3a5.slice/crio-6580691c8f1590365f6dcdeab398137475f318742f777cadd3a6400f99a70c94 WatchSource:0}: Error finding container 6580691c8f1590365f6dcdeab398137475f318742f777cadd3a6400f99a70c94: Status 404 returned error can't find the container with id 6580691c8f1590365f6dcdeab398137475f318742f777cadd3a6400f99a70c94 Aug 05 17:34:16.314176 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.314068 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" podUID="c46f3831-2ad7-45cb-96f6-a004602018d7" containerName="main" containerID="cri-o://2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434" gracePeriod=45 Aug 05 17:34:16.373345 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.373314 2583 scope.go:117] "RemoveContainer" containerID="73da9dcabfe5d2cd5f69f75b910663128df9742d49a8dbe2b0508d742ab13cab" Aug 05 17:34:16.373510 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.373318 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378868960544" Aug 05 17:34:16.374693 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.374669 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7603-140378869047632" event={"ID":"a02ad9d7-b581-4059-a4f5-2c609a92a3a5","Type":"ContainerStarted","Data":"6580691c8f1590365f6dcdeab398137475f318742f777cadd3a6400f99a70c94"} Aug 05 17:34:16.581549 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.581526 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:34:16.605030 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.605005 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-dshm\") pod \"c46f3831-2ad7-45cb-96f6-a004602018d7\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " Aug 05 17:34:16.605143 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.605072 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-home\") pod \"c46f3831-2ad7-45cb-96f6-a004602018d7\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " Aug 05 17:34:16.605143 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.605102 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-model-cache\") pod \"c46f3831-2ad7-45cb-96f6-a004602018d7\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " Aug 05 17:34:16.605143 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.605136 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhq7q\" (UniqueName: \"kubernetes.io/projected/c46f3831-2ad7-45cb-96f6-a004602018d7-kube-api-access-zhq7q\") pod \"c46f3831-2ad7-45cb-96f6-a004602018d7\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " Aug 05 17:34:16.605330 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.605166 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c46f3831-2ad7-45cb-96f6-a004602018d7-tls-certs\") pod \"c46f3831-2ad7-45cb-96f6-a004602018d7\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " Aug 05 17:34:16.605330 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.605246 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-tmp-dir\") pod \"c46f3831-2ad7-45cb-96f6-a004602018d7\" (UID: \"c46f3831-2ad7-45cb-96f6-a004602018d7\") " Aug 05 17:34:16.605431 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.605390 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-model-cache" (OuterVolumeSpecName: "model-cache") pod "c46f3831-2ad7-45cb-96f6-a004602018d7" (UID: "c46f3831-2ad7-45cb-96f6-a004602018d7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:34:16.605431 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.605405 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-home" (OuterVolumeSpecName: "home") pod "c46f3831-2ad7-45cb-96f6-a004602018d7" (UID: "c46f3831-2ad7-45cb-96f6-a004602018d7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:34:16.605591 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.605570 2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:34:16.605664 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.605595 2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:34:16.605664 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.605607 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c46f3831-2ad7-45cb-96f6-a004602018d7" (UID: "c46f3831-2ad7-45cb-96f6-a004602018d7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:34:16.607380 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.607352 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c46f3831-2ad7-45cb-96f6-a004602018d7-kube-api-access-zhq7q" (OuterVolumeSpecName: "kube-api-access-zhq7q") pod "c46f3831-2ad7-45cb-96f6-a004602018d7" (UID: "c46f3831-2ad7-45cb-96f6-a004602018d7"). InnerVolumeSpecName "kube-api-access-zhq7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:34:16.607486 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.607397 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c46f3831-2ad7-45cb-96f6-a004602018d7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c46f3831-2ad7-45cb-96f6-a004602018d7" (UID: "c46f3831-2ad7-45cb-96f6-a004602018d7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:34:16.607542 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.607512 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-dshm" (OuterVolumeSpecName: "dshm") pod "c46f3831-2ad7-45cb-96f6-a004602018d7" (UID: "c46f3831-2ad7-45cb-96f6-a004602018d7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:34:16.706160 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.706126 2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c46f3831-2ad7-45cb-96f6-a004602018d7-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:34:16.706160 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.706154 2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:34:16.706160 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.706162 2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c46f3831-2ad7-45cb-96f6-a004602018d7-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:34:16.706390 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:16.706171 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhq7q\" (UniqueName: \"kubernetes.io/projected/c46f3831-2ad7-45cb-96f6-a004602018d7-kube-api-access-zhq7q\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:34:17.382120 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:17.382082 2583 generic.go:356] "Generic (PLEG): container finished" podID="c46f3831-2ad7-45cb-96f6-a004602018d7" containerID="2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434" exitCode=0 Aug 05 17:34:17.382329 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:17.382134 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" Aug 05 17:34:17.382329 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:17.382173 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" event={"ID":"c46f3831-2ad7-45cb-96f6-a004602018d7","Type":"ContainerDied","Data":"2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434"} Aug 05 17:34:17.382329 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:17.382243 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f" event={"ID":"c46f3831-2ad7-45cb-96f6-a004602018d7","Type":"ContainerDied","Data":"976dae80d77a195e8a84034819c00428232b033c6cb4334b907446bc1d6a8e3b"} Aug 05 17:34:17.382329 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:17.382271 2583 scope.go:117] "RemoveContainer" containerID="2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434" Aug 05 17:34:17.385396 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:17.385365 2583 generic.go:356] "Generic (PLEG): container finished" podID="a02ad9d7-b581-4059-a4f5-2c609a92a3a5" containerID="e9697cae0f081163becb4fb1e8912902fbee5a250d912b676883128adf292116" exitCode=0 Aug 05 17:34:17.385510 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:17.385419 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7603-140378869047632" event={"ID":"a02ad9d7-b581-4059-a4f5-2c609a92a3a5","Type":"ContainerDied","Data":"e9697cae0f081163becb4fb1e8912902fbee5a250d912b676883128adf292116"} Aug 05 17:34:17.392518 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:17.392497 2583 scope.go:117] "RemoveContainer" containerID="2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434" Aug 05 17:34:17.392732 ip-10-0-132-4 kubenswrapper[2583]: E0805 17:34:17.392712 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434\": container with ID starting with 2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434 not found: ID does not exist" containerID="2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434" Aug 05 17:34:17.392789 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:17.392740 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434"} err="failed to get container status \"2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434\": rpc error: code = NotFound desc = could not find container \"2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434\": container with ID starting with 2c1dbcd77e96a96fca7f4201f053964788142b45b48fd8f78e9bbe46478d1434 not found: ID does not exist" Aug 05 17:34:17.419961 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:17.419924 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f"] Aug 05 17:34:17.422840 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:17.422815 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a1e09f/rate-test-model-a1e09f-kserve-655c55599f-qfk7f"] Aug 05 17:34:18.020470 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.020441 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c46f3831-2ad7-45cb-96f6-a004602018d7" path="/var/lib/kubelet/pods/c46f3831-2ad7-45cb-96f6-a004602018d7/volumes" Aug 05 17:34:18.533204 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.533179 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:18.554457 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.554419 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7603-140378869047632_a02ad9d7-b581-4059-a4f5-2c609a92a3a5/test-curl-7603-140378869047632/0.log" Aug 05 17:34:18.575718 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.575687 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7603-140378869047632"] Aug 05 17:34:18.582022 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.581995 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7603-140378869047632"] Aug 05 17:34:18.621534 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.621506 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s4cn\" (UniqueName: \"kubernetes.io/projected/a02ad9d7-b581-4059-a4f5-2c609a92a3a5-kube-api-access-8s4cn\") pod \"a02ad9d7-b581-4059-a4f5-2c609a92a3a5\" (UID: \"a02ad9d7-b581-4059-a4f5-2c609a92a3a5\") " Aug 05 17:34:18.623583 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.623555 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a02ad9d7-b581-4059-a4f5-2c609a92a3a5-kube-api-access-8s4cn" (OuterVolumeSpecName: "kube-api-access-8s4cn") pod "a02ad9d7-b581-4059-a4f5-2c609a92a3a5" (UID: "a02ad9d7-b581-4059-a4f5-2c609a92a3a5"). InnerVolumeSpecName "kube-api-access-8s4cn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:34:18.710466 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.710392 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7603-140378869047632"] Aug 05 17:34:18.710775 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.710763 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a02ad9d7-b581-4059-a4f5-2c609a92a3a5" containerName="test-curl-7603-140378869047632" Aug 05 17:34:18.710821 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.710778 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a02ad9d7-b581-4059-a4f5-2c609a92a3a5" containerName="test-curl-7603-140378869047632" Aug 05 17:34:18.710821 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.710793 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46f3831-2ad7-45cb-96f6-a004602018d7" containerName="main" Aug 05 17:34:18.710821 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.710802 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46f3831-2ad7-45cb-96f6-a004602018d7" containerName="main" Aug 05 17:34:18.710913 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.710863 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a02ad9d7-b581-4059-a4f5-2c609a92a3a5" containerName="test-curl-7603-140378869047632" Aug 05 17:34:18.710913 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.710871 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c46f3831-2ad7-45cb-96f6-a004602018d7" containerName="main" Aug 05 17:34:18.713880 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.713863 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:18.720650 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.720625 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7603-140378869047632"] Aug 05 17:34:18.722206 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.722174 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s4cn\" (UniqueName: \"kubernetes.io/projected/a02ad9d7-b581-4059-a4f5-2c609a92a3a5-kube-api-access-8s4cn\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:34:18.822765 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.822731 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zl2x\" (UniqueName: \"kubernetes.io/projected/41888e1b-10f0-49db-94e6-580f7527b3d4-kube-api-access-7zl2x\") pod \"test-curl-7603-140378869047632\" (UID: \"41888e1b-10f0-49db-94e6-580f7527b3d4\") " pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:18.923548 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.923509 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zl2x\" (UniqueName: \"kubernetes.io/projected/41888e1b-10f0-49db-94e6-580f7527b3d4-kube-api-access-7zl2x\") pod \"test-curl-7603-140378869047632\" (UID: \"41888e1b-10f0-49db-94e6-580f7527b3d4\") " pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:18.933643 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:18.933612 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zl2x\" (UniqueName: \"kubernetes.io/projected/41888e1b-10f0-49db-94e6-580f7527b3d4-kube-api-access-7zl2x\") pod \"test-curl-7603-140378869047632\" (UID: \"41888e1b-10f0-49db-94e6-580f7527b3d4\") " pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:19.024499 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:19.024423 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:19.364428 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:19.364402 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7603-140378869047632"] Aug 05 17:34:19.366815 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:34:19.366787 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41888e1b_10f0_49db_94e6_580f7527b3d4.slice/crio-d8ef1436f1e71b2581e2e8053acbfa4bd7f12e67cb17562abd28d6f7cc99d80c WatchSource:0}: Error finding container d8ef1436f1e71b2581e2e8053acbfa4bd7f12e67cb17562abd28d6f7cc99d80c: Status 404 returned error can't find the container with id d8ef1436f1e71b2581e2e8053acbfa4bd7f12e67cb17562abd28d6f7cc99d80c Aug 05 17:34:19.398349 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:19.398326 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:19.398463 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:19.398328 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6580691c8f1590365f6dcdeab398137475f318742f777cadd3a6400f99a70c94" Aug 05 17:34:19.399682 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:19.399630 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7603-140378869047632" event={"ID":"41888e1b-10f0-49db-94e6-580f7527b3d4","Type":"ContainerStarted","Data":"d8ef1436f1e71b2581e2e8053acbfa4bd7f12e67cb17562abd28d6f7cc99d80c"} Aug 05 17:34:19.416185 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:19.416155 2583 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7603-140378869047632" oldPodUID="a02ad9d7-b581-4059-a4f5-2c609a92a3a5" podUID="41888e1b-10f0-49db-94e6-580f7527b3d4" Aug 05 17:34:20.021374 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:20.021281 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a02ad9d7-b581-4059-a4f5-2c609a92a3a5" path="/var/lib/kubelet/pods/a02ad9d7-b581-4059-a4f5-2c609a92a3a5/volumes" Aug 05 17:34:20.406111 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:20.406075 2583 generic.go:356] "Generic (PLEG): container finished" podID="41888e1b-10f0-49db-94e6-580f7527b3d4" containerID="0964bede32179abe326e13aac9436bd5f6ee70e442e1991dc6db03fb43bac684" exitCode=0 Aug 05 17:34:20.406500 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:20.406113 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7603-140378869047632" event={"ID":"41888e1b-10f0-49db-94e6-580f7527b3d4","Type":"ContainerDied","Data":"0964bede32179abe326e13aac9436bd5f6ee70e442e1991dc6db03fb43bac684"} Aug 05 17:34:21.555704 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:21.555676 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:21.576270 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:21.576241 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7603-140378869047632_41888e1b-10f0-49db-94e6-580f7527b3d4/test-curl-7603-140378869047632/0.log" Aug 05 17:34:21.596450 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:21.596422 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7603-140378869047632"] Aug 05 17:34:21.600272 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:21.600248 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7603-140378869047632"] Aug 05 17:34:21.650690 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:21.650668 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zl2x\" (UniqueName: \"kubernetes.io/projected/41888e1b-10f0-49db-94e6-580f7527b3d4-kube-api-access-7zl2x\") pod \"41888e1b-10f0-49db-94e6-580f7527b3d4\" (UID: \"41888e1b-10f0-49db-94e6-580f7527b3d4\") " Aug 05 17:34:21.652728 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:21.652704 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41888e1b-10f0-49db-94e6-580f7527b3d4-kube-api-access-7zl2x" (OuterVolumeSpecName: "kube-api-access-7zl2x") pod "41888e1b-10f0-49db-94e6-580f7527b3d4" (UID: "41888e1b-10f0-49db-94e6-580f7527b3d4"). InnerVolumeSpecName "kube-api-access-7zl2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:34:21.751610 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:21.751536 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zl2x\" (UniqueName: \"kubernetes.io/projected/41888e1b-10f0-49db-94e6-580f7527b3d4-kube-api-access-7zl2x\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:34:22.020918 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:22.020718 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41888e1b-10f0-49db-94e6-580f7527b3d4" path="/var/lib/kubelet/pods/41888e1b-10f0-49db-94e6-580f7527b3d4/volumes" Aug 05 17:34:22.418716 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:22.418690 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7603-140378869047632" Aug 05 17:34:22.418906 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:22.418694 2583 scope.go:117] "RemoveContainer" containerID="0964bede32179abe326e13aac9436bd5f6ee70e442e1991dc6db03fb43bac684" Aug 05 17:34:50.896946 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.896911 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d"] Aug 05 17:34:50.897531 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.897514 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41888e1b-10f0-49db-94e6-580f7527b3d4" containerName="test-curl-7603-140378869047632" Aug 05 17:34:50.897575 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.897534 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="41888e1b-10f0-49db-94e6-580f7527b3d4" containerName="test-curl-7603-140378869047632" Aug 05 17:34:50.897648 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.897637 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="41888e1b-10f0-49db-94e6-580f7527b3d4" containerName="test-curl-7603-140378869047632" Aug 05 17:34:50.901185 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.901167 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:50.903845 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.903820 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-40374d-openshift-default-dockercfg-g8rfz\"" Aug 05 17:34:50.904147 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.904129 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Aug 05 17:34:50.913531 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.913511 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d"] Aug 05 17:34:50.914939 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.914914 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-credential-socket\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:50.915036 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.914954 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-workload-certs\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:50.915083 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.915044 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdw7f\" (UniqueName: \"kubernetes.io/projected/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-kube-api-access-qdw7f\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:50.915137 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.915091 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-workload-socket\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:50.915192 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.915149 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istiod-ca-cert\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:50.915265 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.915236 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-envoy\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:50.915330 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.915264 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-data\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:50.915330 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.915299 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-podinfo\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:50.915450 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:50.915334 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-token\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.016132 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.016103 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-workload-socket\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.016317 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.016141 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istiod-ca-cert\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.016317 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.016203 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-envoy\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.016317 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.016238 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-data\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.016317 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.016272 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-podinfo\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.016317 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.016300 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-token\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.016612 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.016404 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-credential-socket\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.016612 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.016429 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-workload-certs\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.016612 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.016555 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-workload-socket\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.016880 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.016850 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdw7f\" (UniqueName: \"kubernetes.io/projected/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-kube-api-access-qdw7f\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.017000 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.016973 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istiod-ca-cert\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.017169 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.017140 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-credential-socket\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.017310 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.017143 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-workload-certs\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.017380 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.017365 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-data\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.018842 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.018822 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-envoy\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.019028 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.018998 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-podinfo\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.025062 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.025035 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-token\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.025260 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.025243 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdw7f\" (UniqueName: \"kubernetes.io/projected/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-kube-api-access-qdw7f\") pod \"e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.212049 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.211963 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:51.350452 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.350427 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d"] Aug 05 17:34:51.352502 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:34:51.352471 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e3cecb_7526_4a8c_8c7f_8f8ae3baa27c.slice/crio-c083409b26949001a19486b992e0824780acb421b68f0de8084e3e6391b5cbdc WatchSource:0}: Error finding container c083409b26949001a19486b992e0824780acb421b68f0de8084e3e6391b5cbdc: Status 404 returned error can't find the container with id c083409b26949001a19486b992e0824780acb421b68f0de8084e3e6391b5cbdc Aug 05 17:34:51.566721 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:51.566625 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" event={"ID":"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c","Type":"ContainerStarted","Data":"c083409b26949001a19486b992e0824780acb421b68f0de8084e3e6391b5cbdc"} Aug 05 17:34:55.587078 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:55.587033 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 17:34:55.587362 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:55.587128 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 17:34:55.587362 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:55.587166 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 17:34:56.594571 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:56.594534 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" event={"ID":"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c","Type":"ContainerStarted","Data":"193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c"} Aug 05 17:34:56.710221 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:56.710111 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" podStartSLOduration=2.477892459 podStartE2EDuration="6.710092822s" totalImagesPullingTime="4.232200363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:56.708387357 +0000 UTC m=+3361.193045260" watchObservedRunningTime="2026-08-05 17:34:56.710092822 +0000 UTC m=+3361.194750725" Aug 05 17:34:57.213115 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:57.213081 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:57.217861 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:57.217837 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:57.599871 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:57.599841 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:34:57.600867 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:34:57.600845 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:35:12.777746 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:12.777410 2583 patch_prober.go:28] interesting pod/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": read tcp 10.133.0.2:51916->10.133.0.54:15021: read: connection reset by peer" start-of-body= Aug 05 17:35:12.777746 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:12.777479 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": read tcp 10.133.0.2:51916->10.133.0.54:15021: read: connection reset by peer" Aug 05 17:35:13.688200 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:13.688165 2583 generic.go:356] "Generic (PLEG): container finished" podID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerID="193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c" exitCode=0 Aug 05 17:35:13.688411 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:13.688237 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" event={"ID":"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c","Type":"ContainerDied","Data":"193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c"} Aug 05 17:35:13.688652 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:13.688637 2583 scope.go:117] "RemoveContainer" containerID="193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c" Aug 05 17:35:13.689767 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:13.689740 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 17:35:13.689827 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:13.689803 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 17:35:13.689864 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:13.689833 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 17:35:14.698821 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:14.698773 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" event={"ID":"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c","Type":"ContainerStarted","Data":"69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833"} Aug 05 17:35:15.212489 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:15.212446 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:35:15.212707 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:15.212587 2583 patch_prober.go:28] interesting pod/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Aug 05 17:35:15.212707 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:15.212630 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Aug 05 17:35:16.213003 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:16.212958 2583 patch_prober.go:28] interesting pod/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Aug 05 17:35:16.213476 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:16.213025 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Aug 05 17:35:17.213083 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:17.213042 2583 patch_prober.go:28] interesting pod/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Aug 05 17:35:17.213606 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:17.213304 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Aug 05 17:35:18.212514 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:18.212460 2583 patch_prober.go:28] interesting pod/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Aug 05 17:35:18.212736 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:18.212531 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Aug 05 17:35:19.213479 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:19.213437 2583 patch_prober.go:28] interesting pod/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Aug 05 17:35:19.213956 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:19.213511 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Aug 05 17:35:20.216359 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:20.216328 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:35:20.216759 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:20.216598 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:35:20.217236 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:20.217206 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:35:41.214762 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.214730 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8"] Aug 05 17:35:41.218199 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.218183 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.220996 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.220965 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-09e18b\"/\"openshift-service-ca.crt\"" Aug 05 17:35:41.220996 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.220972 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-09e18b\"/\"kube-root-ca.crt\"" Aug 05 17:35:41.222024 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.222010 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-09e18b\"/\"default-dockercfg-lcrwd\"" Aug 05 17:35:41.222128 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.222112 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-09e18b\"/\"ipp-route-09e18b-kserve-self-signed-certs\"" Aug 05 17:35:41.229784 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.229763 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8"] Aug 05 17:35:41.282062 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.282036 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lntvh\" (UniqueName: \"kubernetes.io/projected/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-kube-api-access-lntvh\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.282248 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.282093 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-dshm\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.282248 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.282114 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-model-cache\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.282248 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.282197 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-tls-certs\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.282416 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.282275 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-home\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.282416 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.282307 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-tmp-dir\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.382797 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.382761 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lntvh\" (UniqueName: \"kubernetes.io/projected/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-kube-api-access-lntvh\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.382985 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.382819 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-dshm\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.382985 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.382845 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-model-cache\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.382985 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.382877 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-tls-certs\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.382985 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.382900 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-home\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.382985 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.382917 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-tmp-dir\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.383367 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.383342 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-model-cache\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.383367 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.383358 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-tmp-dir\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.383467 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.383389 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-home\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.385149 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.385128 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-dshm\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.385322 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.385306 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-tls-certs\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.391349 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.391324 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lntvh\" (UniqueName: \"kubernetes.io/projected/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-kube-api-access-lntvh\") pod \"ipp-route-09e18b-kserve-7f7fbdb647-8j2j8\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.527764 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.527673 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:41.663439 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.663414 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8"] Aug 05 17:35:41.665363 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:35:41.665335 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf1445c6_e393_4bb5_a0b5_c95a572b7dd6.slice/crio-fb6633d5d0302488c9ebb99d7bf30f7ade77d743cab718241c94568940a80e44 WatchSource:0}: Error finding container fb6633d5d0302488c9ebb99d7bf30f7ade77d743cab718241c94568940a80e44: Status 404 returned error can't find the container with id fb6633d5d0302488c9ebb99d7bf30f7ade77d743cab718241c94568940a80e44 Aug 05 17:35:41.841647 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.841616 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" event={"ID":"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6","Type":"ContainerStarted","Data":"e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653"} Aug 05 17:35:41.841817 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.841660 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" event={"ID":"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6","Type":"ContainerStarted","Data":"fb6633d5d0302488c9ebb99d7bf30f7ade77d743cab718241c94568940a80e44"} Aug 05 17:35:41.867076 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:41.867026 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" podStartSLOduration=0.867011247 podStartE2EDuration="867.011247ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:35:41.864145269 +0000 UTC m=+3406.348803172" watchObservedRunningTime="2026-08-05 17:35:41.867011247 +0000 UTC m=+3406.351669190" Aug 05 17:35:51.528570 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:51.528102 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:51.529242 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:51.529123 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:51.546329 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:51.546307 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:35:51.905894 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:35:51.905861 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:37:21.438184 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:21.438103 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8"] Aug 05 17:37:36.458265 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.458203 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" podUID="bf1445c6-e393-4bb5-a0b5-c95a572b7dd6" containerName="main" containerID="cri-o://e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653" gracePeriod=45 Aug 05 17:37:36.705802 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.705777 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:37:36.829289 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.829177 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-home\") pod \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " Aug 05 17:37:36.829289 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.829264 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lntvh\" (UniqueName: \"kubernetes.io/projected/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-kube-api-access-lntvh\") pod \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " Aug 05 17:37:36.829515 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.829318 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-dshm\") pod \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " Aug 05 17:37:36.829515 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.829342 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-model-cache\") pod \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " Aug 05 17:37:36.829515 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.829399 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-tls-certs\") pod \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " Aug 05 17:37:36.829515 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.829428 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-tmp-dir\") pod \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\" (UID: \"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6\") " Aug 05 17:37:36.829515 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.829479 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-home" (OuterVolumeSpecName: "home") pod "bf1445c6-e393-4bb5-a0b5-c95a572b7dd6" (UID: "bf1445c6-e393-4bb5-a0b5-c95a572b7dd6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:37:36.829738 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.829619 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-model-cache" (OuterVolumeSpecName: "model-cache") pod "bf1445c6-e393-4bb5-a0b5-c95a572b7dd6" (UID: "bf1445c6-e393-4bb5-a0b5-c95a572b7dd6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:37:36.829738 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.829714 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bf1445c6-e393-4bb5-a0b5-c95a572b7dd6" (UID: "bf1445c6-e393-4bb5-a0b5-c95a572b7dd6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:37:36.829817 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.829801 2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:37:36.829854 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.829822 2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:37:36.829854 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.829835 2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:37:36.831503 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.831474 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-kube-api-access-lntvh" (OuterVolumeSpecName: "kube-api-access-lntvh") pod "bf1445c6-e393-4bb5-a0b5-c95a572b7dd6" (UID: "bf1445c6-e393-4bb5-a0b5-c95a572b7dd6"). InnerVolumeSpecName "kube-api-access-lntvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:37:36.831503 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.831488 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-dshm" (OuterVolumeSpecName: "dshm") pod "bf1445c6-e393-4bb5-a0b5-c95a572b7dd6" (UID: "bf1445c6-e393-4bb5-a0b5-c95a572b7dd6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:37:36.831650 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.831524 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bf1445c6-e393-4bb5-a0b5-c95a572b7dd6" (UID: "bf1445c6-e393-4bb5-a0b5-c95a572b7dd6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:37:36.930349 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.930317 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lntvh\" (UniqueName: \"kubernetes.io/projected/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-kube-api-access-lntvh\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:37:36.930349 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.930343 2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:37:36.930349 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:36.930353 2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:37:37.433437 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:37.433402 2583 generic.go:356] "Generic (PLEG): container finished" podID="bf1445c6-e393-4bb5-a0b5-c95a572b7dd6" containerID="e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653" exitCode=0 Aug 05 17:37:37.433437 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:37.433441 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" event={"ID":"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6","Type":"ContainerDied","Data":"e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653"} Aug 05 17:37:37.433679 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:37.433449 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" Aug 05 17:37:37.433679 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:37.433471 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8" event={"ID":"bf1445c6-e393-4bb5-a0b5-c95a572b7dd6","Type":"ContainerDied","Data":"fb6633d5d0302488c9ebb99d7bf30f7ade77d743cab718241c94568940a80e44"} Aug 05 17:37:37.433679 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:37.433487 2583 scope.go:117] "RemoveContainer" containerID="e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653" Aug 05 17:37:37.443432 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:37.443415 2583 scope.go:117] "RemoveContainer" containerID="e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653" Aug 05 17:37:37.443698 ip-10-0-132-4 kubenswrapper[2583]: E0805 17:37:37.443680 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653\": container with ID starting with e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653 not found: ID does not exist" containerID="e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653" Aug 05 17:37:37.443746 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:37.443706 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653"} err="failed to get container status \"e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653\": rpc error: code = NotFound desc = could not find container \"e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653\": container with ID starting with e9650414d267223cbe518fa960212c4708075404ebe73a568e07b3154ecc0653 not found: ID does not exist" Aug 05 17:37:37.460905 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:37.460876 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8"] Aug 05 17:37:37.464086 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:37.464062 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-09e18b/ipp-route-09e18b-kserve-7f7fbdb647-8j2j8"] Aug 05 17:37:38.025818 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:37:38.022041 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf1445c6-e393-4bb5-a0b5-c95a572b7dd6" path="/var/lib/kubelet/pods/bf1445c6-e393-4bb5-a0b5-c95a572b7dd6/volumes" Aug 05 17:38:29.336084 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:29.336045 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d"] Aug 05 17:38:29.336719 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:29.336361 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" containerID="cri-o://69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833" gracePeriod=30 Aug 05 17:38:34.590850 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.590825 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:38:34.730144 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.730048 2583 generic.go:356] "Generic (PLEG): container finished" podID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerID="69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833" exitCode=0 Aug 05 17:38:34.730144 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.730105 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" Aug 05 17:38:34.730144 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.730125 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" event={"ID":"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c","Type":"ContainerDied","Data":"69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833"} Aug 05 17:38:34.730457 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.730175 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d" event={"ID":"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c","Type":"ContainerDied","Data":"c083409b26949001a19486b992e0824780acb421b68f0de8084e3e6391b5cbdc"} Aug 05 17:38:34.730457 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.730197 2583 scope.go:117] "RemoveContainer" containerID="69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833" Aug 05 17:38:34.739425 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.739407 2583 scope.go:117] "RemoveContainer" containerID="193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c" Aug 05 17:38:34.739935 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.739916 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-workload-certs\") pod \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " Aug 05 17:38:34.740027 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.739960 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-data\") pod \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " Aug 05 17:38:34.740027 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740006 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdw7f\" (UniqueName: \"kubernetes.io/projected/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-kube-api-access-qdw7f\") pod \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " Aug 05 17:38:34.740139 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740095 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-workload-socket\") pod \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " Aug 05 17:38:34.740139 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740126 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istiod-ca-cert\") pod \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " Aug 05 17:38:34.740305 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740152 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-envoy\") pod \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " Aug 05 17:38:34.740305 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740198 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-token\") pod \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " Aug 05 17:38:34.740305 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740208 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" (UID: "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:38:34.740305 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740252 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-credential-socket\") pod \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " Aug 05 17:38:34.740305 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740257 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" (UID: "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:38:34.740305 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740299 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-podinfo\") pod \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\" (UID: \"a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c\") " Aug 05 17:38:34.740603 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740584 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" (UID: "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:38:34.740735 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740590 2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-workload-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:38:34.740735 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740629 2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-data\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:38:34.740836 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740773 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" (UID: "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:38:34.740836 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.740786 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" (UID: "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:38:34.742733 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.742697 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" (UID: "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:38:34.742843 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.742759 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" (UID: "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 17:38:34.742906 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.742866 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" (UID: "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:38:34.743201 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.743178 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-kube-api-access-qdw7f" (OuterVolumeSpecName: "kube-api-access-qdw7f") pod "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" (UID: "a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c"). InnerVolumeSpecName "kube-api-access-qdw7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:38:34.762552 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.762525 2583 scope.go:117] "RemoveContainer" containerID="69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833" Aug 05 17:38:34.762884 ip-10-0-132-4 kubenswrapper[2583]: E0805 17:38:34.762863 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833\": container with ID starting with 69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833 not found: ID does not exist" containerID="69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833" Aug 05 17:38:34.762942 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.762892 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833"} err="failed to get container status \"69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833\": rpc error: code = NotFound desc = could not find container \"69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833\": container with ID starting with 69a16209eebf490d308d75c2db6477f778bd4eeb2a257665851e9b3d90e7f833 not found: ID does not exist" Aug 05 17:38:34.762942 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.762909 2583 scope.go:117] "RemoveContainer" containerID="193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c" Aug 05 17:38:34.763173 ip-10-0-132-4 kubenswrapper[2583]: E0805 17:38:34.763158 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c\": container with ID starting with 193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c not found: ID does not exist" containerID="193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c" Aug 05 17:38:34.763249 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.763177 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c"} err="failed to get container status \"193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c\": rpc error: code = NotFound desc = could not find container \"193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c\": container with ID starting with 193893597b60113621ff3b92a874789178584be6e484c2108589949a38030f6c not found: ID does not exist" Aug 05 17:38:34.841420 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.841387 2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-credential-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:38:34.841420 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.841412 2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-podinfo\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:38:34.841420 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.841424 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdw7f\" (UniqueName: \"kubernetes.io/projected/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-kube-api-access-qdw7f\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:38:34.841641 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.841433 2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-workload-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:38:34.841641 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.841443 2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istiod-ca-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:38:34.841641 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.841452 2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-envoy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:38:34.841641 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:34.841461 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c-istio-token\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\"" Aug 05 17:38:35.054114 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:35.054084 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d"] Aug 05 17:38:35.061251 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:35.061205 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-40374d-openshift-default-5df4b9966d-ctg7d"] Aug 05 17:38:36.020592 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:36.020563 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" path="/var/lib/kubelet/pods/a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c/volumes" Aug 05 17:38:56.259608 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:56.259578 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:38:56.266585 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:38:56.266558 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:39:06.644381 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:06.644339 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79b885fbd5-4cglt_e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c/authorino/0.log" Aug 05 17:39:12.669554 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:12.669523 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b469b89cc-t8qnr_d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a/copy-manifests/0.log" Aug 05 17:39:12.675822 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:12.675794 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b469b89cc-t8qnr_d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a/manager/0.log" Aug 05 17:39:13.011183 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:13.011100 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5fb54d6f74-wmg55_23d9e567-b3ac-435e-b081-99a7efb7fc51/maas-api/0.log" Aug 05 17:39:14.214596 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:14.214568 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79b885fbd5-4cglt_e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c/authorino/0.log" Aug 05 17:39:14.554702 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:14.554629 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-hzgts_74b21406-594b-4885-a45c-6e683b685136/kuadrant-console-plugin/0.log" Aug 05 17:39:14.888075 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:14.888044 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-f2n9g_d5507cb3-4357-4ec3-a57a-34760a0cd5bb/manager/0.log" Aug 05 17:39:15.458582 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:15.458552 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-558bb69c48-9t77z_ee73bceb-b365-49c8-965b-e09eb1157386/kube-auth-proxy/0.log" Aug 05 17:39:16.533804 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:16.533769 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-68kws_042a7159-e6b4-43f4-90af-565ca86e920b/main/0.log" Aug 05 17:39:16.985708 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:16.985680 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-g9bv8_5a67c933-5723-4390-a0fb-09955b24103e/main/0.log" Aug 05 17:39:25.500596 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:25.500562 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6pglf_0d5e3b35-ca04-44af-820a-ce5467bd445c/global-pull-secret-syncer/0.log" Aug 05 17:39:25.725513 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:25.725471 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xn7jj_d4e36102-8bf2-443b-acb5-ba26c5282f01/konnectivity-agent/0.log" Aug 05 17:39:25.778466 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:25.778370 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-4.ec2.internal_bbc2ecf91e3a14d28f59c693cc51e1f3/haproxy/0.log" Aug 05 17:39:31.015380 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:31.015352 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79b885fbd5-4cglt_e0d3cafa-fb1a-4c35-b822-1a89d4d53d4c/authorino/0.log" Aug 05 17:39:31.210983 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:31.210957 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-hzgts_74b21406-594b-4885-a45c-6e683b685136/kuadrant-console-plugin/0.log" Aug 05 17:39:31.543754 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:31.543725 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-f2n9g_d5507cb3-4357-4ec3-a57a-34760a0cd5bb/manager/0.log" Aug 05 17:39:33.562082 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:33.562053 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-8qjpj_1eb27246-de51-450d-9ca9-c30c76faa40f/cluster-monitoring-operator/0.log" Aug 05 17:39:33.942022 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:33.941989 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-wthk8_b82c97c2-2933-4968-9299-5161c15e193a/monitoring-plugin/0.log" Aug 05 17:39:33.996847 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:33.996815 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ckt42_2dee3bdb-5aa6-4fb4-8bb0-e2455471a057/node-exporter/0.log" Aug 05 17:39:34.062725 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:34.062697 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ckt42_2dee3bdb-5aa6-4fb4-8bb0-e2455471a057/kube-rbac-proxy/0.log" Aug 05 17:39:34.095676 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:34.095651 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ckt42_2dee3bdb-5aa6-4fb4-8bb0-e2455471a057/init-textfile/0.log" Aug 05 17:39:34.363324 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:34.363294 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bw5zn_8554acc7-d16c-432e-8df5-1085a795a2a4/kube-rbac-proxy-main/0.log" Aug 05 17:39:34.395743 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:34.395717 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bw5zn_8554acc7-d16c-432e-8df5-1085a795a2a4/kube-rbac-proxy-self/0.log" Aug 05 17:39:34.445778 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:34.445753 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-bw5zn_8554acc7-d16c-432e-8df5-1085a795a2a4/openshift-state-metrics/0.log" Aug 05 17:39:34.946260 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:34.946208 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-29pss_bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e/prometheus-operator/0.log" Aug 05 17:39:35.005429 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.005399 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-29pss_bb9c2e54-6cc9-46dc-8a0a-b040e2c5675e/kube-rbac-proxy/0.log" Aug 05 17:39:35.104739 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.104709 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-645867fbcd-nt6vb_82faad46-ffea-4f5a-b547-817a1ff3e884/telemeter-client/0.log" Aug 05 17:39:35.183285 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.183252 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q"] Aug 05 17:39:35.183656 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.183644 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf1445c6-e393-4bb5-a0b5-c95a572b7dd6" containerName="main" Aug 05 17:39:35.183704 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.183657 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf1445c6-e393-4bb5-a0b5-c95a572b7dd6" containerName="main" Aug 05 17:39:35.183704 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.183667 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" Aug 05 17:39:35.183704 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.183673 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" Aug 05 17:39:35.183704 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.183679 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" Aug 05 17:39:35.183704 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.183685 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" Aug 05 17:39:35.183854 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.183747 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" Aug 05 17:39:35.183854 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.183757 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e3cecb-7526-4a8c-8c7f-8f8ae3baa27c" containerName="istio-proxy" Aug 05 17:39:35.183854 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.183764 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf1445c6-e393-4bb5-a0b5-c95a572b7dd6" containerName="main" Aug 05 17:39:35.187058 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.187041 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.191242 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.191203 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w2hzf\"/\"openshift-service-ca.crt\"" Aug 05 17:39:35.192109 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.192091 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w2hzf\"/\"default-dockercfg-hjlhd\"" Aug 05 17:39:35.192261 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.192246 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w2hzf\"/\"kube-root-ca.crt\"" Aug 05 17:39:35.194968 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.194948 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-645867fbcd-nt6vb_82faad46-ffea-4f5a-b547-817a1ff3e884/reload/0.log" Aug 05 17:39:35.261784 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.261718 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q"] Aug 05 17:39:35.275776 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.275751 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h958\" (UniqueName: \"kubernetes.io/projected/437497cd-fe93-4a2c-bff0-84b137f26e36-kube-api-access-2h958\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.275911 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.275790 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/437497cd-fe93-4a2c-bff0-84b137f26e36-proc\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.275911 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.275818 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/437497cd-fe93-4a2c-bff0-84b137f26e36-lib-modules\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.275911 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.275899 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/437497cd-fe93-4a2c-bff0-84b137f26e36-sys\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.276036 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.275956 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/437497cd-fe93-4a2c-bff0-84b137f26e36-podres\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.296291 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.296269 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-645867fbcd-nt6vb_82faad46-ffea-4f5a-b547-817a1ff3e884/kube-rbac-proxy/0.log" Aug 05 17:39:35.352296 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.352274 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-597b94895-gf2vs_f110d151-f6de-4d45-8f7f-f2926dd14ff0/thanos-query/0.log" Aug 05 17:39:35.377057 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.377032 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/437497cd-fe93-4a2c-bff0-84b137f26e36-proc\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.377179 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.377071 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/437497cd-fe93-4a2c-bff0-84b137f26e36-lib-modules\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.377179 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.377094 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/437497cd-fe93-4a2c-bff0-84b137f26e36-sys\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.377179 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.377152 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/437497cd-fe93-4a2c-bff0-84b137f26e36-sys\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.377179 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.377160 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/437497cd-fe93-4a2c-bff0-84b137f26e36-proc\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.377410 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.377193 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/437497cd-fe93-4a2c-bff0-84b137f26e36-podres\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.377410 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.377207 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/437497cd-fe93-4a2c-bff0-84b137f26e36-lib-modules\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.377410 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.377290 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/437497cd-fe93-4a2c-bff0-84b137f26e36-podres\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.377410 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.377295 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h958\" (UniqueName: \"kubernetes.io/projected/437497cd-fe93-4a2c-bff0-84b137f26e36-kube-api-access-2h958\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.404065 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.404035 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h958\" (UniqueName: \"kubernetes.io/projected/437497cd-fe93-4a2c-bff0-84b137f26e36-kube-api-access-2h958\") pod \"perf-node-gather-daemonset-4tr6q\" (UID: \"437497cd-fe93-4a2c-bff0-84b137f26e36\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.430012 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.429989 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-597b94895-gf2vs_f110d151-f6de-4d45-8f7f-f2926dd14ff0/kube-rbac-proxy-web/0.log" Aug 05 17:39:35.487354 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.487330 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-597b94895-gf2vs_f110d151-f6de-4d45-8f7f-f2926dd14ff0/kube-rbac-proxy/0.log" Aug 05 17:39:35.497806 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.497780 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:35.532005 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.531927 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-597b94895-gf2vs_f110d151-f6de-4d45-8f7f-f2926dd14ff0/prom-label-proxy/0.log" Aug 05 17:39:35.568101 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.568079 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-597b94895-gf2vs_f110d151-f6de-4d45-8f7f-f2926dd14ff0/kube-rbac-proxy-rules/0.log" Aug 05 17:39:35.638590 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.638561 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-597b94895-gf2vs_f110d151-f6de-4d45-8f7f-f2926dd14ff0/kube-rbac-proxy-metrics/0.log" Aug 05 17:39:35.647513 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:35.647493 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q"] Aug 05 17:39:35.649237 ip-10-0-132-4 kubenswrapper[2583]: W0805 17:39:35.649202 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod437497cd_fe93_4a2c_bff0_84b137f26e36.slice/crio-7d11a03cc725f5302aa9ffee6663d16d9ff368ebe56701b46af3f763386cd44b WatchSource:0}: Error finding container 7d11a03cc725f5302aa9ffee6663d16d9ff368ebe56701b46af3f763386cd44b: Status 404 returned error can't find the container with id 7d11a03cc725f5302aa9ffee6663d16d9ff368ebe56701b46af3f763386cd44b Aug 05 17:39:36.033339 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:36.033309 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" event={"ID":"437497cd-fe93-4a2c-bff0-84b137f26e36","Type":"ContainerStarted","Data":"a79ffa0485fc64ed3f17ab16ef7e688f1c2655d1f29797167f7dc401a3d309d2"} Aug 05 17:39:36.033707 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:36.033354 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" event={"ID":"437497cd-fe93-4a2c-bff0-84b137f26e36","Type":"ContainerStarted","Data":"7d11a03cc725f5302aa9ffee6663d16d9ff368ebe56701b46af3f763386cd44b"} Aug 05 17:39:36.033707 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:36.033450 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:36.062028 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:36.061944 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" podStartSLOduration=1.061926886 podStartE2EDuration="1.061926886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:39:36.060139237 +0000 UTC m=+3640.544797140" watchObservedRunningTime="2026-08-05 17:39:36.061926886 +0000 UTC m=+3640.546584791" Aug 05 17:39:36.877702 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:36.877671 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-8grqn_77f7cb9f-0392-411e-8f7d-3df14a5a1faf/networking-console-plugin/0.log" Aug 05 17:39:37.481325 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:37.481299 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/2.log" Aug 05 17:39:37.484903 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:37.484882 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-29j7x_297b8597-8acf-413e-b72b-9da7dc7abf60/console-operator/3.log" Aug 05 17:39:38.018012 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:38.017982 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9f869d5c5-vjtxc_d5f5c3e3-6ed2-4823-9151-e281b3120971/console/0.log" Aug 05 17:39:38.057588 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:38.057559 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-62pb9_984e95d2-f85a-4c81-a6a0-4f766eaf8c48/download-server/0.log" Aug 05 17:39:38.758365 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:38.758334 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-rrqd6_5daf1970-c202-45b1-89b4-b80a90db4997/volume-data-source-validator/0.log" Aug 05 17:39:40.488301 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:40.488270 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmj89_e95720f1-0e6c-48d4-971d-1f8b080b55fc/dns/0.log" Aug 05 17:39:40.543554 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:40.543531 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmj89_e95720f1-0e6c-48d4-971d-1f8b080b55fc/kube-rbac-proxy/0.log" Aug 05 17:39:40.636317 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:40.636283 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m846k_9df7d7c5-95a4-444e-a727-8a7f8a65be2e/dns-node-resolver/0.log" Aug 05 17:39:41.532681 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:41.532651 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ghgcw_3a4923c1-abcf-4998-9757-d6753a11e98a/node-ca/0.log" Aug 05 17:39:42.048939 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:42.048913 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-4tr6q" Aug 05 17:39:43.037160 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:43.037130 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-558bb69c48-9t77z_ee73bceb-b365-49c8-965b-e09eb1157386/kube-auth-proxy/0.log" Aug 05 17:39:44.243351 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:44.243327 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9tkn4_b28faef1-bf15-45a5-8eb9-6cf946def73a/serve-healthcheck-canary/0.log" Aug 05 17:39:45.023501 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:45.023384 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l5nhf_1cbdef18-b929-4459-bee9-2f32bb2716b8/kube-rbac-proxy/0.log" Aug 05 17:39:45.051746 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:45.051723 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l5nhf_1cbdef18-b929-4459-bee9-2f32bb2716b8/exporter/0.log" Aug 05 17:39:45.077776 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:45.077747 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l5nhf_1cbdef18-b929-4459-bee9-2f32bb2716b8/extractor/0.log" Aug 05 17:39:46.375417 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:46.375388 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-558bb69c48-9t77z_ee73bceb-b365-49c8-965b-e09eb1157386/kube-auth-proxy/0.log" Aug 05 17:39:48.254904 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:48.254874 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-558bb69c48-9t77z_ee73bceb-b365-49c8-965b-e09eb1157386/kube-auth-proxy/0.log" Aug 05 17:39:48.504518 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:48.504489 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b469b89cc-t8qnr_d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a/manager/0.log" Aug 05 17:39:48.523824 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:48.523754 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b469b89cc-t8qnr_d08b4b0c-8deb-4356-9bcd-e0fc6cafe29a/copy-manifests/0.log" Aug 05 17:39:49.711180 ip-10-0-132-4 kubenswrapper[2583]: I0805 17:39:49.711152 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-598789449f-tpzrl_75c38173-cc3f-4614-82f6-2b7b6260a610/manager/0.log"