Nov 04 04:45:05.975569 ip-10-0-132-197 systemd[1]: Starting Kubernetes Kubelet... Nov 04 04:45:06.434983 ip-10-0-132-197 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 04:45:06.434983 ip-10-0-132-197 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 04:45:06.434983 ip-10-0-132-197 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 04:45:06.434983 ip-10-0-132-197 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 04:45:06.438159 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438086 2573 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:06.438159 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438159 2573 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438164 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438167 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438170 2573 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438173 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438176 2573 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438180 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438184 2573 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438188 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438191 2573 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438194 2573 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438201 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438204 2573 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438207 2573 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438209 2573 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438212 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438215 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438217 2573 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438220 2573 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:06.438225 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438223 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438225 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438228 2573 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438231 2573 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438234 2573 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438237 2573 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438240 2573 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438242 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438245 2573 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438247 2573 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438250 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438253 2573 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438255 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438271 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438274 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438277 2573 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438279 2573 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438282 2573 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438285 2573 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438287 2573 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:06.438678 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438290 2573 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438294 2573 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438298 2573 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438302 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438306 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438309 2573 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438311 2573 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438314 2573 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438317 2573 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438320 2573 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438323 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438325 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438328 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438331 2573 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438334 2573 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438337 2573 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438339 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438342 2573 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438345 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:06.439188 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438347 2573 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438350 2573 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438353 2573 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438355 2573 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438358 2573 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438360 2573 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438363 2573 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438366 2573 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438368 2573 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438371 2573 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438373 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438376 2573 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438378 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438381 2573 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438384 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438386 2573 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438389 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438391 2573 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438394 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438396 2573 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:06.439644 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438398 2573 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438401 2573 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438403 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438406 2573 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438409 2573 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438412 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438415 2573 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438418 2573 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438420 2573 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438423 2573 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438426 2573 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438429 2573 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438435 2573 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438438 2573 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438441 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438443 2573 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438446 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438448 2573 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438451 2573 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:06.440101 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438454 2573 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:06.440575 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438456 2573 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:06.440575 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438460 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:06.440575 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438463 2573 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:06.440575 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438465 2573 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:06.440575 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438468 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:06.440575 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438471 2573 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:06.440575 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.438473 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:06.440867 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440854 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:06.440867 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440865 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440869 2573 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440872 2573 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440874 2573 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440877 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440880 2573 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440883 2573 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440885 2573 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440888 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440891 2573 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440893 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440896 2573 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440898 2573 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440901 2573 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440904 2573 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440907 2573 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440910 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440912 2573 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440915 2573 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:06.440923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440918 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440920 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440923 2573 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440926 2573 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440929 2573 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440932 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440937 2573 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440941 2573 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440944 2573 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440948 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440951 2573 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440954 2573 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440957 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440959 2573 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440962 2573 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440965 2573 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440968 2573 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440970 2573 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440973 2573 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:06.441478 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440975 2573 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440978 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440980 2573 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440983 2573 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440986 2573 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440988 2573 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440991 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440993 2573 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440997 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.440999 2573 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441002 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441004 2573 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441007 2573 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441009 2573 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441012 2573 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441015 2573 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441018 2573 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441021 2573 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441023 2573 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441027 2573 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:06.441962 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441029 2573 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441032 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441035 2573 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441038 2573 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441040 2573 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441043 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441045 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441048 2573 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441051 2573 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441053 2573 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441056 2573 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441058 2573 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441061 2573 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441063 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441066 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441068 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441071 2573 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441073 2573 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441076 2573 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:06.442451 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441079 2573 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441081 2573 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441084 2573 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441087 2573 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441089 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441092 2573 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441095 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441097 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441100 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441103 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441106 2573 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441108 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441111 2573 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441114 2573 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441116 2573 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441119 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441121 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441124 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441126 2573 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441129 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:06.442897 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441131 2573 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441134 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441137 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441141 2573 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441145 2573 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441148 2573 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441151 2573 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441153 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441637 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441643 2573 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441646 2573 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441649 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441651 2573 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441655 2573 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441657 2573 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441660 2573 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441663 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441665 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:06.443379 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441668 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441670 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441674 2573 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441677 2573 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441679 2573 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441682 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441685 2573 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441688 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441691 2573 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441693 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441696 2573 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441698 2573 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441701 2573 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441703 2573 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441706 2573 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441709 2573 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441711 2573 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441714 2573 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441716 2573 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441719 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:06.443800 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441722 2573 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441725 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441727 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441730 2573 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441732 2573 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441735 2573 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441738 2573 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441741 2573 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441743 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441746 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441749 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441751 2573 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441754 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441756 2573 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441759 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441762 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441764 2573 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441767 2573 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441769 2573 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:06.444275 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441772 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441775 2573 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441778 2573 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441781 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441783 2573 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441786 2573 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441788 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441791 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441793 2573 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441796 2573 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441798 2573 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441801 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441804 2573 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441806 2573 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441809 2573 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441811 2573 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441814 2573 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441816 2573 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441819 2573 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:06.444729 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441824 2573 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441828 2573 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441831 2573 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441834 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441836 2573 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441839 2573 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441841 2573 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441844 2573 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441847 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441849 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441852 2573 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441855 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441857 2573 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441860 2573 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441862 2573 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441865 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441868 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441870 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441873 2573 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441875 2573 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:06.445176 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441878 2573 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441880 2573 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441883 2573 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441886 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441888 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441891 2573 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441893 2573 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441896 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441899 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441901 2573 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441904 2573 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441906 2573 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441909 2573 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441911 2573 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441914 2573 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441916 2573 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441921 2573 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.441924 2573 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442008 2573 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442018 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442024 2573 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 04:45:06.445658 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442029 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442033 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442037 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442041 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442045 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442049 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442052 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442056 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442060 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442063 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442066 2573 flags.go:64] FLAG: --cgroup-root="" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442069 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442072 2573 flags.go:64] FLAG: --client-ca-file="" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442075 2573 flags.go:64] FLAG: --cloud-provider="external" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442078 2573 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442082 2573 flags.go:64] FLAG: --cluster-domain="" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442085 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442088 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442091 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442095 2573 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442099 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442102 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442105 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 04:45:06.446153 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442108 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442111 2573 flags.go:64] FLAG: --contention-profiling="false" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442115 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442118 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442121 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442124 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442128 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442131 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442134 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442137 2573 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442140 2573 flags.go:64] FLAG: --enable-server="true" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442143 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442147 2573 flags.go:64] FLAG: --event-burst="100" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442150 2573 flags.go:64] FLAG: --event-qps="50" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442153 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442156 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442159 2573 flags.go:64] FLAG: --eviction-hard="" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442164 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442167 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442170 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442173 2573 flags.go:64] FLAG: --eviction-soft="" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442176 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442179 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442182 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442185 2573 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 04:45:06.446693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442188 2573 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442190 2573 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442193 2573 flags.go:64] FLAG: --feature-gates="" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442197 2573 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442200 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442203 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442206 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442211 2573 flags.go:64] FLAG: --healthz-port="10248" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442215 2573 flags.go:64] FLAG: --help="false" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442217 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442221 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442224 2573 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442227 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442231 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442234 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442237 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442240 2573 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442243 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442246 2573 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442249 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442252 2573 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442255 2573 flags.go:64] FLAG: --kube-reserved="" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442269 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442273 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 04:45:06.447349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442276 2573 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442280 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442283 2573 flags.go:64] FLAG: --lock-file="" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442286 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442289 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442292 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442297 2573 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442300 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442303 2573 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442306 2573 flags.go:64] FLAG: --logging-format="text" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442309 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442313 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442315 2573 flags.go:64] FLAG: --manifest-url="" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442318 2573 flags.go:64] FLAG: --manifest-url-header="" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442322 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442327 2573 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442330 2573 flags.go:64] FLAG: --max-pods="110" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442333 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442336 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442339 2573 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442343 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442346 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442349 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442352 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442358 2573 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 04:45:06.447936 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442361 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442364 2573 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442367 2573 flags.go:64] FLAG: --pod-cidr="" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442371 2573 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442373 2573 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442376 2573 flags.go:64] FLAG: --pods-per-core="0" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442379 2573 flags.go:64] FLAG: --port="10250" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442383 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442385 2573 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-00ffcc9d648dd10a7" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442389 2573 flags.go:64] FLAG: --qos-reserved="" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442392 2573 flags.go:64] FLAG: --read-only-port="10255" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442395 2573 flags.go:64] FLAG: --register-node="true" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442398 2573 flags.go:64] FLAG: --register-with-taints="" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442401 2573 flags.go:64] FLAG: --registry-burst="10" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442404 2573 flags.go:64] FLAG: --registry-qps="5" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442407 2573 flags.go:64] FLAG: --reserved-cpus="" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442410 2573 flags.go:64] FLAG: --reserved-memory="" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442414 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442417 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442420 2573 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442423 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442426 2573 flags.go:64] FLAG: --runonce="false" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442430 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442434 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442436 2573 flags.go:64] FLAG: --seccomp-default="false" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442439 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442442 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 04:45:06.448747 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442445 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442448 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442451 2573 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442454 2573 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442458 2573 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442461 2573 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442464 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442467 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442470 2573 flags.go:64] FLAG: --system-cgroups="" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442473 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442478 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442481 2573 flags.go:64] FLAG: --tls-cert-file="" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442483 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442487 2573 flags.go:64] FLAG: --tls-min-version="" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442490 2573 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442493 2573 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442496 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442499 2573 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442502 2573 flags.go:64] FLAG: --v="2" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442507 2573 flags.go:64] FLAG: --version="false" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442511 2573 flags.go:64] FLAG: --vmodule="" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442516 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442519 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442649 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:06.449882 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442653 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442656 2573 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442659 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442663 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442665 2573 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442668 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442670 2573 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442673 2573 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442676 2573 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442678 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442681 2573 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442683 2573 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442686 2573 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442689 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442691 2573 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442694 2573 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442697 2573 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442699 2573 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442702 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:06.450763 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442705 2573 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442707 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442710 2573 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442713 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442715 2573 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442718 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442721 2573 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442723 2573 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442726 2573 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442729 2573 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442733 2573 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442736 2573 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442739 2573 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442741 2573 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442744 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442746 2573 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442749 2573 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442752 2573 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442754 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442756 2573 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:06.451407 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442759 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442762 2573 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442764 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442767 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442770 2573 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442772 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442774 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442777 2573 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442779 2573 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442782 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442785 2573 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442787 2573 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442789 2573 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442792 2573 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442794 2573 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442797 2573 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442799 2573 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442802 2573 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442805 2573 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442808 2573 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:06.451925 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442811 2573 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442814 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442819 2573 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442821 2573 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442824 2573 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442826 2573 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442829 2573 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442833 2573 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442837 2573 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442840 2573 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442843 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442845 2573 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442848 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442850 2573 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442853 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442855 2573 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442858 2573 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442861 2573 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442863 2573 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:06.452471 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442866 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442868 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442871 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442873 2573 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442876 2573 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442878 2573 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442881 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442883 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442886 2573 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442890 2573 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442893 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442896 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442900 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442903 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442906 2573 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442910 2573 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442912 2573 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442915 2573 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442918 2573 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:06.452923 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442921 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442923 2573 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442926 2573 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442928 2573 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442931 2573 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442933 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442936 2573 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442938 2573 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.442964 2573 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.442999 2573 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443003 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443007 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443010 2573 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443013 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443015 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443018 2573 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:06.453388 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443021 2573 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443023 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443026 2573 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443029 2573 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443031 2573 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443034 2573 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443036 2573 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443039 2573 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443042 2573 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443045 2573 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443052 2573 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443055 2573 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443057 2573 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443061 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443064 2573 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443067 2573 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443069 2573 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443072 2573 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443075 2573 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443079 2573 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:06.453760 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443083 2573 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443086 2573 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443089 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443092 2573 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443094 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443097 2573 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443099 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443102 2573 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443105 2573 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443107 2573 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443110 2573 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443112 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443115 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443117 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443120 2573 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443122 2573 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443125 2573 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443128 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443130 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:06.454236 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443133 2573 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443141 2573 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443144 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443147 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443151 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443153 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443157 2573 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443160 2573 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443162 2573 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443165 2573 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443168 2573 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443170 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443173 2573 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443176 2573 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443178 2573 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443181 2573 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443183 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443186 2573 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443188 2573 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:06.454693 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443191 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443193 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443196 2573 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443198 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443201 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443203 2573 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443206 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443208 2573 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443211 2573 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443213 2573 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443216 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443218 2573 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443221 2573 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443223 2573 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443227 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443230 2573 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443232 2573 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443235 2573 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443240 2573 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:06.455148 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443245 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443247 2573 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443250 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443252 2573 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443255 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443258 2573 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443277 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443281 2573 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443286 2573 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443290 2573 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443294 2573 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443297 2573 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443300 2573 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443304 2573 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443307 2573 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443309 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443312 2573 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443315 2573 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443317 2573 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443319 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:06.455598 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443322 2573 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.443325 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.452354 2573 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.452369 2573 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.453103 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.453110 2573 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453166 2573 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453171 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453174 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453178 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453182 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453185 2573 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453188 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453192 2573 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453197 2573 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453200 2573 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453203 2573 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453206 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453210 2573 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:06.456069 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453213 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453216 2573 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453219 2573 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453221 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453224 2573 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453226 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453229 2573 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453232 2573 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453234 2573 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453237 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453239 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453242 2573 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453245 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453248 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453251 2573 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453253 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453256 2573 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453274 2573 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453277 2573 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453280 2573 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:06.456533 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453282 2573 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453285 2573 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453288 2573 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453290 2573 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453293 2573 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453296 2573 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453299 2573 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453301 2573 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453304 2573 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453306 2573 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453309 2573 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453311 2573 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453314 2573 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453317 2573 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453320 2573 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453322 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453325 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453333 2573 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453335 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453339 2573 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:06.457034 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453342 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453345 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453348 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453350 2573 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453353 2573 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453356 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453358 2573 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453361 2573 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453364 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453366 2573 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453369 2573 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453372 2573 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453374 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453377 2573 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453379 2573 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453382 2573 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453385 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453387 2573 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453390 2573 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453392 2573 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:06.457511 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453395 2573 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453398 2573 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453400 2573 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453403 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453406 2573 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453409 2573 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453412 2573 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453414 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453417 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453420 2573 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453422 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453425 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453428 2573 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453430 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453433 2573 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453436 2573 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453438 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453441 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453443 2573 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:06.457973 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453446 2573 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453449 2573 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453452 2573 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453456 2573 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453460 2573 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453463 2573 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453466 2573 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453469 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453472 2573 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453474 2573 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453477 2573 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453479 2573 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453482 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453484 2573 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.453513 2573 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453670 2573 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:06.458524 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453677 2573 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453680 2573 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453683 2573 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453686 2573 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453689 2573 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453692 2573 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453695 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453697 2573 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453700 2573 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453702 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453705 2573 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453708 2573 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453710 2573 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453713 2573 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453715 2573 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453718 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453720 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453723 2573 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453726 2573 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453728 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:06.458900 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453731 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453734 2573 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453736 2573 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453739 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453742 2573 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453745 2573 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453747 2573 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453750 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453752 2573 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453754 2573 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453757 2573 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453760 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453762 2573 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453765 2573 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453768 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453770 2573 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453773 2573 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453776 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453779 2573 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453782 2573 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:06.459376 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453784 2573 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453789 2573 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453793 2573 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453796 2573 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453799 2573 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453802 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453804 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453808 2573 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453811 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453814 2573 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453817 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453820 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453822 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453825 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453828 2573 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453830 2573 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453833 2573 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453835 2573 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453838 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:06.459835 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453841 2573 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453843 2573 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453845 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453848 2573 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453850 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453853 2573 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453855 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453858 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453860 2573 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453863 2573 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453865 2573 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453869 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453871 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453874 2573 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453877 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453879 2573 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453882 2573 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453884 2573 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453887 2573 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:06.460331 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453889 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453892 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453895 2573 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453897 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453900 2573 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453903 2573 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453905 2573 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453908 2573 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453910 2573 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453913 2573 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453916 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453918 2573 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453921 2573 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453923 2573 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453926 2573 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453928 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453931 2573 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453934 2573 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453936 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453939 2573 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:06.460775 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453942 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453944 2573 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453947 2573 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453949 2573 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453952 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453956 2573 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.453959 2573 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.453982 2573 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454012 2573 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454017 2573 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454020 2573 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454023 2573 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454025 2573 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454028 2573 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454030 2573 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454033 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:06.461272 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454035 2573 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454038 2573 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454040 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454043 2573 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454045 2573 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454048 2573 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454051 2573 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454053 2573 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454055 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454058 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454060 2573 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454063 2573 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454065 2573 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454068 2573 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454070 2573 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454073 2573 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454076 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454078 2573 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454081 2573 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454083 2573 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:06.461635 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454086 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454088 2573 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454092 2573 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454094 2573 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454097 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454099 2573 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454102 2573 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454105 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454107 2573 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454110 2573 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454112 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454115 2573 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454118 2573 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454120 2573 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454124 2573 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454128 2573 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454131 2573 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454134 2573 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454137 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:06.462086 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454139 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454143 2573 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454146 2573 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454149 2573 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454152 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454155 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454157 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454160 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454164 2573 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454166 2573 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454169 2573 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454171 2573 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454178 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454181 2573 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454183 2573 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454186 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454189 2573 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454192 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454194 2573 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:06.462573 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454197 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454199 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454202 2573 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454205 2573 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454207 2573 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454210 2573 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454213 2573 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454215 2573 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454218 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454220 2573 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454223 2573 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454225 2573 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454228 2573 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454231 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454233 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454236 2573 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454238 2573 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454241 2573 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454244 2573 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454248 2573 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:06.463002 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454251 2573 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454253 2573 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454256 2573 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454272 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454275 2573 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454279 2573 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454282 2573 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454285 2573 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454287 2573 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454290 2573 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454293 2573 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454296 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454299 2573 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454302 2573 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454305 2573 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454307 2573 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454310 2573 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454314 2573 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454316 2573 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:06.463520 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:06.454319 2573 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:06.463960 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.454370 2573 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 04:45:06.463960 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.456934 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 04 04:45:06.463960 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.457857 2573 server.go:1014] "Starting client certificate rotation" Nov 04 04:45:06.463960 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.457946 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 04:45:06.463960 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.457980 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 04:45:06.463960 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.460293 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 04:45:06.463960 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.462269 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 04:45:06.475383 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.475367 2573 log.go:25] "Validated CRI v1 runtime API" Nov 04 04:45:06.479063 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.479046 2573 log.go:25] "Validated CRI v1 image API" Nov 04 04:45:06.479934 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.479902 2573 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 04:45:06.485944 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.485922 2573 fs.go:135] Filesystem UUIDs: map[2595e2a5-5f0d-4407-93e3-5d4cb7f282bd:/dev/nvme0n1p4 76e86ad0-fd3e-4ae8-b6e6-b9f0746d0493:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Nov 04 04:45:06.485990 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.485945 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 04 04:45:06.492625 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.492514 2573 manager.go:217] Machine: {Timestamp:2026-11-04 04:45:06.490956165 +0000 UTC m=+0.380985586 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499996 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec201e640063449dadeacac160a9e71e SystemUUID:ec201e64-0063-449d-adea-cac160a9e71e BootID:5fcc7dee-162a-45be-8d40-8d9d612a56b0 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:e8:3d:7b:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:e8:3d:7b:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:ce:e9:11:8b:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 04:45:06.493404 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.493393 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 04:45:06.493509 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.493498 2573 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 04:45:06.495455 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.495436 2573 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 04:45:06.495595 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.495456 2573 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-197.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 04:45:06.495640 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.495600 2573 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 04:45:06.495640 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.495612 2573 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 04:45:06.495692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.495646 2573 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 04:45:06.495692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.495663 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 04:45:06.496632 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.496622 2573 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 04:45:06.501091 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.501080 2573 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 04:45:06.501217 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.501208 2573 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 04:45:06.502028 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.502014 2573 kubelet.go:493] "Attempting to sync node with API server" Nov 04 04:45:06.502058 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.502035 2573 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 04:45:06.502058 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.502045 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 04:45:06.502058 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.502053 2573 kubelet.go:405] "Adding apiserver pod source" Nov 04 04:45:06.502150 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.502061 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 04:45:06.502706 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.502686 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 04:45:06.507020 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.507001 2573 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 04:45:06.512382 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.512370 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 04:45:06.513537 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.513525 2573 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 04:45:06.513572 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.513555 2573 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 04:45:06.513707 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.513697 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 04:45:06.513735 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.513714 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 04:45:06.513735 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.513720 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 04:45:06.513735 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.513726 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 04:45:06.513735 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.513732 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 04:45:06.513836 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.513737 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 04:45:06.514515 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.514507 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 04:45:06.514544 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.514517 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 04:45:06.514544 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.514524 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 04:45:06.514544 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.514530 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 04:45:06.514544 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.514539 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 04:45:06.514666 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.514547 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 04:45:06.515396 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.515386 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 04:45:06.515429 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.515399 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 04:45:06.519188 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.519175 2573 server.go:1263] "Started kubelet" Nov 04 04:45:06.519286 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.519216 2573 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 04:45:06.519374 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.519321 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 04:45:06.519405 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.519397 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 04:45:06.519842 ip-10-0-132-197 systemd[1]: Started Kubernetes Kubelet. Nov 04 04:45:06.521116 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.520551 2573 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 04:45:06.523823 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.523807 2573 server.go:317] "Adding debug handlers to kubelet server" Nov 04 04:45:06.526437 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.526418 2573 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 04 04:45:06.528955 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.528938 2573 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 04:45:06.529039 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.528959 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 04:45:06.529039 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.529018 2573 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-197.us-west-2.compute.internal\" not found" Nov 04 04:45:06.529662 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.529640 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 04:45:06.529774 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.529762 2573 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 04:45:06.529774 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.529775 2573 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 04:45:06.529869 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.529859 2573 reconstruct.go:97] "Volume reconstruction finished" Nov 04 04:45:06.529869 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.529864 2573 reconciler.go:29] "Reconciler: start to sync state" Nov 04 04:45:06.529970 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.529877 2573 factory.go:55] Registering systemd factory Nov 04 04:45:06.529970 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.529893 2573 factory.go:223] Registration of the systemd container factory successfully Nov 04 04:45:06.530124 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.530111 2573 factory.go:153] Registering CRI-O factory Nov 04 04:45:06.530178 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.530126 2573 factory.go:223] Registration of the crio container factory successfully Nov 04 04:45:06.530178 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.530170 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 04:45:06.530327 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.530187 2573 factory.go:103] Registering Raw factory Nov 04 04:45:06.530327 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.530203 2573 manager.go:1199] Started watching for new ooms in manager Nov 04 04:45:06.531254 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.531238 2573 manager.go:319] Starting recovery of all containers Nov 04 04:45:06.545934 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.545917 2573 manager.go:324] Recovery completed Nov 04 04:45:06.549982 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.549965 2573 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:06.551582 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.551563 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:06.551668 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.551599 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:06.551668 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.551614 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:06.552193 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.552179 2573 cpu_manager.go:226] "Starting" policy="none" Nov 04 04:45:06.552193 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.552191 2573 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 04:45:06.552283 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.552200 2573 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:06.552283 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.552209 2573 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 04:45:06.553978 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.553956 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:06.554048 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.553996 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:06.554048 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.554013 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:06.554653 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.554640 2573 policy_none.go:50] "Start" Nov 04 04:45:06.554693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.554658 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 04:45:06.554693 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.554675 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 04:45:06.556775 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.556762 2573 policy_none.go:44] "Start" Nov 04 04:45:06.598801 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.598768 2573 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 04:45:06.601093 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.601079 2573 manager.go:341] "Starting Device Plugin manager" Nov 04 04:45:06.601173 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.601108 2573 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 04:45:06.601173 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.601119 2573 server.go:87] "Starting device plugin registration server" Nov 04 04:45:06.601496 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.601362 2573 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 04:45:06.601496 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.601377 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 04:45:06.601496 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.601472 2573 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 04:45:06.601684 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.601570 2573 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 04:45:06.601684 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.601612 2573 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 04:45:06.602113 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.602094 2573 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 04:45:06.602233 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.602138 2573 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-197.us-west-2.compute.internal\" not found" Nov 04 04:45:06.661854 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.661823 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-197.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 04 04:45:06.661854 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.661837 2573 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-197.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 04 04:45:06.672244 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.672217 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 04:45:06.673859 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.673843 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 04:45:06.673922 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.673865 2573 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 04:45:06.673922 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.673887 2573 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 04:45:06.673922 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.673917 2573 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 04 04:45:06.701624 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.701559 2573 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:06.702326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.702310 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:06.702414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.702343 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:06.702414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.702359 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:06.702414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.702390 2573 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:06.708918 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.708062 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-197.us-west-2.compute.internal.18e4be0b1bb6491b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-197.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-197.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 04:45:06.519148827 +0000 UTC m=+0.409178238,LastTimestamp:2026-11-04 04:45:06.519148827 +0000 UTC m=+0.409178238,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-197.us-west-2.compute.internal,}" Nov 04 04:45:06.717200 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.717169 2573 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Nov 04 04:45:06.717200 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.717174 2573 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Nov 04 04:45:06.719103 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.719076 2573 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 04:45:06.719186 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.719118 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9wngj" Nov 04 04:45:06.774783 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.774753 2573 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal"] Nov 04 04:45:06.774861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.774816 2573 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:06.775770 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.775754 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:06.775830 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.775783 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:06.775830 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.775793 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:06.777802 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.777782 2573 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:06.777962 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.777948 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:06.778017 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.777982 2573 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:06.778526 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.778511 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:06.778590 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.778539 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:06.778590 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.778548 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:06.778651 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.778511 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:06.778651 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.778624 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:06.778651 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.778636 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:06.780401 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.780384 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:06.780515 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.780409 2573 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:06.781034 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.781020 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:06.781098 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.781045 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:06.781098 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.781055 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:06.801954 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.801939 2573 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-197.us-west-2.compute.internal\" not found" node="ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:06.804683 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.804666 2573 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-197.us-west-2.compute.internal\" not found" node="ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:06.832559 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.832539 2573 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:45:06.833639 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.833627 2573 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:45:06.838456 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.838444 2573 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:06.838500 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:06.838462 2573 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-197.us-west-2.compute.internal\": node \"ip-10-0-132-197.us-west-2.compute.internal\" not found" Nov 04 04:45:06.929630 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.929609 2573 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:06.930761 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.930745 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1de2404c5cc3fbadf16c719910f8d787-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"1de2404c5cc3fbadf16c719910f8d787\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:06.930808 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.930771 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c77202defc6f17821d20368d232c24c4-config\") pod \"kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"c77202defc6f17821d20368d232c24c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:06.930808 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:06.930789 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1de2404c5cc3fbadf16c719910f8d787-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"1de2404c5cc3fbadf16c719910f8d787\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:07.031854 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.031793 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1de2404c5cc3fbadf16c719910f8d787-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"1de2404c5cc3fbadf16c719910f8d787\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:07.031854 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.031813 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1de2404c5cc3fbadf16c719910f8d787-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"1de2404c5cc3fbadf16c719910f8d787\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:07.031854 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.031830 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1de2404c5cc3fbadf16c719910f8d787-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"1de2404c5cc3fbadf16c719910f8d787\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:07.032024 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.031872 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1de2404c5cc3fbadf16c719910f8d787-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"1de2404c5cc3fbadf16c719910f8d787\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:07.032024 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.031883 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c77202defc6f17821d20368d232c24c4-config\") pod \"kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"c77202defc6f17821d20368d232c24c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:07.032024 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.031891 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c77202defc6f17821d20368d232c24c4-config\") pod \"kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"c77202defc6f17821d20368d232c24c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:07.052591 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.052575 2573 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 04:45:07.054365 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.054351 2573 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:07.106429 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.106408 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:07.108558 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.108544 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:07.149126 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.149109 2573 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 04:45:07.457804 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.457778 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 04 04:45:07.458227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.457925 2573 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 04 04:45:07.458227 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:07.457960 2573 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://afa22c3b1a41d46a3a14deb84ca41375-9501ff5f8f77d258.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-132-197.us-west-2.compute.internal.18e4be0b1da5c0ca\": read tcp 10.0.132.197:43738->3.22.197.16:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-132-197.us-west-2.compute.internal.18e4be0b1da5c0ca default 4831 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-197.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-197.us-west-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-197.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 04:45:06 +0000 UTC,LastTimestamp:2026-11-04 04:45:06.702364274 +0000 UTC m=+0.592393688,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-197.us-west-2.compute.internal,}" Nov 04 04:45:07.503763 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.503741 2573 apiserver.go:52] "Watching apiserver" Nov 04 04:45:07.530025 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.530009 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 04 04:45:07.725115 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.725028 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 04:40:06 +0000 UTC" deadline="2028-08-09 04:49:15.282992212 +0000 UTC" Nov 04 04:45:07.725115 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.725069 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15456h4m7.557925566s" Nov 04 04:45:07.788342 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.788317 2573 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 04:45:07.788672 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.788656 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal","openshift-multus/multus-bmvjp","openshift-multus/network-metrics-daemon-d25j9","kube-system/global-pull-secret-syncer-cnvdz","kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal","openshift-dns/node-resolver-vjj7q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4","openshift-cluster-node-tuning-operator/tuned-rrnq6","openshift-network-diagnostics/network-check-target-f7dtz","openshift-multus/multus-additional-cni-plugins-j5j9g","openshift-network-operator/iptables-alerter-8rtt2","openshift-ovn-kubernetes/ovnkube-node-8mrwd","kube-system/konnectivity-agent-qkwm9","openshift-image-registry/node-ca-f66bz"] Nov 04 04:45:07.791073 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.791054 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.792860 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.792843 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.794804 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.794785 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:07.794876 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:07.794847 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:07.796716 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.796699 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:07.798731 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.798716 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:07.798815 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:07.798759 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:07.800735 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.800720 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.802755 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.802740 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:07.805071 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.805049 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.809550 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.809270 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:07.812007 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.811989 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.814159 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.814142 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:07.816347 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.816331 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:07.816402 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:07.816382 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:07.830805 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.830790 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 04:45:07.837590 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837572 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-netns\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.837640 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837599 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-systemd-units\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.837676 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-run-netns\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.837676 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837672 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-cni-netd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.837736 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.837736 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837725 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-hostroot\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.837797 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837772 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5xp4\" (UniqueName: \"kubernetes.io/projected/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-kube-api-access-k5xp4\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.837829 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837797 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-sys\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.837829 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837813 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-daemon-config\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.837890 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837836 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l58ck\" (UniqueName: \"kubernetes.io/projected/0921fa80-a280-4013-8c90-530a9f1e45e1-kube-api-access-l58ck\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.837890 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837869 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3751973e-ab65-4992-9b24-38a050b1324c-serviceca\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:07.837948 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837896 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.837948 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-systemd\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.838012 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837950 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-cni-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.838012 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-k8s-cni-cncf-io\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.838012 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837980 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-cni-bin\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.838012 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.837996 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-etc-selinux\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.838129 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838017 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-hosts-file\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:07.838129 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838033 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cnibin\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.838129 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838049 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/953e8e8a-3671-4896-9b02-cb40af9e1978-host-slash\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:07.838129 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838062 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-modprobe-d\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.838129 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838075 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-etc-kubernetes\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.838129 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838118 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-sys-fs\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.838379 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838143 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-system-cni-dir\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.838379 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-node-log\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.838379 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838189 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-device-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.838379 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838209 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm5s5\" (UniqueName: \"kubernetes.io/projected/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-kube-api-access-gm5s5\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:07.838379 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838226 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g98wr\" (UniqueName: \"kubernetes.io/projected/953e8e8a-3671-4896-9b02-cb40af9e1978-kube-api-access-g98wr\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:07.838379 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838241 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-ovnkube-config\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.838379 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysconfig\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.838379 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838280 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-socket-dir-parent\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.838379 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838320 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vznm\" (UniqueName: \"kubernetes.io/projected/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-kube-api-access-6vznm\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:07.838379 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838338 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cvsc\" (UniqueName: \"kubernetes.io/projected/3751973e-ab65-4992-9b24-38a050b1324c-kube-api-access-2cvsc\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:07.838379 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838352 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-slash\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.838379 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-systemd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838389 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-ovn\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysctl-conf\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838433 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-cnibin\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838446 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0921fa80-a280-4013-8c90-530a9f1e45e1-cni-binary-copy\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838485 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838512 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838531 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-var-lib-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838574 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8272e327-372c-4b8c-9ca3-acf950c43690-ovn-node-metrics-cert\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838605 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysctl-d\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838629 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-conf-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838652 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838676 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-dbus\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838702 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/953e8e8a-3671-4896-9b02-cb40af9e1978-iptables-alerter-script\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838738 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838788 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-kubelet\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.838861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838827 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-registration-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838856 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-etc-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838875 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dca566d-9570-433f-bde3-f47b3c7d2895-tmp\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838889 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838918 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-log-socket\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838950 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd26b2a0-3960-49b0-8d68-034665741c8a-konnectivity-ca\") pod \"konnectivity-agent-qkwm9\" (UID: \"fd26b2a0-3960-49b0-8d68-034665741c8a\") " pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838973 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-kubelet-config\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.838989 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-kubelet\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839009 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-run\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839032 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-system-cni-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839046 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-multus-certs\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839064 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhwrd\" (UniqueName: \"kubernetes.io/projected/8272e327-372c-4b8c-9ca3-acf950c43690-kube-api-access-nhwrd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839112 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839146 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-socket-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839174 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-tmp-dir\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839199 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzrs5\" (UniqueName: \"kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5\") pod \"network-check-target-f7dtz\" (UID: \"6febe6fa-de9b-47eb-a036-a63aea789894\") " pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:07.839326 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839225 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-var-lib-kubelet\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839252 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839292 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztj4f\" (UniqueName: \"kubernetes.io/projected/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-kube-api-access-ztj4f\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839315 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-ovnkube-script-lib\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839336 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-host\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839367 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-cni-multus\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839383 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3751973e-ab65-4992-9b24-38a050b1324c-host\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839399 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-cni-bin\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839465 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd26b2a0-3960-49b0-8d68-034665741c8a-agent-certs\") pod \"konnectivity-agent-qkwm9\" (UID: \"fd26b2a0-3960-49b0-8d68-034665741c8a\") " pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839493 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-kubernetes\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839515 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-lib-modules\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839541 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgkkl\" (UniqueName: \"kubernetes.io/projected/8dca566d-9570-433f-bde3-f47b3c7d2895-kube-api-access-pgkkl\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-env-overrides\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.839768 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.839617 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-tuned\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.846253 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.846237 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:07.846344 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.846257 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:07.846414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.846398 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l2xwd\"" Nov 04 04:45:07.847584 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.847571 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 04:45:07.847634 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.847591 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 04:45:07.847634 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.847626 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 04:45:07.847700 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.847632 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 04:45:07.847700 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.847628 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-gwbb5\"" Nov 04 04:45:07.851426 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.851412 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 04:45:07.851426 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.851420 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 04:45:07.851535 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.851488 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 04:45:07.851535 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.851490 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nhf59\"" Nov 04 04:45:07.855270 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.855256 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 04:45:07.855390 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.855373 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 04:45:07.855436 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.855422 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 04:45:07.855562 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.855546 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8xbd4\"" Nov 04 04:45:07.857303 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.857276 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 04:45:07.857383 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.857317 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7qqph\"" Nov 04 04:45:07.857477 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.857461 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 04:45:07.859778 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.859760 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ss4dp\"" Nov 04 04:45:07.897863 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.897845 2573 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 04:45:07.897935 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.897910 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l7cxl" Nov 04 04:45:07.905569 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.905553 2573 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:45:07.939820 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939797 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-slash\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.939916 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939824 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-systemd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.939916 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-ovn\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.939916 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939854 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysctl-conf\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.939916 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-cnibin\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.939916 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939882 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0921fa80-a280-4013-8c90-530a9f1e45e1-cni-binary-copy\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.939916 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939927 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-systemd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939937 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939941 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-ovn\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939941 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-slash\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939959 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-cnibin\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.939982 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-var-lib-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940018 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8272e327-372c-4b8c-9ca3-acf950c43690-ovn-node-metrics-cert\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940033 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysctl-d\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:07.940038 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940048 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-conf-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940060 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysctl-conf\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940072 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:07.940098 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs podName:e4cfdbb2-d02d-46a4-8d69-4d7418f8c639 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:08.440078127 +0000 UTC m=+2.330107541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs") pod "network-metrics-daemon-d25j9" (UID: "e4cfdbb2-d02d-46a4-8d69-4d7418f8c639") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940109 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-conf-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940115 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-var-lib-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940139 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-dbus\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:07.940227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940169 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysctl-d\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940169 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/953e8e8a-3671-4896-9b02-cb40af9e1978-iptables-alerter-script\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940201 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-dbus\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940214 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940233 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-kubelet\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940248 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-registration-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940263 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-etc-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940316 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-etc-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940322 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-kubelet\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940337 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dca566d-9570-433f-bde3-f47b3c7d2895-tmp\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940354 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940336 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-registration-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940372 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-log-socket\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940397 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd26b2a0-3960-49b0-8d68-034665741c8a-konnectivity-ca\") pod \"konnectivity-agent-qkwm9\" (UID: \"fd26b2a0-3960-49b0-8d68-034665741c8a\") " pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:07.940436 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940444 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-log-socket\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940467 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0921fa80-a280-4013-8c90-530a9f1e45e1-cni-binary-copy\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.940862 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940473 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-kubelet-config\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940435 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-kubelet-config\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:07.940526 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret podName:ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b nodeName:}" failed. No retries permitted until 2026-11-04 04:45:08.440512514 +0000 UTC m=+2.330541914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret") pod "global-pull-secret-syncer-cnvdz" (UID: "ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b") : object "kube-system"/"original-pull-secret" not registered Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940560 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-kubelet\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940577 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-run\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940579 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-system-cni-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940621 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-multus-certs\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940620 2573 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940635 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-run\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940641 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhwrd\" (UniqueName: \"kubernetes.io/projected/8272e327-372c-4b8c-9ca3-acf950c43690-kube-api-access-nhwrd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940667 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-multus-certs\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940673 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940624 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-kubelet\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940892 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-socket-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940814 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940708 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-system-cni-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.941511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940930 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-tmp-dir\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940954 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzrs5\" (UniqueName: \"kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5\") pod \"network-check-target-f7dtz\" (UID: \"6febe6fa-de9b-47eb-a036-a63aea789894\") " pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940971 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-var-lib-kubelet\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940972 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-socket-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.940987 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941037 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941048 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-var-lib-kubelet\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztj4f\" (UniqueName: \"kubernetes.io/projected/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-kube-api-access-ztj4f\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941148 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-ovnkube-script-lib\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-host\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941183 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-cni-multus\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941200 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3751973e-ab65-4992-9b24-38a050b1324c-host\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941224 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941242 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-host\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941246 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-cni-multus\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941253 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3751973e-ab65-4992-9b24-38a050b1324c-host\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941249 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-cni-bin\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.942275 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941244 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-tmp-dir\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941304 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-cni-bin\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941326 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd26b2a0-3960-49b0-8d68-034665741c8a-agent-certs\") pod \"konnectivity-agent-qkwm9\" (UID: \"fd26b2a0-3960-49b0-8d68-034665741c8a\") " pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941343 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-kubernetes\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941357 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-lib-modules\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941371 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-kubernetes\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgkkl\" (UniqueName: \"kubernetes.io/projected/8dca566d-9570-433f-bde3-f47b3c7d2895-kube-api-access-pgkkl\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941394 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-env-overrides\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941409 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-tuned\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941427 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-netns\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941442 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-lib-modules\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941488 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-netns\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-systemd-units\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941525 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-systemd-units\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941525 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-run-netns\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941554 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-run-netns\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941561 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-cni-netd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.942900 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941590 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-cni-netd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941589 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-hostroot\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941628 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5xp4\" (UniqueName: \"kubernetes.io/projected/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-kube-api-access-k5xp4\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941667 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-hostroot\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941679 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-sys\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941712 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-daemon-config\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941736 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l58ck\" (UniqueName: \"kubernetes.io/projected/0921fa80-a280-4013-8c90-530a9f1e45e1-kube-api-access-l58ck\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941758 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3751973e-ab65-4992-9b24-38a050b1324c-serviceca\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941762 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-sys\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941784 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941808 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-systemd\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941829 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-cni-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941854 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-k8s-cni-cncf-io\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-cni-bin\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941890 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-systemd\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.943424 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941906 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-etc-selinux\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941931 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-hosts-file\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941957 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cnibin\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.941971 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-k8s-cni-cncf-io\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-cni-bin\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942019 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-cni-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942012 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cnibin\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942061 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-hosts-file\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942068 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/953e8e8a-3671-4896-9b02-cb40af9e1978-host-slash\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942092 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-etc-selinux\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942095 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-modprobe-d\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942122 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/953e8e8a-3671-4896-9b02-cb40af9e1978-host-slash\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-etc-kubernetes\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942150 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3751973e-ab65-4992-9b24-38a050b1324c-serviceca\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942155 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-sys-fs\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942153 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-etc-kubernetes\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942181 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-system-cni-dir\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942206 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-node-log\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.943887 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942208 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-modprobe-d\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-sys-fs\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942230 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-device-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942244 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-system-cni-dir\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942256 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm5s5\" (UniqueName: \"kubernetes.io/projected/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-kube-api-access-gm5s5\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942248 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-node-log\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942309 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-device-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942283 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g98wr\" (UniqueName: \"kubernetes.io/projected/953e8e8a-3671-4896-9b02-cb40af9e1978-kube-api-access-g98wr\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-ovnkube-config\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysconfig\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942398 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-socket-dir-parent\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942422 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vznm\" (UniqueName: \"kubernetes.io/projected/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-kube-api-access-6vznm\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942449 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvsc\" (UniqueName: \"kubernetes.io/projected/3751973e-ab65-4992-9b24-38a050b1324c-kube-api-access-2cvsc\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysconfig\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942467 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-socket-dir-parent\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.942785 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-daemon-config\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.944169 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-tuned\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.944408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.944195 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dca566d-9570-433f-bde3-f47b3c7d2895-tmp\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:07.950839 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.950819 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 04:45:07.950937 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.950879 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 04:45:07.951101 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951084 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 04:45:07.951150 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951126 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 04:45:07.951206 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951147 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 04:45:07.951333 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951253 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:07.951333 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951286 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 04:45:07.951333 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951299 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-95fm7\"" Nov 04 04:45:07.951516 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951429 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-77ccl\"" Nov 04 04:45:07.951516 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951458 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 04:45:07.951516 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951460 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:07.951516 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951478 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 04:45:07.951685 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951554 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 04:45:07.951685 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951574 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kjpq6\"" Nov 04 04:45:07.951685 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951587 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 04:45:07.951685 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951610 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 04:45:07.951823 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.951809 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-env-overrides\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.952942 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.952926 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.952988 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.952928 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-ovnkube-config\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.960793 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.960774 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:07.961392 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.961375 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/953e8e8a-3671-4896-9b02-cb40af9e1978-iptables-alerter-script\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:07.961499 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.961483 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd26b2a0-3960-49b0-8d68-034665741c8a-konnectivity-ca\") pod \"konnectivity-agent-qkwm9\" (UID: \"fd26b2a0-3960-49b0-8d68-034665741c8a\") " pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:07.961756 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.961728 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-ovnkube-script-lib\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.962314 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.962280 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8272e327-372c-4b8c-9ca3-acf950c43690-ovn-node-metrics-cert\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:07.963179 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:07.963160 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd26b2a0-3960-49b0-8d68-034665741c8a-agent-certs\") pod \"konnectivity-agent-qkwm9\" (UID: \"fd26b2a0-3960-49b0-8d68-034665741c8a\") " pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:08.002677 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:08.002612 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 04:45:08.002677 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:08.002634 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 04:45:08.002677 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:08.002644 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tzrs5 for pod openshift-network-diagnostics/network-check-target-f7dtz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:45:08.002916 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:08.002699 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5 podName:6febe6fa-de9b-47eb-a036-a63aea789894 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:08.502686753 +0000 UTC m=+2.392716153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tzrs5" (UniqueName: "kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5") pod "network-check-target-f7dtz" (UID: "6febe6fa-de9b-47eb-a036-a63aea789894") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:45:08.005225 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.005193 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhwrd\" (UniqueName: \"kubernetes.io/projected/8272e327-372c-4b8c-9ca3-acf950c43690-kube-api-access-nhwrd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:08.005751 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.005687 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l58ck\" (UniqueName: \"kubernetes.io/projected/0921fa80-a280-4013-8c90-530a9f1e45e1-kube-api-access-l58ck\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:08.006116 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.006087 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g98wr\" (UniqueName: \"kubernetes.io/projected/953e8e8a-3671-4896-9b02-cb40af9e1978-kube-api-access-g98wr\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:08.006236 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.006216 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztj4f\" (UniqueName: \"kubernetes.io/projected/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-kube-api-access-ztj4f\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:08.006319 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.006266 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgkkl\" (UniqueName: \"kubernetes.io/projected/8dca566d-9570-433f-bde3-f47b3c7d2895-kube-api-access-pgkkl\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:08.006501 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.006479 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cvsc\" (UniqueName: \"kubernetes.io/projected/3751973e-ab65-4992-9b24-38a050b1324c-kube-api-access-2cvsc\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:08.006921 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.006901 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm5s5\" (UniqueName: \"kubernetes.io/projected/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-kube-api-access-gm5s5\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:08.007454 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.007436 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vznm\" (UniqueName: \"kubernetes.io/projected/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-kube-api-access-6vznm\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:08.007825 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.007810 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5xp4\" (UniqueName: \"kubernetes.io/projected/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-kube-api-access-k5xp4\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:08.122449 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.122419 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:08.146528 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.146504 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bmvjp" Nov 04 04:45:08.163111 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.163089 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:08.183505 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.183484 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:08.183581 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.183546 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:08.209377 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.209355 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:08.212864 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.212848 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:08.230741 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.230723 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:08.236831 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.236812 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:08.358781 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.358756 2573 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:45:08.418609 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:08.418579 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de2404c5cc3fbadf16c719910f8d787.slice/crio-f803cb825a272dfbf1196f8dc1daa43d520274af80e91b0f4318f921a1535842 WatchSource:0}: Error finding container f803cb825a272dfbf1196f8dc1daa43d520274af80e91b0f4318f921a1535842: Status 404 returned error can't find the container with id f803cb825a272dfbf1196f8dc1daa43d520274af80e91b0f4318f921a1535842 Nov 04 04:45:08.418938 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:08.418919 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77202defc6f17821d20368d232c24c4.slice/crio-0c34a17ccf8f222c33197013e59b989754daeb18a1d7d91ed4bb73ef61730bc8 WatchSource:0}: Error finding container 0c34a17ccf8f222c33197013e59b989754daeb18a1d7d91ed4bb73ef61730bc8: Status 404 returned error can't find the container with id 0c34a17ccf8f222c33197013e59b989754daeb18a1d7d91ed4bb73ef61730bc8 Nov 04 04:45:08.423962 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.423947 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 04:45:08.446489 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.446457 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:08.446489 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.446502 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:08.446630 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:08.446612 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 04:45:08.446710 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:08.446660 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret podName:ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b nodeName:}" failed. No retries permitted until 2026-11-04 04:45:09.446647341 +0000 UTC m=+3.336676753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret") pod "global-pull-secret-syncer-cnvdz" (UID: "ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b") : object "kube-system"/"original-pull-secret" not registered Nov 04 04:45:08.446710 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:08.446612 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:45:08.446710 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:08.446692 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs podName:e4cfdbb2-d02d-46a4-8d69-4d7418f8c639 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:09.446682605 +0000 UTC m=+3.336712006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs") pod "network-metrics-daemon-d25j9" (UID: "e4cfdbb2-d02d-46a4-8d69-4d7418f8c639") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:45:08.546822 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.546797 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzrs5\" (UniqueName: \"kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5\") pod \"network-check-target-f7dtz\" (UID: \"6febe6fa-de9b-47eb-a036-a63aea789894\") " pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:08.547289 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:08.546907 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 04:45:08.547289 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:08.546922 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 04:45:08.547289 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:08.546932 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tzrs5 for pod openshift-network-diagnostics/network-check-target-f7dtz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:45:08.547289 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:08.546977 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5 podName:6febe6fa-de9b-47eb-a036-a63aea789894 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:09.546962402 +0000 UTC m=+3.436991814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzrs5" (UniqueName: "kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5") pod "network-check-target-f7dtz" (UID: "6febe6fa-de9b-47eb-a036-a63aea789894") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:45:08.678069 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.677974 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" event={"ID":"c77202defc6f17821d20368d232c24c4","Type":"ContainerStarted","Data":"0c34a17ccf8f222c33197013e59b989754daeb18a1d7d91ed4bb73ef61730bc8"} Nov 04 04:45:08.678937 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.678919 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" event={"ID":"1de2404c5cc3fbadf16c719910f8d787","Type":"ContainerStarted","Data":"f803cb825a272dfbf1196f8dc1daa43d520274af80e91b0f4318f921a1535842"} Nov 04 04:45:08.855237 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.855210 2573 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:45:08.900960 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.900905 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 04:40:07 +0000 UTC" deadline="2028-07-31 20:21:41.845226314 +0000 UTC" Nov 04 04:45:08.900960 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:08.900951 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15255h36m32.94427717s" Nov 04 04:45:09.032881 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:09.032856 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0921fa80_a280_4013_8c90_530a9f1e45e1.slice/crio-1194de70ef1a63df8a4298d03ec9d73b821fb1689ecdf814a747480b57efd82b WatchSource:0}: Error finding container 1194de70ef1a63df8a4298d03ec9d73b821fb1689ecdf814a747480b57efd82b: Status 404 returned error can't find the container with id 1194de70ef1a63df8a4298d03ec9d73b821fb1689ecdf814a747480b57efd82b Nov 04 04:45:09.061490 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:09.061467 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dca566d_9570_433f_bde3_f47b3c7d2895.slice/crio-75cb358bf918bb48dc4b55406b669022e4621ef1b688308f6b83b1bd6a04973c WatchSource:0}: Error finding container 75cb358bf918bb48dc4b55406b669022e4621ef1b688308f6b83b1bd6a04973c: Status 404 returned error can't find the container with id 75cb358bf918bb48dc4b55406b669022e4621ef1b688308f6b83b1bd6a04973c Nov 04 04:45:09.085700 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:09.085676 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66675bf0_7d80_414a_8ccc_a7e3718bbaaa.slice/crio-65b09845f3a957ae48f5ee479bcc15cac4a19d81690a4be07e5bfdd6bd2595f1 WatchSource:0}: Error finding container 65b09845f3a957ae48f5ee479bcc15cac4a19d81690a4be07e5bfdd6bd2595f1: Status 404 returned error can't find the container with id 65b09845f3a957ae48f5ee479bcc15cac4a19d81690a4be07e5bfdd6bd2595f1 Nov 04 04:45:09.119940 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:09.119912 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953e8e8a_3671_4896_9b02_cb40af9e1978.slice/crio-a20bde6ddb43854d9cf74a0d182eff35f2c602b5fc52ee41e59cc3a4383756ae WatchSource:0}: Error finding container a20bde6ddb43854d9cf74a0d182eff35f2c602b5fc52ee41e59cc3a4383756ae: Status 404 returned error can't find the container with id a20bde6ddb43854d9cf74a0d182eff35f2c602b5fc52ee41e59cc3a4383756ae Nov 04 04:45:09.121352 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:09.121332 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3751973e_ab65_4992_9b24_38a050b1324c.slice/crio-425ce514232109c05af0a5b0dd2ee2d2b7e1dcde98ef0c6bea435b5b0179efa0 WatchSource:0}: Error finding container 425ce514232109c05af0a5b0dd2ee2d2b7e1dcde98ef0c6bea435b5b0179efa0: Status 404 returned error can't find the container with id 425ce514232109c05af0a5b0dd2ee2d2b7e1dcde98ef0c6bea435b5b0179efa0 Nov 04 04:45:09.138706 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:09.138684 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5331a9ab_3b27_4726_bf53_9ed1ac228c6c.slice/crio-c0c0ff0c95c9a734d602aa61ca025816684e3bdee7c53698046204b3e4c547d2 WatchSource:0}: Error finding container c0c0ff0c95c9a734d602aa61ca025816684e3bdee7c53698046204b3e4c547d2: Status 404 returned error can't find the container with id c0c0ff0c95c9a734d602aa61ca025816684e3bdee7c53698046204b3e4c547d2 Nov 04 04:45:09.173199 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:09.173177 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2998cb_3584_4d30_8ff9_9e1ca5dc8950.slice/crio-f20e7d9c261d68f03284575088df97b83981d016703a3bfec8f7a9f2b11904ea WatchSource:0}: Error finding container f20e7d9c261d68f03284575088df97b83981d016703a3bfec8f7a9f2b11904ea: Status 404 returned error can't find the container with id f20e7d9c261d68f03284575088df97b83981d016703a3bfec8f7a9f2b11904ea Nov 04 04:45:09.174063 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:09.174043 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd26b2a0_3960_49b0_8d68_034665741c8a.slice/crio-155e2be44040f0ae4c2a5a2aaeb4bf3a647c188e4f7495a85ff1e8443d715acc WatchSource:0}: Error finding container 155e2be44040f0ae4c2a5a2aaeb4bf3a647c188e4f7495a85ff1e8443d715acc: Status 404 returned error can't find the container with id 155e2be44040f0ae4c2a5a2aaeb4bf3a647c188e4f7495a85ff1e8443d715acc Nov 04 04:45:09.190718 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:09.190698 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8272e327_372c_4b8c_9ca3_acf950c43690.slice/crio-ce0f8e5536a46a40523db36a3cb54280b47e17de9a98fb61c31d2b6ba6646f9d WatchSource:0}: Error finding container ce0f8e5536a46a40523db36a3cb54280b47e17de9a98fb61c31d2b6ba6646f9d: Status 404 returned error can't find the container with id ce0f8e5536a46a40523db36a3cb54280b47e17de9a98fb61c31d2b6ba6646f9d Nov 04 04:45:09.453856 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.453824 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:09.453856 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.453858 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:09.454053 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:09.453962 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:45:09.454053 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:09.454013 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 04:45:09.454053 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:09.454018 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs podName:e4cfdbb2-d02d-46a4-8d69-4d7418f8c639 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:11.454003615 +0000 UTC m=+5.344033030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs") pod "network-metrics-daemon-d25j9" (UID: "e4cfdbb2-d02d-46a4-8d69-4d7418f8c639") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:45:09.454156 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:09.454066 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret podName:ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b nodeName:}" failed. No retries permitted until 2026-11-04 04:45:11.454055408 +0000 UTC m=+5.344084811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret") pod "global-pull-secret-syncer-cnvdz" (UID: "ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b") : object "kube-system"/"original-pull-secret" not registered Nov 04 04:45:09.554221 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.554198 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzrs5\" (UniqueName: \"kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5\") pod \"network-check-target-f7dtz\" (UID: \"6febe6fa-de9b-47eb-a036-a63aea789894\") " pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:09.554669 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:09.554304 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 04:45:09.554669 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:09.554315 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 04:45:09.554669 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:09.554323 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tzrs5 for pod openshift-network-diagnostics/network-check-target-f7dtz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:45:09.554669 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:09.554362 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5 podName:6febe6fa-de9b-47eb-a036-a63aea789894 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:11.554351317 +0000 UTC m=+5.444380716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzrs5" (UniqueName: "kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5") pod "network-check-target-f7dtz" (UID: "6febe6fa-de9b-47eb-a036-a63aea789894") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:45:09.674549 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.674521 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:09.674691 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.674644 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:09.674691 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:09.674653 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:09.674773 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:09.674719 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:09.674773 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.674745 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:09.674864 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:09.674846 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:09.681625 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.681598 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vjj7q" event={"ID":"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950","Type":"ContainerStarted","Data":"f20e7d9c261d68f03284575088df97b83981d016703a3bfec8f7a9f2b11904ea"} Nov 04 04:45:09.682734 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.682709 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5j9g" event={"ID":"5331a9ab-3b27-4726-bf53-9ed1ac228c6c","Type":"ContainerStarted","Data":"c0c0ff0c95c9a734d602aa61ca025816684e3bdee7c53698046204b3e4c547d2"} Nov 04 04:45:09.683645 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.683626 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8rtt2" event={"ID":"953e8e8a-3671-4896-9b02-cb40af9e1978","Type":"ContainerStarted","Data":"a20bde6ddb43854d9cf74a0d182eff35f2c602b5fc52ee41e59cc3a4383756ae"} Nov 04 04:45:09.684790 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.684767 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" event={"ID":"66675bf0-7d80-414a-8ccc-a7e3718bbaaa","Type":"ContainerStarted","Data":"65b09845f3a957ae48f5ee479bcc15cac4a19d81690a4be07e5bfdd6bd2595f1"} Nov 04 04:45:09.685830 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.685805 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" event={"ID":"8dca566d-9570-433f-bde3-f47b3c7d2895","Type":"ContainerStarted","Data":"75cb358bf918bb48dc4b55406b669022e4621ef1b688308f6b83b1bd6a04973c"} Nov 04 04:45:09.687023 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.687003 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bmvjp" event={"ID":"0921fa80-a280-4013-8c90-530a9f1e45e1","Type":"ContainerStarted","Data":"1194de70ef1a63df8a4298d03ec9d73b821fb1689ecdf814a747480b57efd82b"} Nov 04 04:45:09.688038 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.688013 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" event={"ID":"8272e327-372c-4b8c-9ca3-acf950c43690","Type":"ContainerStarted","Data":"ce0f8e5536a46a40523db36a3cb54280b47e17de9a98fb61c31d2b6ba6646f9d"} Nov 04 04:45:09.689098 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.689080 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f66bz" event={"ID":"3751973e-ab65-4992-9b24-38a050b1324c","Type":"ContainerStarted","Data":"425ce514232109c05af0a5b0dd2ee2d2b7e1dcde98ef0c6bea435b5b0179efa0"} Nov 04 04:45:09.690070 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.690051 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qkwm9" event={"ID":"fd26b2a0-3960-49b0-8d68-034665741c8a","Type":"ContainerStarted","Data":"155e2be44040f0ae4c2a5a2aaeb4bf3a647c188e4f7495a85ff1e8443d715acc"} Nov 04 04:45:09.901136 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.901081 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 04:40:07 +0000 UTC" deadline="2028-03-30 21:09:35.010192409 +0000 UTC" Nov 04 04:45:09.901136 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:09.901132 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12304h24m25.109063834s" Nov 04 04:45:11.470557 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:11.470182 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:11.470557 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:11.470237 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:11.470557 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:11.470377 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 04:45:11.470557 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:11.470438 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret podName:ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b nodeName:}" failed. No retries permitted until 2026-11-04 04:45:15.470419961 +0000 UTC m=+9.360449365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret") pod "global-pull-secret-syncer-cnvdz" (UID: "ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b") : object "kube-system"/"original-pull-secret" not registered Nov 04 04:45:11.470557 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:11.470499 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:45:11.470557 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:11.470531 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs podName:e4cfdbb2-d02d-46a4-8d69-4d7418f8c639 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:15.470519994 +0000 UTC m=+9.360549395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs") pod "network-metrics-daemon-d25j9" (UID: "e4cfdbb2-d02d-46a4-8d69-4d7418f8c639") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:45:11.570968 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:11.570720 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzrs5\" (UniqueName: \"kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5\") pod \"network-check-target-f7dtz\" (UID: \"6febe6fa-de9b-47eb-a036-a63aea789894\") " pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:11.570968 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:11.570855 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 04:45:11.570968 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:11.570869 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 04:45:11.570968 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:11.570878 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tzrs5 for pod openshift-network-diagnostics/network-check-target-f7dtz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:45:11.570968 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:11.570925 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5 podName:6febe6fa-de9b-47eb-a036-a63aea789894 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:15.570909235 +0000 UTC m=+9.460938634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzrs5" (UniqueName: "kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5") pod "network-check-target-f7dtz" (UID: "6febe6fa-de9b-47eb-a036-a63aea789894") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:45:11.674824 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:11.674793 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:11.674987 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:11.674891 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:11.674987 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:11.674933 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:11.674987 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:11.674981 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:11.675143 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:11.675013 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:11.675143 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:11.675060 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:12.717500 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:12.716677 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5j9g" event={"ID":"5331a9ab-3b27-4726-bf53-9ed1ac228c6c","Type":"ContainerStarted","Data":"f2b851fc83d15d2dfd8562a42be401f7ca8b0452b31a89e6e25429711966b26d"} Nov 04 04:45:12.720615 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:12.720304 2573 generic.go:356] "Generic (PLEG): container finished" podID="1de2404c5cc3fbadf16c719910f8d787" containerID="b547781123afb2d7d3730d7193545e6658cab3e65e26d59f4dfb69a823536e50" exitCode=0 Nov 04 04:45:12.720615 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:12.720350 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" event={"ID":"1de2404c5cc3fbadf16c719910f8d787","Type":"ContainerDied","Data":"b547781123afb2d7d3730d7193545e6658cab3e65e26d59f4dfb69a823536e50"} Nov 04 04:45:13.675734 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:13.675241 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:13.675734 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:13.675379 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:13.675734 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:13.675392 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:13.675734 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:13.675509 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:13.675734 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:13.675566 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:13.675734 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:13.675635 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:13.725775 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:13.725429 2573 generic.go:356] "Generic (PLEG): container finished" podID="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" containerID="f2b851fc83d15d2dfd8562a42be401f7ca8b0452b31a89e6e25429711966b26d" exitCode=0 Nov 04 04:45:13.725775 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:13.725515 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5j9g" event={"ID":"5331a9ab-3b27-4726-bf53-9ed1ac228c6c","Type":"ContainerDied","Data":"f2b851fc83d15d2dfd8562a42be401f7ca8b0452b31a89e6e25429711966b26d"} Nov 04 04:45:13.735967 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:13.735937 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" event={"ID":"c77202defc6f17821d20368d232c24c4","Type":"ContainerStarted","Data":"d0d1d4ae150bbc454450c626e9b0874360f6426fcee34482d2708489be6d5367"} Nov 04 04:45:13.750064 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:13.750037 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" event={"ID":"1de2404c5cc3fbadf16c719910f8d787","Type":"ContainerStarted","Data":"61ad9021089982d620438eaf292fc828b8ced9de24a11fd2bbf2a9f33eadf603"} Nov 04 04:45:14.083432 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:14.083372 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" podStartSLOduration=7.083351808 podStartE2EDuration="7.083351808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:13.967484143 +0000 UTC m=+7.857513565" watchObservedRunningTime="2026-11-04 04:45:14.083351808 +0000 UTC m=+7.973381229" Nov 04 04:45:14.759736 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:14.759698 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qkwm9" event={"ID":"fd26b2a0-3960-49b0-8d68-034665741c8a","Type":"ContainerStarted","Data":"c8f33bcddd6441e50631a0496ca76ca4ae6cdbf3be59f0ca1ed371c4704fb3d7"} Nov 04 04:45:14.878210 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:14.878148 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" podStartSLOduration=7.878127634 podStartE2EDuration="7.878127634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:14.082677269 +0000 UTC m=+7.972706692" watchObservedRunningTime="2026-11-04 04:45:14.878127634 +0000 UTC m=+8.768157057" Nov 04 04:45:14.879020 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:14.878979 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qkwm9" podStartSLOduration=3.098306276 podStartE2EDuration="7.878962867s" totalImagesPullingTime="4.780656591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:14.877963589 +0000 UTC m=+8.767993014" watchObservedRunningTime="2026-11-04 04:45:14.878962867 +0000 UTC m=+8.768992280" Nov 04 04:45:15.505988 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:15.505187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:15.505988 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:15.505242 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:15.505988 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:15.505408 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 04:45:15.505988 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:15.505469 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret podName:ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b nodeName:}" failed. No retries permitted until 2026-11-04 04:45:23.505451453 +0000 UTC m=+17.395480859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret") pod "global-pull-secret-syncer-cnvdz" (UID: "ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b") : object "kube-system"/"original-pull-secret" not registered Nov 04 04:45:15.505988 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:15.505855 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:45:15.505988 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:15.505905 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs podName:e4cfdbb2-d02d-46a4-8d69-4d7418f8c639 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:23.50588992 +0000 UTC m=+17.395919324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs") pod "network-metrics-daemon-d25j9" (UID: "e4cfdbb2-d02d-46a4-8d69-4d7418f8c639") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:45:15.606307 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:15.606274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzrs5\" (UniqueName: \"kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5\") pod \"network-check-target-f7dtz\" (UID: \"6febe6fa-de9b-47eb-a036-a63aea789894\") " pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:15.606518 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:15.606499 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 04:45:15.606601 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:15.606527 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 04:45:15.606601 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:15.606540 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tzrs5 for pod openshift-network-diagnostics/network-check-target-f7dtz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:45:15.606601 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:15.606595 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5 podName:6febe6fa-de9b-47eb-a036-a63aea789894 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:23.606578198 +0000 UTC m=+17.496607617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzrs5" (UniqueName: "kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5") pod "network-check-target-f7dtz" (UID: "6febe6fa-de9b-47eb-a036-a63aea789894") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:45:15.674333 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:15.674288 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:15.674496 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:15.674414 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:15.674557 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:15.674498 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:15.674608 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:15.674572 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:15.674664 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:15.674644 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:15.674773 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:15.674729 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:15.766137 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:15.766027 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f66bz" event={"ID":"3751973e-ab65-4992-9b24-38a050b1324c","Type":"ContainerStarted","Data":"070c516a163c991c079daa1d8be4b512d9aa614adb20236b9cb8f0431b38f1b5"} Nov 04 04:45:15.886984 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:15.886932 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f66bz" podStartSLOduration=4.065345712 podStartE2EDuration="9.886918843s" totalImagesPullingTime="5.821573131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:15.886915314 +0000 UTC m=+9.776944736" watchObservedRunningTime="2026-11-04 04:45:15.886918843 +0000 UTC m=+9.776948264" Nov 04 04:45:16.771028 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:16.770954 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" event={"ID":"66675bf0-7d80-414a-8ccc-a7e3718bbaaa","Type":"ContainerStarted","Data":"6b0577ed8b2b4266a6fb852f62ea184d28dfb0f904563946a022f3476ddd2a32"} Nov 04 04:45:17.675126 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:17.674253 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:17.675126 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:17.674391 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:17.675126 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:17.674805 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:17.675126 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:17.674920 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:17.675126 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:17.674969 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:17.675126 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:17.675042 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:17.775738 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:17.775094 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bmvjp" event={"ID":"0921fa80-a280-4013-8c90-530a9f1e45e1","Type":"ContainerStarted","Data":"d46234b5621ded590ce08332b92c26323986ea5986ce7dc82edc13a5587c7d76"} Nov 04 04:45:18.004074 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:18.004045 2573 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 04:45:18.613861 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:18.613720 2573 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T04:45:18.004068821Z","UUID":"b0f8c8ed-7597-4dc5-a918-f65a679f45bc","Handler":null,"Name":"","Endpoint":""} Nov 04 04:45:18.615305 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:18.615282 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 04:45:18.615434 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:18.615312 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 04:45:18.779150 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:18.779117 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vjj7q" event={"ID":"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950","Type":"ContainerStarted","Data":"2ef441f7d93645db7e53cb813e1f896e08ea8e044055a472e1a876919ea77fa0"} Nov 04 04:45:18.781449 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:18.781390 2573 generic.go:356] "Generic (PLEG): container finished" podID="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" containerID="424cc35471635ff973fe9526ee63ecf439e6632ba138ccd02136d0d6816165a7" exitCode=0 Nov 04 04:45:18.781565 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:18.781480 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5j9g" event={"ID":"5331a9ab-3b27-4726-bf53-9ed1ac228c6c","Type":"ContainerDied","Data":"424cc35471635ff973fe9526ee63ecf439e6632ba138ccd02136d0d6816165a7"} Nov 04 04:45:18.784354 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:18.784332 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" event={"ID":"66675bf0-7d80-414a-8ccc-a7e3718bbaaa","Type":"ContainerStarted","Data":"b4bb79772cb21548f0cca81532df79024601deaa2ad5e47913ff7eec990fc54a"} Nov 04 04:45:18.896479 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:18.896400 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-bmvjp" podStartSLOduration=4.619968173 podStartE2EDuration="12.896385407s" totalImagesPullingTime="8.276417234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:17.915728811 +0000 UTC m=+11.805758234" watchObservedRunningTime="2026-11-04 04:45:18.896385407 +0000 UTC m=+12.786414861" Nov 04 04:45:18.896611 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:18.896572 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-vjj7q" podStartSLOduration=3.290890255 podStartE2EDuration="11.896567964s" totalImagesPullingTime="8.605677709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:18.896048475 +0000 UTC m=+12.786077895" watchObservedRunningTime="2026-11-04 04:45:18.896567964 +0000 UTC m=+12.786597381" Nov 04 04:45:19.497645 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:19.497004 2573 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:19.498180 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:19.497978 2573 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:19.674597 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:19.674566 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:19.674698 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:19.674677 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:19.674988 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:19.674971 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:19.675089 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:19.675044 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:19.675148 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:19.675100 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:19.675193 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:19.675152 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:19.788063 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:19.787966 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8rtt2" event={"ID":"953e8e8a-3671-4896-9b02-cb40af9e1978","Type":"ContainerStarted","Data":"58cdca8c74fbf82abedbd8f6542e55f535221882b3aa6bd4edeba002af34e054"} Nov 04 04:45:19.790465 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:19.790440 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" event={"ID":"8dca566d-9570-433f-bde3-f47b3c7d2895","Type":"ContainerStarted","Data":"cc3a10ac9e48a3ba7d477722dacf2b75e3be3e4b769ea8ec0f2473e0c3c39fff"} Nov 04 04:45:19.906128 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:19.905875 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8rtt2" podStartSLOduration=4.014100218 podStartE2EDuration="12.905858075s" totalImagesPullingTime="8.891757857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:19.905641012 +0000 UTC m=+13.795670433" watchObservedRunningTime="2026-11-04 04:45:19.905858075 +0000 UTC m=+13.795887497" Nov 04 04:45:20.794210 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:20.794159 2573 generic.go:356] "Generic (PLEG): container finished" podID="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" containerID="6ad6ad0bfa3a894262fab7ac063fe0ed5736c811a5c074d4f37df547a2f64268" exitCode=0 Nov 04 04:45:20.794661 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:20.794252 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5j9g" event={"ID":"5331a9ab-3b27-4726-bf53-9ed1ac228c6c","Type":"ContainerDied","Data":"6ad6ad0bfa3a894262fab7ac063fe0ed5736c811a5c074d4f37df547a2f64268"} Nov 04 04:45:20.796947 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:20.796921 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" event={"ID":"66675bf0-7d80-414a-8ccc-a7e3718bbaaa","Type":"ContainerStarted","Data":"0c40963f798db49b192e3bd6b39e938e9ce55032a6bc68464680d288fb851744"} Nov 04 04:45:20.917760 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:20.917711 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" podStartSLOduration=4.368513216 podStartE2EDuration="14.917697567s" totalImagesPullingTime="10.549184351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:20.028199146 +0000 UTC m=+13.918228567" watchObservedRunningTime="2026-11-04 04:45:20.917697567 +0000 UTC m=+14.807726987" Nov 04 04:45:21.037948 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:21.037897 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" podStartSLOduration=3.496362029 podStartE2EDuration="14.037885985s" totalImagesPullingTime="10.541523956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:45:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:21.037763671 +0000 UTC m=+14.927793091" watchObservedRunningTime="2026-11-04 04:45:21.037885985 +0000 UTC m=+14.927915412" Nov 04 04:45:21.674572 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:21.674536 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:21.674572 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:21.674574 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:21.674777 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:21.674535 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:21.674777 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:21.674661 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:21.674777 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:21.674739 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:21.674878 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:21.674814 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:22.804318 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:22.804288 2573 generic.go:356] "Generic (PLEG): container finished" podID="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" containerID="05841ebabdefdaea77d7cd25a92480180c7f3b564e25091d76dcac8f60fbf5fc" exitCode=0 Nov 04 04:45:22.805035 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:22.804342 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5j9g" event={"ID":"5331a9ab-3b27-4726-bf53-9ed1ac228c6c","Type":"ContainerDied","Data":"05841ebabdefdaea77d7cd25a92480180c7f3b564e25091d76dcac8f60fbf5fc"} Nov 04 04:45:23.567756 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:23.567719 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:23.567915 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:23.567774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:23.567915 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:23.567868 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:45:23.568021 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:23.567928 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs podName:e4cfdbb2-d02d-46a4-8d69-4d7418f8c639 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:39.567914192 +0000 UTC m=+33.457943605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs") pod "network-metrics-daemon-d25j9" (UID: "e4cfdbb2-d02d-46a4-8d69-4d7418f8c639") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:45:23.568021 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:23.567868 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 04:45:23.568021 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:23.567994 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret podName:ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b nodeName:}" failed. No retries permitted until 2026-11-04 04:45:39.567981823 +0000 UTC m=+33.458011241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret") pod "global-pull-secret-syncer-cnvdz" (UID: "ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b") : object "kube-system"/"original-pull-secret" not registered Nov 04 04:45:23.668463 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:23.668424 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzrs5\" (UniqueName: \"kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5\") pod \"network-check-target-f7dtz\" (UID: \"6febe6fa-de9b-47eb-a036-a63aea789894\") " pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:23.668612 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:23.668557 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 04:45:23.668612 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:23.668572 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 04:45:23.668612 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:23.668581 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tzrs5 for pod openshift-network-diagnostics/network-check-target-f7dtz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:45:23.668723 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:23.668621 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5 podName:6febe6fa-de9b-47eb-a036-a63aea789894 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:39.66860933 +0000 UTC m=+33.558638729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzrs5" (UniqueName: "kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5") pod "network-check-target-f7dtz" (UID: "6febe6fa-de9b-47eb-a036-a63aea789894") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:45:23.674464 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:23.674439 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:23.674582 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:23.674470 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:23.674629 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:23.674605 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:23.674664 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:23.674598 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:23.674705 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:23.674671 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:23.674803 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:23.674780 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:24.812868 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:24.812675 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" event={"ID":"8272e327-372c-4b8c-9ca3-acf950c43690","Type":"ContainerStarted","Data":"6cfa232704e22146b1866d1da42a0886df41dd65becccbbbbf3661b2e2fe150e"} Nov 04 04:45:24.813439 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:24.812933 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" event={"ID":"8272e327-372c-4b8c-9ca3-acf950c43690","Type":"ContainerStarted","Data":"b9b17b0fdfbd1675c0d44047f48d09c32055810e2489c8ba1a475c957edfd6dd"} Nov 04 04:45:24.813439 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:24.812983 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" event={"ID":"8272e327-372c-4b8c-9ca3-acf950c43690","Type":"ContainerStarted","Data":"99664507b31ee832fe9d26d9c27217c334cd59728cc050022569d8e16ce8bae8"} Nov 04 04:45:24.813439 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:24.813029 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" event={"ID":"8272e327-372c-4b8c-9ca3-acf950c43690","Type":"ContainerStarted","Data":"be81b97dc410a7a631623427983d9caa26c71823c521f82c96dc2b08ddc67172"} Nov 04 04:45:24.813439 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:24.813076 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" event={"ID":"8272e327-372c-4b8c-9ca3-acf950c43690","Type":"ContainerStarted","Data":"b23159fa1534e4760e7eed2d781a7fb522cf58ca110de6790d904d1f0db2d6df"} Nov 04 04:45:24.813439 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:24.813121 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" event={"ID":"8272e327-372c-4b8c-9ca3-acf950c43690","Type":"ContainerStarted","Data":"f61537586fe71973db638bdcbe89516ce6317e4f19bbbdad8f66aa1b31c34156"} Nov 04 04:45:25.675062 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:25.674893 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:25.675204 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:25.674965 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:25.675204 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:25.675126 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:25.675204 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:25.674972 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:25.675330 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:25.675203 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:25.675330 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:25.675287 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:25.816937 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:25.816908 2573 generic.go:356] "Generic (PLEG): container finished" podID="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" containerID="84034a1eca1c9d73b83d70ccc34edcc5ded2b23b6c3ca4aad0075278650139b2" exitCode=0 Nov 04 04:45:25.817392 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:25.816965 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5j9g" event={"ID":"5331a9ab-3b27-4726-bf53-9ed1ac228c6c","Type":"ContainerDied","Data":"84034a1eca1c9d73b83d70ccc34edcc5ded2b23b6c3ca4aad0075278650139b2"} Nov 04 04:45:26.821695 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:26.821662 2573 generic.go:356] "Generic (PLEG): container finished" podID="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" containerID="b1fd50dcfb3e1e771e7d8c97f2955db27625fed5655af46967ebf43b100d01c9" exitCode=0 Nov 04 04:45:26.822211 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:26.821751 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5j9g" event={"ID":"5331a9ab-3b27-4726-bf53-9ed1ac228c6c","Type":"ContainerDied","Data":"b1fd50dcfb3e1e771e7d8c97f2955db27625fed5655af46967ebf43b100d01c9"} Nov 04 04:45:26.825080 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:26.825057 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" event={"ID":"8272e327-372c-4b8c-9ca3-acf950c43690","Type":"ContainerStarted","Data":"7cdfa9eb2e43d30d373dbb3da4232260a084d100916bac62a648f8310c51fade"} Nov 04 04:45:27.674308 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:27.674280 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:27.674482 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:27.674403 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:27.674482 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:27.674431 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:27.674482 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:27.674418 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:27.674644 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:27.674510 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:27.674644 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:27.674559 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:27.829711 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:27.829680 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5j9g" event={"ID":"5331a9ab-3b27-4726-bf53-9ed1ac228c6c","Type":"ContainerStarted","Data":"72c7f92ca316ba4b8149242a29089a367caf1c31abd4ece19140d379e751a387"} Nov 04 04:45:27.954093 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:27.954006 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j5j9g" podStartSLOduration=8.003406457 podStartE2EDuration="20.953993125s" totalImagesPullingTime="12.950586668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:45:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:27.953537102 +0000 UTC m=+21.843566522" watchObservedRunningTime="2026-11-04 04:45:27.953993125 +0000 UTC m=+21.844022546" Nov 04 04:45:28.838231 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:28.838186 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" event={"ID":"8272e327-372c-4b8c-9ca3-acf950c43690","Type":"ContainerStarted","Data":"151f7be4f076da126a7b7dc9aa0293b3f96ee68e3e6b69ca68a8eab8338ee3b5"} Nov 04 04:45:29.121771 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:29.121721 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" podStartSLOduration=7.122287603 podStartE2EDuration="22.121708061s" totalImagesPullingTime="14.999420458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:29.070732615 +0000 UTC m=+22.960762035" watchObservedRunningTime="2026-11-04 04:45:29.121708061 +0000 UTC m=+23.011737472" Nov 04 04:45:29.674688 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:29.674660 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:29.674912 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:29.674770 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:29.674912 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:29.674780 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:29.674912 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:29.674800 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:29.674912 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:29.674883 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:29.675086 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:29.674947 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:29.839905 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:29.839884 2573 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 04:45:29.840459 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:29.840337 2573 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:29.840459 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:29.840418 2573 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:29.855374 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:29.855355 2573 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:29.855517 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:29.855490 2573 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:30.057299 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:30.057251 2573 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:31.502288 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:31.502247 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cnvdz"] Nov 04 04:45:31.502850 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:31.502366 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:31.502850 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:31.502459 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:31.505043 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:31.505022 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f7dtz"] Nov 04 04:45:31.505151 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:31.505097 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:31.505190 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:31.505167 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:31.553475 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:31.553449 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d25j9"] Nov 04 04:45:31.553583 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:31.553536 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:31.553632 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:31.553616 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:32.639646 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:32.639619 2573 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:32.640040 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:32.639754 2573 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 04:45:32.640152 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:32.640133 2573 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:33.674244 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:33.674217 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:33.674705 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:33.674316 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:33.674705 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:33.674429 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:33.674705 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:33.674450 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:33.674705 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:33.674506 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:33.674705 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:33.674564 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:35.674248 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:35.674217 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:35.674731 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:35.674252 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:35.674731 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:35.674350 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7dtz" podUID="6febe6fa-de9b-47eb-a036-a63aea789894" Nov 04 04:45:35.674731 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:35.674380 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnvdz" podUID="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" Nov 04 04:45:35.674731 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:35.674432 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:35.674731 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:35.674522 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d25j9" podUID="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" Nov 04 04:45:37.424184 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.424160 2573 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeReady" Nov 04 04:45:37.424595 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.424257 2573 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 04 04:45:37.582869 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.582841 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-vc88q"] Nov 04 04:45:37.584829 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.584810 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-blxqr"] Nov 04 04:45:37.584959 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.584939 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-vc88q" Nov 04 04:45:37.586407 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.586386 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-trz8n"] Nov 04 04:45:37.586599 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.586562 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-blxqr" Nov 04 04:45:37.588092 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.588075 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-trz8n" Nov 04 04:45:37.592803 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.592782 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c46895cdd-h2frf"] Nov 04 04:45:37.594812 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.594794 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b"] Nov 04 04:45:37.595610 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.594914 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.597047 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.597028 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d56d655f9-pdqrc"] Nov 04 04:45:37.597448 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.597423 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:37.600295 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.599976 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5"] Nov 04 04:45:37.600295 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.600081 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.602724 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.602035 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-tqfqb"] Nov 04 04:45:37.602724 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.602155 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:37.603701 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.603683 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-8959q"] Nov 04 04:45:37.603783 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.603745 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.605521 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.605505 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:37.634236 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.634215 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-867f9c6749-4gj2n"] Nov 04 04:45:37.644482 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.644223 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68"] Nov 04 04:45:37.648257 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.646124 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.648257 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.646538 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Nov 04 04:45:37.648257 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.646614 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Nov 04 04:45:37.648899 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.648882 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v"] Nov 04 04:45:37.649155 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.649014 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:37.651226 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.651206 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh"] Nov 04 04:45:37.651433 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.651412 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:37.653082 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.653059 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-crv79"] Nov 04 04:45:37.653464 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.653417 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh" Nov 04 04:45:37.656566 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.656547 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5"] Nov 04 04:45:37.657584 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.657566 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.659318 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.659299 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vqqr6"] Nov 04 04:45:37.659549 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.659532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5" Nov 04 04:45:37.662112 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.662091 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ntz9h"] Nov 04 04:45:37.662229 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.662211 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vqqr6" Nov 04 04:45:37.664194 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.664176 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-trz8n"] Nov 04 04:45:37.664286 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.664213 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-vc88q"] Nov 04 04:45:37.664286 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.664229 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-blxqr"] Nov 04 04:45:37.664286 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.664241 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c46895cdd-h2frf"] Nov 04 04:45:37.664286 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.664252 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b"] Nov 04 04:45:37.664286 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.664287 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh"] Nov 04 04:45:37.664453 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.664303 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-8959q"] Nov 04 04:45:37.664453 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.664315 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68"] Nov 04 04:45:37.664453 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.664327 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5"] Nov 04 04:45:37.664453 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.664343 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v"] Nov 04 04:45:37.664453 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.664412 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:37.674524 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.674475 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:37.674524 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.674495 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:37.674680 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.674666 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:37.682024 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682004 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbfnh\" (UniqueName: \"kubernetes.io/projected/e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1-kube-api-access-bbfnh\") pod \"kas-connection-checker-685895c7c9-blxqr\" (UID: \"e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1\") " pod="kube-system/kas-connection-checker-685895c7c9-blxqr" Nov 04 04:45:37.682105 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682037 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.682105 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682066 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-stats-auth\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.682105 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682094 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e75df29-4521-44fa-babe-a45b73155b91-serving-cert\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.682211 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:37.682211 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682196 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxtdj\" (UniqueName: \"kubernetes.io/projected/0483be54-d5f5-4555-89c9-ef61cbee16ad-kube-api-access-hxtdj\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:37.682318 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682300 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-installation-pull-secrets\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.682368 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.682410 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682381 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxcd2\" (UniqueName: \"kubernetes.io/projected/0f55afb7-c026-4ad5-afe1-6c133692689e-kube-api-access-wxcd2\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.682447 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682407 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-trusted-ca\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.682447 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682433 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptvfj\" (UniqueName: \"kubernetes.io/projected/a9dc342a-1857-4691-a57b-d1672547d10c-kube-api-access-ptvfj\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:37.682510 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e75df29-4521-44fa-babe-a45b73155b91-trusted-ca\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.682547 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682519 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj7qq\" (UniqueName: \"kubernetes.io/projected/6e75df29-4521-44fa-babe-a45b73155b91-kube-api-access-pj7qq\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.682622 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682594 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-default-certificate\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.682732 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:37.682732 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-image-registry-private-configuration\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.682732 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682718 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-certificates\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.682888 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682741 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9dc342a-1857-4691-a57b-d1672547d10c-serving-cert\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:37.682888 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:37.682888 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682819 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24e214b2-5e33-4022-8f14-edf1cb11f820-ca-trust-extracted\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.682888 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682847 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9dc342a-1857-4691-a57b-d1672547d10c-config\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:37.682888 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682872 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:37.683115 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e75df29-4521-44fa-babe-a45b73155b91-config\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.683115 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682921 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-bound-sa-token\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.683115 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682959 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c59zf\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-kube-api-access-c59zf\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.683115 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.682989 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v27tp\" (UniqueName: \"kubernetes.io/projected/70407c80-19ed-467f-a4a4-8ff150518aef-kube-api-access-v27tp\") pod \"kas-connection-checker-685895c7c9-vc88q\" (UID: \"70407c80-19ed-467f-a4a4-8ff150518aef\") " pod="kube-system/kas-connection-checker-685895c7c9-vc88q" Nov 04 04:45:37.683115 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.683039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.683362 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.683144 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f45v\" (UniqueName: \"kubernetes.io/projected/d035486c-ba72-485c-88f9-0733ea426168-kube-api-access-6f45v\") pod \"kas-connection-checker-685895c7c9-trz8n\" (UID: \"d035486c-ba72-485c-88f9-0733ea426168\") " pod="kube-system/kas-connection-checker-685895c7c9-trz8n" Nov 04 04:45:37.685544 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.685524 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d56d655f9-pdqrc"] Nov 04 04:45:37.695722 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.695702 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 04 04:45:37.695857 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.695779 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 04 04:45:37.695982 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.695959 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 04 04:45:37.695982 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.695969 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sfklt\"" Nov 04 04:45:37.696101 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.696021 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Nov 04 04:45:37.696141 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.696103 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 04 04:45:37.697033 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.697016 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5"] Nov 04 04:45:37.697653 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.697635 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ntz9h"] Nov 04 04:45:37.698162 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.698147 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-tqfqb"] Nov 04 04:45:37.698701 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.698683 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vqqr6"] Nov 04 04:45:37.737032 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.737013 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-crv79"] Nov 04 04:45:37.738237 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.738218 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-867f9c6749-4gj2n"] Nov 04 04:45:37.745495 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745449 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:37.745594 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745500 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 04 04:45:37.745594 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745499 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:37.745736 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745718 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Nov 04 04:45:37.745797 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745741 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 04:45:37.745797 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745741 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 04:45:37.745797 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745770 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 04 04:45:37.745797 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745784 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 04:45:37.746015 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745862 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Nov 04 04:45:37.746015 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745949 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:37.746015 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745961 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 04 04:45:37.746015 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745969 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:37.746015 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745968 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Nov 04 04:45:37.746015 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745994 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 04:45:37.746015 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.745997 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:37.746015 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.746008 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Nov 04 04:45:37.746015 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.746007 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:37.746410 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.746023 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Nov 04 04:45:37.746410 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.746197 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:37.746410 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.746210 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 04:45:37.746410 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.746237 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:37.746410 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.746314 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:37.746410 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.746370 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 04:45:37.746410 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.746377 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:37.746410 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.746384 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 04:45:37.746410 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.746369 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 04:45:37.746783 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.746416 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 04:45:37.747231 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.747217 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Nov 04 04:45:37.783776 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.783752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-installation-pull-secrets\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.783860 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.783782 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9wkm\" (UniqueName: \"kubernetes.io/projected/68796d82-fed3-494a-8239-32c07fa7c466-kube-api-access-p9wkm\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.783860 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.783799 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:37.783860 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.783816 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5ccn\" (UniqueName: \"kubernetes.io/projected/c04074e7-79db-4586-9c75-ec922314ba54-kube-api-access-c5ccn\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:37.783992 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.783870 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9dc342a-1857-4691-a57b-d1672547d10c-serving-cert\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:37.783992 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.783896 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d49dda15-d5d9-414e-b552-0d9bcab7bba0-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:37.783992 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.783937 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68796d82-fed3-494a-8239-32c07fa7c466-snapshots\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.784148 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784044 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk2nv\" (UniqueName: \"kubernetes.io/projected/d49dda15-d5d9-414e-b552-0d9bcab7bba0-kube-api-access-kk2nv\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:37.784148 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784075 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrsrc\" (UniqueName: \"kubernetes.io/projected/474ac538-e679-400a-89ee-db708dfcddda-kube-api-access-hrsrc\") pod \"network-check-source-6f78d59f99-r8sp5\" (UID: \"474ac538-e679-400a-89ee-db708dfcddda\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5" Nov 04 04:45:37.784148 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784117 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24e214b2-5e33-4022-8f14-edf1cb11f820-ca-trust-extracted\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.784148 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784138 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34bc4578-ce85-4a2d-9f94-0305ae3267f2-cert\") pod \"ingress-canary-vqqr6\" (UID: \"34bc4578-ce85-4a2d-9f94-0305ae3267f2\") " pod="openshift-ingress-canary/ingress-canary-vqqr6" Nov 04 04:45:37.784389 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784161 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9dc342a-1857-4691-a57b-d1672547d10c-config\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:37.784389 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784176 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:37.784389 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784290 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e75df29-4521-44fa-babe-a45b73155b91-config\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.784389 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784328 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:37.784389 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j7m2\" (UniqueName: \"kubernetes.io/projected/34bc4578-ce85-4a2d-9f94-0305ae3267f2-kube-api-access-8j7m2\") pod \"ingress-canary-vqqr6\" (UID: \"34bc4578-ce85-4a2d-9f94-0305ae3267f2\") " pod="openshift-ingress-canary/ingress-canary-vqqr6" Nov 04 04:45:37.784627 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784408 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c59zf\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-kube-api-access-c59zf\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.784627 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784435 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68796d82-fed3-494a-8239-32c07fa7c466-service-ca-bundle\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.784627 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784462 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24e214b2-5e33-4022-8f14-edf1cb11f820-ca-trust-extracted\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.784627 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784477 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68796d82-fed3-494a-8239-32c07fa7c466-serving-cert\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.784627 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784571 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f45v\" (UniqueName: \"kubernetes.io/projected/d035486c-ba72-485c-88f9-0733ea426168-kube-api-access-6f45v\") pod \"kas-connection-checker-685895c7c9-trz8n\" (UID: \"d035486c-ba72-485c-88f9-0733ea426168\") " pod="kube-system/kas-connection-checker-685895c7c9-trz8n" Nov 04 04:45:37.784627 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784615 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6491499f-48db-4ee8-9cc1-b27029b2c033-config-volume\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:37.784918 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-stats-auth\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.784918 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784795 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e75df29-4521-44fa-babe-a45b73155b91-serving-cert\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.784918 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784827 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9dc342a-1857-4691-a57b-d1672547d10c-config\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:37.784918 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784845 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:37.784918 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtdj\" (UniqueName: \"kubernetes.io/projected/0483be54-d5f5-4555-89c9-ef61cbee16ad-kube-api-access-hxtdj\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:37.784918 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784915 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-bound-sa-token\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.785184 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784927 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:37.785184 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784945 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.785184 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.784967 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e75df29-4521-44fa-babe-a45b73155b91-config\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.785184 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785019 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxcd2\" (UniqueName: \"kubernetes.io/projected/0f55afb7-c026-4ad5-afe1-6c133692689e-kube-api-access-wxcd2\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.785184 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785050 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-default-certificate\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.785184 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785075 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-image-registry-private-configuration\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.785184 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785097 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-trusted-ca\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.785184 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785115 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-certificates\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.785184 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785140 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-image-registry-private-configuration\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.785184 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785176 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7074b62a-f130-413b-ae9d-53b113f9f58c-ca-trust-extracted\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785220 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-bound-sa-token\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-certificates\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785307 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c04074e7-79db-4586-9c75-ec922314ba54-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785332 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68796d82-fed3-494a-8239-32c07fa7c466-tmp\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785367 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6491499f-48db-4ee8-9cc1-b27029b2c033-tmp-dir\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785397 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68796d82-fed3-494a-8239-32c07fa7c466-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785481 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v27tp\" (UniqueName: \"kubernetes.io/projected/70407c80-19ed-467f-a4a4-8ff150518aef-kube-api-access-v27tp\") pod \"kas-connection-checker-685895c7c9-vc88q\" (UID: \"70407c80-19ed-467f-a4a4-8ff150518aef\") " pod="kube-system/kas-connection-checker-685895c7c9-vc88q" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785644 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c04074e7-79db-4586-9c75-ec922314ba54-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785676 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-certificates\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.785692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785691 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbfnh\" (UniqueName: \"kubernetes.io/projected/e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1-kube-api-access-bbfnh\") pod \"kas-connection-checker-685895c7c9-blxqr\" (UID: \"e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1\") " pod="kube-system/kas-connection-checker-685895c7c9-blxqr" Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.785704 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.785721 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46895cdd-h2frf: secret "image-registry-tls" not found Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785753 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.785768 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls podName:24e214b2-5e33-4022-8f14-edf1cb11f820 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:38.285750592 +0000 UTC m=+32.175780006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls") pod "image-registry-6c46895cdd-h2frf" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820") : secret "image-registry-tls" not found Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785797 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xv8k\" (UniqueName: \"kubernetes.io/projected/6491499f-48db-4ee8-9cc1-b27029b2c033-kube-api-access-4xv8k\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785822 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84g42\" (UniqueName: \"kubernetes.io/projected/9283e782-7152-4c67-8ce3-e07042df088b-kube-api-access-84g42\") pod \"volume-data-source-validator-58c9f5f46d-jqjsh\" (UID: \"9283e782-7152-4c67-8ce3-e07042df088b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh" Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.785843 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle podName:0f55afb7-c026-4ad5-afe1-6c133692689e nodeName:}" failed. No retries permitted until 2026-11-04 04:45:38.285830907 +0000 UTC m=+32.175860329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle") pod "router-default-5d56d655f9-pdqrc" (UID: "0f55afb7-c026-4ad5-afe1-6c133692689e") : configmap references non-existent config key: service-ca.crt Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785875 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-installation-pull-secrets\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785907 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m66bl\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-kube-api-access-m66bl\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785954 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-trusted-ca\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.785998 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptvfj\" (UniqueName: \"kubernetes.io/projected/a9dc342a-1857-4691-a57b-d1672547d10c-kube-api-access-ptvfj\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.786035 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e75df29-4521-44fa-babe-a45b73155b91-trusted-ca\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.786063 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj7qq\" (UniqueName: \"kubernetes.io/projected/6e75df29-4521-44fa-babe-a45b73155b91-kube-api-access-pj7qq\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.786295 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.786089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:37.786912 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.786771 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-trusted-ca\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.786912 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.786786 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:37.787715 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.787688 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 04 04:45:37.788156 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.788139 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Nov 04 04:45:37.788775 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.788753 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-image-registry-private-configuration\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.788864 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.788756 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-installation-pull-secrets\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.789800 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.789779 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Nov 04 04:45:37.796617 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.796585 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Nov 04 04:45:37.796706 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.796603 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Nov 04 04:45:37.796951 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.796930 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Nov 04 04:45:37.797029 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.796942 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Nov 04 04:45:37.797085 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797057 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-rrdk2\"" Nov 04 04:45:37.797085 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797067 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 04:45:37.797178 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797100 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 04:45:37.797178 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797151 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m97m8\"" Nov 04 04:45:37.797178 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797159 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 04:45:37.797347 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797180 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-45k46\"" Nov 04 04:45:37.797347 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797198 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Nov 04 04:45:37.797347 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797214 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Nov 04 04:45:37.797347 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797240 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Nov 04 04:45:37.797347 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797243 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Nov 04 04:45:37.797347 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797251 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 04:45:37.797347 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797285 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Nov 04 04:45:37.797347 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797291 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jn85r\"" Nov 04 04:45:37.797347 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797344 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-4k9ql\"" Nov 04 04:45:37.797728 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e75df29-4521-44fa-babe-a45b73155b91-trusted-ca\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.797728 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.797490 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-hmct5\"" Nov 04 04:45:37.805718 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.805669 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:45:37.805718 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.805684 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 04:45:37.805718 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.805705 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:45:37.805921 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.805723 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert podName:c8dfe4c5-4264-40e3-a284-69e2d64be1f5 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:38.305707291 +0000 UTC m=+32.195736707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8959q" (UID: "c8dfe4c5-4264-40e3-a284-69e2d64be1f5") : secret "networking-console-plugin-cert" not found Nov 04 04:45:37.805921 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.805742 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs podName:0f55afb7-c026-4ad5-afe1-6c133692689e nodeName:}" failed. No retries permitted until 2026-11-04 04:45:38.305731965 +0000 UTC m=+32.195761401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs") pod "router-default-5d56d655f9-pdqrc" (UID: "0f55afb7-c026-4ad5-afe1-6c133692689e") : secret "router-metrics-certs-default" not found Nov 04 04:45:37.805921 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.805758 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls podName:0483be54-d5f5-4555-89c9-ef61cbee16ad nodeName:}" failed. No retries permitted until 2026-11-04 04:45:38.30574934 +0000 UTC m=+32.195778738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-zzpt5" (UID: "0483be54-d5f5-4555-89c9-ef61cbee16ad") : secret "samples-operator-tls" not found Nov 04 04:45:37.806156 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.806136 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9dc342a-1857-4691-a57b-d1672547d10c-serving-cert\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:37.807598 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.807580 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-stats-auth\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.808172 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.808150 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e75df29-4521-44fa-babe-a45b73155b91-serving-cert\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.808253 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.808231 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-default-certificate\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.847005 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.846973 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f45v\" (UniqueName: \"kubernetes.io/projected/d035486c-ba72-485c-88f9-0733ea426168-kube-api-access-6f45v\") pod \"kas-connection-checker-685895c7c9-trz8n\" (UID: \"d035486c-ba72-485c-88f9-0733ea426168\") " pod="kube-system/kas-connection-checker-685895c7c9-trz8n" Nov 04 04:45:37.847107 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.847050 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c59zf\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-kube-api-access-c59zf\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.848205 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.848180 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-bound-sa-token\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:37.848399 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.848377 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v27tp\" (UniqueName: \"kubernetes.io/projected/70407c80-19ed-467f-a4a4-8ff150518aef-kube-api-access-v27tp\") pod \"kas-connection-checker-685895c7c9-vc88q\" (UID: \"70407c80-19ed-467f-a4a4-8ff150518aef\") " pod="kube-system/kas-connection-checker-685895c7c9-vc88q" Nov 04 04:45:37.848505 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.848448 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbfnh\" (UniqueName: \"kubernetes.io/projected/e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1-kube-api-access-bbfnh\") pod \"kas-connection-checker-685895c7c9-blxqr\" (UID: \"e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1\") " pod="kube-system/kas-connection-checker-685895c7c9-blxqr" Nov 04 04:45:37.849329 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.849307 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxcd2\" (UniqueName: \"kubernetes.io/projected/0f55afb7-c026-4ad5-afe1-6c133692689e-kube-api-access-wxcd2\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:37.849416 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.849315 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxtdj\" (UniqueName: \"kubernetes.io/projected/0483be54-d5f5-4555-89c9-ef61cbee16ad-kube-api-access-hxtdj\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:37.849568 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.849551 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj7qq\" (UniqueName: \"kubernetes.io/projected/6e75df29-4521-44fa-babe-a45b73155b91-kube-api-access-pj7qq\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.849625 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.849575 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptvfj\" (UniqueName: \"kubernetes.io/projected/a9dc342a-1857-4691-a57b-d1672547d10c-kube-api-access-ptvfj\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:37.887289 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887251 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xv8k\" (UniqueName: \"kubernetes.io/projected/6491499f-48db-4ee8-9cc1-b27029b2c033-kube-api-access-4xv8k\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:37.887408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887294 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84g42\" (UniqueName: \"kubernetes.io/projected/9283e782-7152-4c67-8ce3-e07042df088b-kube-api-access-84g42\") pod \"volume-data-source-validator-58c9f5f46d-jqjsh\" (UID: \"9283e782-7152-4c67-8ce3-e07042df088b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh" Nov 04 04:45:37.887408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887314 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m66bl\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-kube-api-access-m66bl\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.887408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887334 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-installation-pull-secrets\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.887408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887353 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9wkm\" (UniqueName: \"kubernetes.io/projected/68796d82-fed3-494a-8239-32c07fa7c466-kube-api-access-p9wkm\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.887408 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:37.887624 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.887456 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:45:37.887624 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887479 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5ccn\" (UniqueName: \"kubernetes.io/projected/c04074e7-79db-4586-9c75-ec922314ba54-kube-api-access-c5ccn\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:37.887624 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.887506 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls podName:6491499f-48db-4ee8-9cc1-b27029b2c033 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:38.387490168 +0000 UTC m=+32.277519567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls") pod "dns-default-ntz9h" (UID: "6491499f-48db-4ee8-9cc1-b27029b2c033") : secret "dns-default-metrics-tls" not found Nov 04 04:45:37.887624 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887538 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d49dda15-d5d9-414e-b552-0d9bcab7bba0-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:37.887624 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887562 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68796d82-fed3-494a-8239-32c07fa7c466-snapshots\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.887624 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887591 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk2nv\" (UniqueName: \"kubernetes.io/projected/d49dda15-d5d9-414e-b552-0d9bcab7bba0-kube-api-access-kk2nv\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:37.887624 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrsrc\" (UniqueName: \"kubernetes.io/projected/474ac538-e679-400a-89ee-db708dfcddda-kube-api-access-hrsrc\") pod \"network-check-source-6f78d59f99-r8sp5\" (UID: \"474ac538-e679-400a-89ee-db708dfcddda\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5" Nov 04 04:45:37.887955 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887655 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34bc4578-ce85-4a2d-9f94-0305ae3267f2-cert\") pod \"ingress-canary-vqqr6\" (UID: \"34bc4578-ce85-4a2d-9f94-0305ae3267f2\") " pod="openshift-ingress-canary/ingress-canary-vqqr6" Nov 04 04:45:37.887955 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887693 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:37.887955 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887720 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j7m2\" (UniqueName: \"kubernetes.io/projected/34bc4578-ce85-4a2d-9f94-0305ae3267f2-kube-api-access-8j7m2\") pod \"ingress-canary-vqqr6\" (UID: \"34bc4578-ce85-4a2d-9f94-0305ae3267f2\") " pod="openshift-ingress-canary/ingress-canary-vqqr6" Nov 04 04:45:37.887955 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68796d82-fed3-494a-8239-32c07fa7c466-service-ca-bundle\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.887955 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887787 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68796d82-fed3-494a-8239-32c07fa7c466-serving-cert\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.887955 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887819 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6491499f-48db-4ee8-9cc1-b27029b2c033-config-volume\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:37.887955 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.887826 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:37.887955 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.887875 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls podName:d49dda15-d5d9-414e-b552-0d9bcab7bba0 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:38.387861094 +0000 UTC m=+32.277890500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fzt9v" (UID: "d49dda15-d5d9-414e-b552-0d9bcab7bba0") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:37.887955 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887895 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-bound-sa-token\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.888414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887960 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-trusted-ca\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.888414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.887995 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-image-registry-private-configuration\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.888414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7074b62a-f130-413b-ae9d-53b113f9f58c-ca-trust-extracted\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.888414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-certificates\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.888414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888116 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c04074e7-79db-4586-9c75-ec922314ba54-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:37.888414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888144 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68796d82-fed3-494a-8239-32c07fa7c466-tmp\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.888414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6491499f-48db-4ee8-9cc1-b27029b2c033-tmp-dir\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:37.888414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888199 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.888414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888224 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68796d82-fed3-494a-8239-32c07fa7c466-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.888414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888242 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68796d82-fed3-494a-8239-32c07fa7c466-snapshots\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.888414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888285 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c04074e7-79db-4586-9c75-ec922314ba54-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:37.888414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888328 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d49dda15-d5d9-414e-b552-0d9bcab7bba0-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:37.888996 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68796d82-fed3-494a-8239-32c07fa7c466-tmp\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.888996 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888677 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6491499f-48db-4ee8-9cc1-b27029b2c033-config-volume\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:37.888996 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.888784 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:37.888996 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.888802 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867f9c6749-4gj2n: secret "image-registry-tls" not found Nov 04 04:45:37.888996 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:37.888853 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls podName:7074b62a-f130-413b-ae9d-53b113f9f58c nodeName:}" failed. No retries permitted until 2026-11-04 04:45:38.38883961 +0000 UTC m=+32.278869014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls") pod "image-registry-867f9c6749-4gj2n" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c") : secret "image-registry-tls" not found Nov 04 04:45:37.888996 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.888911 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-certificates\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.889325 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.889245 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c04074e7-79db-4586-9c75-ec922314ba54-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:37.889551 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.889526 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6491499f-48db-4ee8-9cc1-b27029b2c033-tmp-dir\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:37.889617 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.889581 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-trusted-ca\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.890162 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.890131 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68796d82-fed3-494a-8239-32c07fa7c466-service-ca-bundle\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.890241 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.890202 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-installation-pull-secrets\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.890449 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.890426 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68796d82-fed3-494a-8239-32c07fa7c466-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.890449 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.890439 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7074b62a-f130-413b-ae9d-53b113f9f58c-ca-trust-extracted\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.890547 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.890438 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34bc4578-ce85-4a2d-9f94-0305ae3267f2-cert\") pod \"ingress-canary-vqqr6\" (UID: \"34bc4578-ce85-4a2d-9f94-0305ae3267f2\") " pod="openshift-ingress-canary/ingress-canary-vqqr6" Nov 04 04:45:37.890547 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.890444 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68796d82-fed3-494a-8239-32c07fa7c466-serving-cert\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.891120 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.891103 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-image-registry-private-configuration\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.892028 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.892003 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c04074e7-79db-4586-9c75-ec922314ba54-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:37.897384 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.897367 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-vc88q" Nov 04 04:45:37.905348 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.905329 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-blxqr" Nov 04 04:45:37.910269 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.910244 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-trz8n" Nov 04 04:45:37.922008 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.921971 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:37.946069 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.945984 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:37.950708 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.950646 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xv8k\" (UniqueName: \"kubernetes.io/projected/6491499f-48db-4ee8-9cc1-b27029b2c033-kube-api-access-4xv8k\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:37.951916 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.951884 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-bound-sa-token\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.953102 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.953076 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84g42\" (UniqueName: \"kubernetes.io/projected/9283e782-7152-4c67-8ce3-e07042df088b-kube-api-access-84g42\") pod \"volume-data-source-validator-58c9f5f46d-jqjsh\" (UID: \"9283e782-7152-4c67-8ce3-e07042df088b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh" Nov 04 04:45:37.969803 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.968000 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrsrc\" (UniqueName: \"kubernetes.io/projected/474ac538-e679-400a-89ee-db708dfcddda-kube-api-access-hrsrc\") pod \"network-check-source-6f78d59f99-r8sp5\" (UID: \"474ac538-e679-400a-89ee-db708dfcddda\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5" Nov 04 04:45:37.970940 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.970843 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m66bl\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-kube-api-access-m66bl\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:37.971414 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.971392 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j7m2\" (UniqueName: \"kubernetes.io/projected/34bc4578-ce85-4a2d-9f94-0305ae3267f2-kube-api-access-8j7m2\") pod \"ingress-canary-vqqr6\" (UID: \"34bc4578-ce85-4a2d-9f94-0305ae3267f2\") " pod="openshift-ingress-canary/ingress-canary-vqqr6" Nov 04 04:45:37.972622 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.972603 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9wkm\" (UniqueName: \"kubernetes.io/projected/68796d82-fed3-494a-8239-32c07fa7c466-kube-api-access-p9wkm\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.972773 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.972751 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5ccn\" (UniqueName: \"kubernetes.io/projected/c04074e7-79db-4586-9c75-ec922314ba54-kube-api-access-c5ccn\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:37.972848 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.972833 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk2nv\" (UniqueName: \"kubernetes.io/projected/d49dda15-d5d9-414e-b552-0d9bcab7bba0-kube-api-access-kk2nv\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:37.985231 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.982465 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh" Nov 04 04:45:37.991068 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.990874 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:37.994519 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:37.994357 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5" Nov 04 04:45:38.000757 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.000609 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vqqr6" Nov 04 04:45:38.271370 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.271301 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:38.287098 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.287076 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-blxqr"] Nov 04 04:45:38.290115 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.290042 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-vc88q"] Nov 04 04:45:38.290603 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:38.290585 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3dc8d87_0f90_48cc_9aec_f40a2fe78ba1.slice/crio-f094f3c122dcdcf0590860fb5c64e0f2695f384cc9e02611d4bc7d57e25c19e2 WatchSource:0}: Error finding container f094f3c122dcdcf0590860fb5c64e0f2695f384cc9e02611d4bc7d57e25c19e2: Status 404 returned error can't find the container with id f094f3c122dcdcf0590860fb5c64e0f2695f384cc9e02611d4bc7d57e25c19e2 Nov 04 04:45:38.292772 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.292745 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:38.292869 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.292803 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:38.292934 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.292865 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:38.292934 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.292879 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46895cdd-h2frf: secret "image-registry-tls" not found Nov 04 04:45:38.292934 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.292930 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls podName:24e214b2-5e33-4022-8f14-edf1cb11f820 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:39.292912913 +0000 UTC m=+33.182942326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls") pod "image-registry-6c46895cdd-h2frf" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820") : secret "image-registry-tls" not found Nov 04 04:45:38.293090 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:38.292894 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70407c80_19ed_467f_a4a4_8ff150518aef.slice/crio-469e9630a173a2dd8817830d3d87dea45f803e17fbedd5930cdc5b16f84a8358 WatchSource:0}: Error finding container 469e9630a173a2dd8817830d3d87dea45f803e17fbedd5930cdc5b16f84a8358: Status 404 returned error can't find the container with id 469e9630a173a2dd8817830d3d87dea45f803e17fbedd5930cdc5b16f84a8358 Nov 04 04:45:38.293090 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.292964 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle podName:0f55afb7-c026-4ad5-afe1-6c133692689e nodeName:}" failed. No retries permitted until 2026-11-04 04:45:39.292947402 +0000 UTC m=+33.182976815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle") pod "router-default-5d56d655f9-pdqrc" (UID: "0f55afb7-c026-4ad5-afe1-6c133692689e") : configmap references non-existent config key: service-ca.crt Nov 04 04:45:38.307631 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.307610 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-trz8n"] Nov 04 04:45:38.324456 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:38.324424 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd035486c_ba72_485c_88f9_0733ea426168.slice/crio-595ebab5af0e3dc13e715b55966b7bece769b25159bd2e615d82b85baa49f9c8 WatchSource:0}: Error finding container 595ebab5af0e3dc13e715b55966b7bece769b25159bd2e615d82b85baa49f9c8: Status 404 returned error can't find the container with id 595ebab5af0e3dc13e715b55966b7bece769b25159bd2e615d82b85baa49f9c8 Nov 04 04:45:38.346725 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.346698 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b"] Nov 04 04:45:38.357007 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.356976 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-tqfqb"] Nov 04 04:45:38.362015 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:38.361990 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9dc342a_1857_4691_a57b_d1672547d10c.slice/crio-72e78e303790e31c3cf6b560634ba9a36635f6109359974e50edd2a92e2375da WatchSource:0}: Error finding container 72e78e303790e31c3cf6b560634ba9a36635f6109359974e50edd2a92e2375da: Status 404 returned error can't find the container with id 72e78e303790e31c3cf6b560634ba9a36635f6109359974e50edd2a92e2375da Nov 04 04:45:38.362323 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:38.362300 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e75df29_4521_44fa_babe_a45b73155b91.slice/crio-2631258c5b789f74650eef2e57a7f6affd10af1a0e530510a4f1bc1648e567ab WatchSource:0}: Error finding container 2631258c5b789f74650eef2e57a7f6affd10af1a0e530510a4f1bc1648e567ab: Status 404 returned error can't find the container with id 2631258c5b789f74650eef2e57a7f6affd10af1a0e530510a4f1bc1648e567ab Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.393618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.393716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.393774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.393830 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.393862 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.393908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394036 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394090 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert podName:c8dfe4c5-4264-40e3-a284-69e2d64be1f5 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:39.394072403 +0000 UTC m=+33.284101805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8959q" (UID: "c8dfe4c5-4264-40e3-a284-69e2d64be1f5") : secret "networking-console-plugin-cert" not found Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394158 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394170 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867f9c6749-4gj2n: secret "image-registry-tls" not found Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394200 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls podName:7074b62a-f130-413b-ae9d-53b113f9f58c nodeName:}" failed. No retries permitted until 2026-11-04 04:45:39.394189888 +0000 UTC m=+33.284219304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls") pod "image-registry-867f9c6749-4gj2n" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c") : secret "image-registry-tls" not found Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394275 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394308 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls podName:6491499f-48db-4ee8-9cc1-b27029b2c033 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:39.394297968 +0000 UTC m=+33.284327368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls") pod "dns-default-ntz9h" (UID: "6491499f-48db-4ee8-9cc1-b27029b2c033") : secret "dns-default-metrics-tls" not found Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394363 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394393 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls podName:d49dda15-d5d9-414e-b552-0d9bcab7bba0 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:39.39438314 +0000 UTC m=+33.284412540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fzt9v" (UID: "d49dda15-d5d9-414e-b552-0d9bcab7bba0") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:38.394578 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394446 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:45:38.395386 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394477 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls podName:0483be54-d5f5-4555-89c9-ef61cbee16ad nodeName:}" failed. No retries permitted until 2026-11-04 04:45:39.394465893 +0000 UTC m=+33.284495293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-zzpt5" (UID: "0483be54-d5f5-4555-89c9-ef61cbee16ad") : secret "samples-operator-tls" not found Nov 04 04:45:38.395386 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394524 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 04:45:38.395386 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:38.394549 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs podName:0f55afb7-c026-4ad5-afe1-6c133692689e nodeName:}" failed. No retries permitted until 2026-11-04 04:45:39.394540807 +0000 UTC m=+33.284570207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs") pod "router-default-5d56d655f9-pdqrc" (UID: "0f55afb7-c026-4ad5-afe1-6c133692689e") : secret "router-metrics-certs-default" not found Nov 04 04:45:38.415429 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.415404 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-crv79"] Nov 04 04:45:38.421456 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:38.421426 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68796d82_fed3_494a_8239_32c07fa7c466.slice/crio-93f479b4ebd56a9c144f484e9b5589106530614777dada64be7e1642af1a7892 WatchSource:0}: Error finding container 93f479b4ebd56a9c144f484e9b5589106530614777dada64be7e1642af1a7892: Status 404 returned error can't find the container with id 93f479b4ebd56a9c144f484e9b5589106530614777dada64be7e1642af1a7892 Nov 04 04:45:38.431742 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.431720 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5"] Nov 04 04:45:38.434890 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.434868 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vqqr6"] Nov 04 04:45:38.436520 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.435541 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh"] Nov 04 04:45:38.436856 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:38.436835 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474ac538_e679_400a_89ee_db708dfcddda.slice/crio-97979a55cc531c74cdce3ffc71aade9a5e4badbf06595870d591194d8bef4669 WatchSource:0}: Error finding container 97979a55cc531c74cdce3ffc71aade9a5e4badbf06595870d591194d8bef4669: Status 404 returned error can't find the container with id 97979a55cc531c74cdce3ffc71aade9a5e4badbf06595870d591194d8bef4669 Nov 04 04:45:38.438221 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:38.438200 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9283e782_7152_4c67_8ce3_e07042df088b.slice/crio-db7c8953a88e5b1720836276cb1bdf0f1c33e86f476714dd69873cada67401d7 WatchSource:0}: Error finding container db7c8953a88e5b1720836276cb1bdf0f1c33e86f476714dd69873cada67401d7: Status 404 returned error can't find the container with id db7c8953a88e5b1720836276cb1bdf0f1c33e86f476714dd69873cada67401d7 Nov 04 04:45:38.439254 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:38.439188 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34bc4578_ce85_4a2d_9f94_0305ae3267f2.slice/crio-ba7e63ca6944959cffca724e2e68bd6fa51f8b2e71c82007accd3bd60fbec813 WatchSource:0}: Error finding container ba7e63ca6944959cffca724e2e68bd6fa51f8b2e71c82007accd3bd60fbec813: Status 404 returned error can't find the container with id ba7e63ca6944959cffca724e2e68bd6fa51f8b2e71c82007accd3bd60fbec813 Nov 04 04:45:38.650672 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.650645 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68"] Nov 04 04:45:38.653496 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:38.653470 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc04074e7_79db_4586_9c75_ec922314ba54.slice/crio-03fc0594b65365a6463b37907f6da78499301fc622db6af8a3a878079e4a5ad6 WatchSource:0}: Error finding container 03fc0594b65365a6463b37907f6da78499301fc622db6af8a3a878079e4a5ad6: Status 404 returned error can't find the container with id 03fc0594b65365a6463b37907f6da78499301fc622db6af8a3a878079e4a5ad6 Nov 04 04:45:38.859064 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.859034 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh" event={"ID":"9283e782-7152-4c67-8ce3-e07042df088b","Type":"ContainerStarted","Data":"db7c8953a88e5b1720836276cb1bdf0f1c33e86f476714dd69873cada67401d7"} Nov 04 04:45:38.860467 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.860434 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-vc88q" event={"ID":"70407c80-19ed-467f-a4a4-8ff150518aef","Type":"ContainerStarted","Data":"15b614d158e464c04682febfdc1b1a61b500331105e00c7b1dcc660477d57c84"} Nov 04 04:45:38.860617 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.860483 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-vc88q" event={"ID":"70407c80-19ed-467f-a4a4-8ff150518aef","Type":"ContainerStarted","Data":"469e9630a173a2dd8817830d3d87dea45f803e17fbedd5930cdc5b16f84a8358"} Nov 04 04:45:38.861646 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.861621 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5" event={"ID":"474ac538-e679-400a-89ee-db708dfcddda","Type":"ContainerStarted","Data":"97979a55cc531c74cdce3ffc71aade9a5e4badbf06595870d591194d8bef4669"} Nov 04 04:45:38.862639 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.862611 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" event={"ID":"c04074e7-79db-4586-9c75-ec922314ba54","Type":"ContainerStarted","Data":"03fc0594b65365a6463b37907f6da78499301fc622db6af8a3a878079e4a5ad6"} Nov 04 04:45:38.863751 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.863728 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vqqr6" event={"ID":"34bc4578-ce85-4a2d-9f94-0305ae3267f2","Type":"ContainerStarted","Data":"ba7e63ca6944959cffca724e2e68bd6fa51f8b2e71c82007accd3bd60fbec813"} Nov 04 04:45:38.864770 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.864743 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" event={"ID":"6e75df29-4521-44fa-babe-a45b73155b91","Type":"ContainerStarted","Data":"2631258c5b789f74650eef2e57a7f6affd10af1a0e530510a4f1bc1648e567ab"} Nov 04 04:45:38.865776 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.865754 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-crv79" event={"ID":"68796d82-fed3-494a-8239-32c07fa7c466","Type":"ContainerStarted","Data":"93f479b4ebd56a9c144f484e9b5589106530614777dada64be7e1642af1a7892"} Nov 04 04:45:38.866722 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.866704 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" event={"ID":"a9dc342a-1857-4691-a57b-d1672547d10c","Type":"ContainerStarted","Data":"72e78e303790e31c3cf6b560634ba9a36635f6109359974e50edd2a92e2375da"} Nov 04 04:45:38.867906 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.867888 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-trz8n" event={"ID":"d035486c-ba72-485c-88f9-0733ea426168","Type":"ContainerStarted","Data":"78a072a1a5fb0cc63283f07d8335238b5f4a38a232814c25d400dea35f03429a"} Nov 04 04:45:38.867980 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.867920 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-trz8n" event={"ID":"d035486c-ba72-485c-88f9-0733ea426168","Type":"ContainerStarted","Data":"595ebab5af0e3dc13e715b55966b7bece769b25159bd2e615d82b85baa49f9c8"} Nov 04 04:45:38.869302 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.869283 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-blxqr" event={"ID":"e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1","Type":"ContainerStarted","Data":"b3b35f11cf8b468cea3d991807f018066221e1ea59b469af93fe702a2db1d33f"} Nov 04 04:45:38.869376 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:38.869316 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-blxqr" event={"ID":"e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1","Type":"ContainerStarted","Data":"f094f3c122dcdcf0590860fb5c64e0f2695f384cc9e02611d4bc7d57e25c19e2"} Nov 04 04:45:39.301830 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.301799 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:39.301968 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.301839 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:39.301968 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.301937 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:39.301968 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.301954 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46895cdd-h2frf: secret "image-registry-tls" not found Nov 04 04:45:39.301968 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.301968 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle podName:0f55afb7-c026-4ad5-afe1-6c133692689e nodeName:}" failed. No retries permitted until 2026-11-04 04:45:41.301954664 +0000 UTC m=+35.191984064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle") pod "router-default-5d56d655f9-pdqrc" (UID: "0f55afb7-c026-4ad5-afe1-6c133692689e") : configmap references non-existent config key: service-ca.crt Nov 04 04:45:39.302135 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.301989 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls podName:24e214b2-5e33-4022-8f14-edf1cb11f820 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:41.301977967 +0000 UTC m=+35.192007366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls") pod "image-registry-6c46895cdd-h2frf" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820") : secret "image-registry-tls" not found Nov 04 04:45:39.403020 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.402992 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:39.403020 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.403025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:39.403201 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.403071 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:39.403201 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.403102 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:39.403201 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403117 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:45:39.403201 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.403143 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:39.403201 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403175 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert podName:c8dfe4c5-4264-40e3-a284-69e2d64be1f5 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:41.40315714 +0000 UTC m=+35.293186539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8959q" (UID: "c8dfe4c5-4264-40e3-a284-69e2d64be1f5") : secret "networking-console-plugin-cert" not found Nov 04 04:45:39.403201 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403186 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:39.403201 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403200 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867f9c6749-4gj2n: secret "image-registry-tls" not found Nov 04 04:45:39.403480 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403213 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:45:39.403480 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403235 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls podName:7074b62a-f130-413b-ae9d-53b113f9f58c nodeName:}" failed. No retries permitted until 2026-11-04 04:45:41.403223647 +0000 UTC m=+35.293253047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls") pod "image-registry-867f9c6749-4gj2n" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c") : secret "image-registry-tls" not found Nov 04 04:45:39.403480 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.403204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:39.403480 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403190 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:45:39.403480 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403248 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls podName:0483be54-d5f5-4555-89c9-ef61cbee16ad nodeName:}" failed. No retries permitted until 2026-11-04 04:45:41.403241861 +0000 UTC m=+35.293271260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-zzpt5" (UID: "0483be54-d5f5-4555-89c9-ef61cbee16ad") : secret "samples-operator-tls" not found Nov 04 04:45:39.403480 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403291 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls podName:6491499f-48db-4ee8-9cc1-b27029b2c033 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:41.403284511 +0000 UTC m=+35.293313918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls") pod "dns-default-ntz9h" (UID: "6491499f-48db-4ee8-9cc1-b27029b2c033") : secret "dns-default-metrics-tls" not found Nov 04 04:45:39.403480 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403292 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 04:45:39.403480 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403306 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:39.403480 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403341 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls podName:d49dda15-d5d9-414e-b552-0d9bcab7bba0 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:41.403328514 +0000 UTC m=+35.293357930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fzt9v" (UID: "d49dda15-d5d9-414e-b552-0d9bcab7bba0") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:39.403480 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.403357 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs podName:0f55afb7-c026-4ad5-afe1-6c133692689e nodeName:}" failed. No retries permitted until 2026-11-04 04:45:41.403349299 +0000 UTC m=+35.293378700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs") pod "router-default-5d56d655f9-pdqrc" (UID: "0f55afb7-c026-4ad5-afe1-6c133692689e") : secret "router-metrics-certs-default" not found Nov 04 04:45:39.605602 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.605521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:39.606039 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.605696 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:39.606375 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.606258 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 04 04:45:39.606375 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:39.606345 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs podName:e4cfdbb2-d02d-46a4-8d69-4d7418f8c639 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:11.606323218 +0000 UTC m=+65.496352640 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs") pod "network-metrics-daemon-d25j9" (UID: "e4cfdbb2-d02d-46a4-8d69-4d7418f8c639") : secret "metrics-daemon-secret" not found Nov 04 04:45:39.608692 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.608638 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:39.707009 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.706959 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzrs5\" (UniqueName: \"kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5\") pod \"network-check-target-f7dtz\" (UID: \"6febe6fa-de9b-47eb-a036-a63aea789894\") " pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:39.717513 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.717465 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzrs5\" (UniqueName: \"kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5\") pod \"network-check-target-f7dtz\" (UID: \"6febe6fa-de9b-47eb-a036-a63aea789894\") " pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:39.812029 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.811990 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:39.819672 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.819648 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:39.879138 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.879027 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-trz8n" podStartSLOduration=444.879008306 podStartE2EDuration="7m24.879008306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:38:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:39.760728416 +0000 UTC m=+33.650757840" watchObservedRunningTime="2026-11-04 04:45:39.879008306 +0000 UTC m=+33.769037728" Nov 04 04:45:39.995580 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.994783 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-vc88q" podStartSLOduration=444.994763471 podStartE2EDuration="7m24.994763471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:38:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:39.993664455 +0000 UTC m=+33.883693874" watchObservedRunningTime="2026-11-04 04:45:39.994763471 +0000 UTC m=+33.884792893" Nov 04 04:45:39.995580 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:39.994880 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-blxqr" podStartSLOduration=444.994873638 podStartE2EDuration="7m24.994873638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:38:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:39.877491542 +0000 UTC m=+33.767520964" watchObservedRunningTime="2026-11-04 04:45:39.994873638 +0000 UTC m=+33.884903061" Nov 04 04:45:40.233307 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:40.233213 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f7dtz"] Nov 04 04:45:40.242449 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:40.242384 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cnvdz"] Nov 04 04:45:40.246453 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:40.246413 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6febe6fa_de9b_47eb_a036_a63aea789894.slice/crio-68d3b5c463d2b4253b999e800fd2f3208a00eb099a6a107b2315f77748012115 WatchSource:0}: Error finding container 68d3b5c463d2b4253b999e800fd2f3208a00eb099a6a107b2315f77748012115: Status 404 returned error can't find the container with id 68d3b5c463d2b4253b999e800fd2f3208a00eb099a6a107b2315f77748012115 Nov 04 04:45:40.888108 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:40.888034 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f7dtz" event={"ID":"6febe6fa-de9b-47eb-a036-a63aea789894","Type":"ContainerStarted","Data":"68d3b5c463d2b4253b999e800fd2f3208a00eb099a6a107b2315f77748012115"} Nov 04 04:45:40.890122 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:40.890098 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cnvdz" event={"ID":"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b","Type":"ContainerStarted","Data":"d79bdadc866e9dcdb8e6814b78839c7b113baee098941a07ab3aaab4b0bec0e8"} Nov 04 04:45:41.327403 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:41.327350 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:41.327403 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:41.327402 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:41.327610 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.327538 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle podName:0f55afb7-c026-4ad5-afe1-6c133692689e nodeName:}" failed. No retries permitted until 2026-11-04 04:45:45.327519608 +0000 UTC m=+39.217549026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle") pod "router-default-5d56d655f9-pdqrc" (UID: "0f55afb7-c026-4ad5-afe1-6c133692689e") : configmap references non-existent config key: service-ca.crt Nov 04 04:45:41.327679 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.327628 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:41.327679 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.327641 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46895cdd-h2frf: secret "image-registry-tls" not found Nov 04 04:45:41.327679 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.327676 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls podName:24e214b2-5e33-4022-8f14-edf1cb11f820 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:45.327664981 +0000 UTC m=+39.217694382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls") pod "image-registry-6c46895cdd-h2frf" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820") : secret "image-registry-tls" not found Nov 04 04:45:41.428915 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:41.428835 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:41.428915 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:41.428882 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:41.429128 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:41.428928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:41.429128 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:41.428963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:41.429128 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:41.429041 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:41.429128 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:41.429098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429231 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429310 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls podName:d49dda15-d5d9-414e-b552-0d9bcab7bba0 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:45.429296091 +0000 UTC m=+39.319325490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fzt9v" (UID: "d49dda15-d5d9-414e-b552-0d9bcab7bba0") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429376 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429378 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429420 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429448 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert podName:c8dfe4c5-4264-40e3-a284-69e2d64be1f5 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:45.429432344 +0000 UTC m=+39.319461758 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8959q" (UID: "c8dfe4c5-4264-40e3-a284-69e2d64be1f5") : secret "networking-console-plugin-cert" not found Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429384 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867f9c6749-4gj2n: secret "image-registry-tls" not found Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429471 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls podName:6491499f-48db-4ee8-9cc1-b27029b2c033 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:45.429456328 +0000 UTC m=+39.319485740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls") pod "dns-default-ntz9h" (UID: "6491499f-48db-4ee8-9cc1-b27029b2c033") : secret "dns-default-metrics-tls" not found Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429386 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429490 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls podName:7074b62a-f130-413b-ae9d-53b113f9f58c nodeName:}" failed. No retries permitted until 2026-11-04 04:45:45.429481171 +0000 UTC m=+39.319510577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls") pod "image-registry-867f9c6749-4gj2n" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c") : secret "image-registry-tls" not found Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429386 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429505 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls podName:0483be54-d5f5-4555-89c9-ef61cbee16ad nodeName:}" failed. No retries permitted until 2026-11-04 04:45:45.42949724 +0000 UTC m=+39.319526642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-zzpt5" (UID: "0483be54-d5f5-4555-89c9-ef61cbee16ad") : secret "samples-operator-tls" not found Nov 04 04:45:41.429671 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:41.429520 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs podName:0f55afb7-c026-4ad5-afe1-6c133692689e nodeName:}" failed. No retries permitted until 2026-11-04 04:45:45.429512466 +0000 UTC m=+39.319541890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs") pod "router-default-5d56d655f9-pdqrc" (UID: "0f55afb7-c026-4ad5-afe1-6c133692689e") : secret "router-metrics-certs-default" not found Nov 04 04:45:41.900286 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:41.899660 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh" event={"ID":"9283e782-7152-4c67-8ce3-e07042df088b","Type":"ContainerStarted","Data":"de11126986fd7d360562d33fe46d1dabf98aecdb46d97db002920d6079035f3f"} Nov 04 04:45:42.019361 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:42.019299 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh" podStartSLOduration=418.585733091 podStartE2EDuration="7m1.019279063s" totalImagesPullingTime="2.433545972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:42.017357397 +0000 UTC m=+35.907386821" watchObservedRunningTime="2026-11-04 04:45:42.019279063 +0000 UTC m=+35.909308476" Nov 04 04:45:42.907227 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:42.907187 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/0.log" Nov 04 04:45:42.907686 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:42.907235 2573 generic.go:356] "Generic (PLEG): container finished" podID="6e75df29-4521-44fa-babe-a45b73155b91" containerID="12d40438f99614672085b59d0106f8c72fadc6dc5762c471fe95ca05126d4a94" exitCode=255 Nov 04 04:45:42.908062 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:42.908044 2573 scope.go:122] "RemoveContainer" containerID="12d40438f99614672085b59d0106f8c72fadc6dc5762c471fe95ca05126d4a94" Nov 04 04:45:42.908362 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:42.908328 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" event={"ID":"6e75df29-4521-44fa-babe-a45b73155b91","Type":"ContainerDied","Data":"12d40438f99614672085b59d0106f8c72fadc6dc5762c471fe95ca05126d4a94"} Nov 04 04:45:43.915575 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:43.915539 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/1.log" Nov 04 04:45:43.917026 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:43.916988 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/0.log" Nov 04 04:45:43.917154 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:43.917027 2573 generic.go:356] "Generic (PLEG): container finished" podID="6e75df29-4521-44fa-babe-a45b73155b91" containerID="6e42effc280f254c979c893a004642bca2ab40c0fd64e589ba512f12038f705b" exitCode=255 Nov 04 04:45:43.917154 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:43.917120 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" event={"ID":"6e75df29-4521-44fa-babe-a45b73155b91","Type":"ContainerDied","Data":"6e42effc280f254c979c893a004642bca2ab40c0fd64e589ba512f12038f705b"} Nov 04 04:45:43.917279 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:43.917208 2573 scope.go:122] "RemoveContainer" containerID="12d40438f99614672085b59d0106f8c72fadc6dc5762c471fe95ca05126d4a94" Nov 04 04:45:43.917659 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:43.917636 2573 scope.go:122] "RemoveContainer" containerID="6e42effc280f254c979c893a004642bca2ab40c0fd64e589ba512f12038f705b" Nov 04 04:45:43.917912 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:43.917869 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-tqfqb_openshift-console-operator(6e75df29-4521-44fa-babe-a45b73155b91)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" podUID="6e75df29-4521-44fa-babe-a45b73155b91" Nov 04 04:45:43.922078 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:43.922055 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-crv79" event={"ID":"68796d82-fed3-494a-8239-32c07fa7c466","Type":"ContainerStarted","Data":"8805e7ab11569c8f01b17808f59f19f949e2cfef18ed59a75afbf3274e2de7ca"} Nov 04 04:45:44.783319 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.783232 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-crv79" podStartSLOduration=416.913208258 podStartE2EDuration="7m1.783209353s" totalImagesPullingTime="4.870001095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:44.16114341 +0000 UTC m=+38.051172835" watchObservedRunningTime="2026-11-04 04:45:44.783209353 +0000 UTC m=+38.673238777" Nov 04 04:45:44.784083 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.784054 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zwkrf"] Nov 04 04:45:44.787254 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.787235 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:44.841046 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.840998 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 04:45:44.842256 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.842233 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zwkrf"] Nov 04 04:45:44.890919 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.890889 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qgh6\" (UniqueName: \"kubernetes.io/projected/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-api-access-2qgh6\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:44.891089 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.890953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-crio-socket\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:44.891089 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.891012 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-data-volume\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:44.891089 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.891039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:44.891210 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.891110 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:44.891570 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.891550 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 04:45:44.891661 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.891623 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-frtvg\"" Nov 04 04:45:44.928803 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.928767 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" event={"ID":"a9dc342a-1857-4691-a57b-d1672547d10c","Type":"ContainerStarted","Data":"567a898b779a49aa0bfc6952bf2d8eb2f90e035895489b5ec6af3b7ef120ea64"} Nov 04 04:45:44.932438 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.932414 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/1.log" Nov 04 04:45:44.932978 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.932953 2573 scope.go:122] "RemoveContainer" containerID="6e42effc280f254c979c893a004642bca2ab40c0fd64e589ba512f12038f705b" Nov 04 04:45:44.933160 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:44.933140 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-tqfqb_openshift-console-operator(6e75df29-4521-44fa-babe-a45b73155b91)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" podUID="6e75df29-4521-44fa-babe-a45b73155b91" Nov 04 04:45:44.991756 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.991720 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-data-volume\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:44.991917 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.991765 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:44.991917 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.991871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:44.992028 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.991926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qgh6\" (UniqueName: \"kubernetes.io/projected/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-api-access-2qgh6\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:44.992028 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.991978 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-crio-socket\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:44.992221 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.992202 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-crio-socket\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:44.992373 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:44.992332 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:45:44.992492 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:44.992407 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls podName:121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:45.492386209 +0000 UTC m=+39.382415621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwkrf" (UID: "121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1") : secret "insights-runtime-extractor-tls" not found Nov 04 04:45:44.992492 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:44.992461 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 04:45:44.992492 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:44.992492 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm podName:121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:45.492482192 +0000 UTC m=+39.382511593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zwkrf" (UID: "121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1") : configmap "kube-rbac-proxy" not found Nov 04 04:45:44.992668 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:44.992648 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-data-volume\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:45.048472 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.048027 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" podStartSLOduration=412.319299833 podStartE2EDuration="6m58.048010789s" totalImagesPullingTime="5.728710956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:45.046514188 +0000 UTC m=+38.936543610" watchObservedRunningTime="2026-11-04 04:45:45.048010789 +0000 UTC m=+38.938040211" Nov 04 04:45:45.056889 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.056860 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qgh6\" (UniqueName: \"kubernetes.io/projected/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-api-access-2qgh6\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:45.067434 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.067058 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-mp8tg-26z5w"] Nov 04 04:45:45.074461 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.074440 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.124454 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.124429 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-mp8tg-26z5w"] Nov 04 04:45:45.128471 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.128444 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xq7xw\"" Nov 04 04:45:45.198863 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.198310 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-trusted-ca-bundle\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.198863 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.198497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk5v2\" (UniqueName: \"kubernetes.io/projected/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-kube-api-access-sk5v2\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.198863 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.198541 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-archives-path\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.198863 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.198601 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-service-ca-bundle\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.299905 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.299871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk5v2\" (UniqueName: \"kubernetes.io/projected/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-kube-api-access-sk5v2\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.300064 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.299918 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-archives-path\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.300064 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.299951 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-service-ca-bundle\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.300064 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.300026 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-trusted-ca-bundle\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.302304 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.300752 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-archives-path\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.302304 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.301517 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-service-ca-bundle\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.303139 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.303112 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-trusted-ca-bundle\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.366444 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.366419 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk5v2\" (UniqueName: \"kubernetes.io/projected/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-kube-api-access-sk5v2\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.400699 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.400672 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:45.400844 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.400706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:45.400911 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.400841 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:45.400911 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.400860 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46895cdd-h2frf: secret "image-registry-tls" not found Nov 04 04:45:45.401001 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.400920 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls podName:24e214b2-5e33-4022-8f14-edf1cb11f820 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:53.400898749 +0000 UTC m=+47.290928148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls") pod "image-registry-6c46895cdd-h2frf" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820") : secret "image-registry-tls" not found Nov 04 04:45:45.401001 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.400937 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle podName:0f55afb7-c026-4ad5-afe1-6c133692689e nodeName:}" failed. No retries permitted until 2026-11-04 04:45:53.400927527 +0000 UTC m=+47.290956934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle") pod "router-default-5d56d655f9-pdqrc" (UID: "0f55afb7-c026-4ad5-afe1-6c133692689e") : configmap references non-existent config key: service-ca.crt Nov 04 04:45:45.408044 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.407177 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:45.502360 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.502326 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:45.502480 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.502383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:45.502480 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.502412 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:45.502480 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.502468 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:45.502616 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.502503 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:45.502616 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.502525 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:45.502616 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.502555 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:45.502616 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.502575 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:45.502806 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.502684 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 04:45:45.502806 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.502740 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs podName:0f55afb7-c026-4ad5-afe1-6c133692689e nodeName:}" failed. No retries permitted until 2026-11-04 04:45:53.50272148 +0000 UTC m=+47.392750893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs") pod "router-default-5d56d655f9-pdqrc" (UID: "0f55afb7-c026-4ad5-afe1-6c133692689e") : secret "router-metrics-certs-default" not found Nov 04 04:45:45.502806 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.502799 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:45:45.502940 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.502821 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert podName:c8dfe4c5-4264-40e3-a284-69e2d64be1f5 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:53.502814895 +0000 UTC m=+47.392844307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8959q" (UID: "c8dfe4c5-4264-40e3-a284-69e2d64be1f5") : secret "networking-console-plugin-cert" not found Nov 04 04:45:45.502940 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.502862 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:45.502940 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.502869 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867f9c6749-4gj2n: secret "image-registry-tls" not found Nov 04 04:45:45.502940 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.502888 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls podName:7074b62a-f130-413b-ae9d-53b113f9f58c nodeName:}" failed. No retries permitted until 2026-11-04 04:45:53.50288265 +0000 UTC m=+47.392912062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls") pod "image-registry-867f9c6749-4gj2n" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c") : secret "image-registry-tls" not found Nov 04 04:45:45.502940 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.502923 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:45:45.502940 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.502941 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls podName:121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:46.502935892 +0000 UTC m=+40.392965303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwkrf" (UID: "121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1") : secret "insights-runtime-extractor-tls" not found Nov 04 04:45:45.503200 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.502975 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:45:45.503200 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.502992 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls podName:6491499f-48db-4ee8-9cc1-b27029b2c033 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:53.502987254 +0000 UTC m=+47.393016667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls") pod "dns-default-ntz9h" (UID: "6491499f-48db-4ee8-9cc1-b27029b2c033") : secret "dns-default-metrics-tls" not found Nov 04 04:45:45.503200 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.503020 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 04:45:45.503200 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.503038 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm podName:121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:46.503033592 +0000 UTC m=+40.393062990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zwkrf" (UID: "121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1") : configmap "kube-rbac-proxy" not found Nov 04 04:45:45.503200 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.503072 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:45.503200 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.503090 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls podName:d49dda15-d5d9-414e-b552-0d9bcab7bba0 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:53.503084742 +0000 UTC m=+47.393114154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fzt9v" (UID: "d49dda15-d5d9-414e-b552-0d9bcab7bba0") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:45.503200 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.503124 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:45:45.503200 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:45.503141 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls podName:0483be54-d5f5-4555-89c9-ef61cbee16ad nodeName:}" failed. No retries permitted until 2026-11-04 04:45:53.503135847 +0000 UTC m=+47.393165259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-zzpt5" (UID: "0483be54-d5f5-4555-89c9-ef61cbee16ad") : secret "samples-operator-tls" not found Nov 04 04:45:45.787528 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.787507 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-mp8tg-26z5w"] Nov 04 04:45:45.789740 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:45.789709 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e6fc28e_9b9c_46c8_ae55_d100b49a43d7.slice/crio-cd1d3cc3e3163a0b4459a9b1b7a541f80bab722e34180064f14b5bc3de5ef80a WatchSource:0}: Error finding container cd1d3cc3e3163a0b4459a9b1b7a541f80bab722e34180064f14b5bc3de5ef80a: Status 404 returned error can't find the container with id cd1d3cc3e3163a0b4459a9b1b7a541f80bab722e34180064f14b5bc3de5ef80a Nov 04 04:45:45.938447 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.938363 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f7dtz" event={"ID":"6febe6fa-de9b-47eb-a036-a63aea789894","Type":"ContainerStarted","Data":"5ba577ac72753d4bd7ad2888fe4859ef2fc809e7c5a9fb548e241d5144fd3ee8"} Nov 04 04:45:45.938882 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.938506 2573 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:45.940218 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.940191 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5" event={"ID":"474ac538-e679-400a-89ee-db708dfcddda","Type":"ContainerStarted","Data":"4c750767bb85ba8aebe633d6107caac24b7892301f9eabf9f6f51bb023496166"} Nov 04 04:45:45.941980 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.941952 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-mp8tg-26z5w" event={"ID":"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7","Type":"ContainerStarted","Data":"2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2"} Nov 04 04:45:45.942096 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.941994 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-mp8tg-26z5w" event={"ID":"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7","Type":"ContainerStarted","Data":"cd1d3cc3e3163a0b4459a9b1b7a541f80bab722e34180064f14b5bc3de5ef80a"} Nov 04 04:45:45.943640 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.943605 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" event={"ID":"c04074e7-79db-4586-9c75-ec922314ba54","Type":"ContainerStarted","Data":"2a441bad9e11af3361353762e6e7876856489055cbf63225e876f6261f383b9e"} Nov 04 04:45:45.945327 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:45.945304 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vqqr6" event={"ID":"34bc4578-ce85-4a2d-9f94-0305ae3267f2","Type":"ContainerStarted","Data":"388d8f1d48db20f7fab7bb76e1179a2e3ccd6804ccd324503c89764b3ce7ac72"} Nov 04 04:45:46.055595 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.055543 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f7dtz" podStartSLOduration=34.72146564 podStartE2EDuration="40.05553062s" totalImagesPullingTime="5.33406498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:46.055128582 +0000 UTC m=+39.945158013" watchObservedRunningTime="2026-11-04 04:45:46.05553062 +0000 UTC m=+39.945560041" Nov 04 04:45:46.182304 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.182219 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vqqr6" podStartSLOduration=2.442050658 podStartE2EDuration="9.18219804s" totalImagesPullingTime="6.740147382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:46.180934355 +0000 UTC m=+40.070963775" watchObservedRunningTime="2026-11-04 04:45:46.18219804 +0000 UTC m=+40.072227463" Nov 04 04:45:46.300895 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.300848 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" podStartSLOduration=419.547391457 podStartE2EDuration="7m6.300835964s" totalImagesPullingTime="6.753444507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:46.298942525 +0000 UTC m=+40.188971957" watchObservedRunningTime="2026-11-04 04:45:46.300835964 +0000 UTC m=+40.190865384" Nov 04 04:45:46.417206 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.417157 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5" podStartSLOduration=409.82636491 podStartE2EDuration="6m56.417145046s" totalImagesPullingTime="6.590780136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:46.416309079 +0000 UTC m=+40.306338500" watchObservedRunningTime="2026-11-04 04:45:46.417145046 +0000 UTC m=+40.307174470" Nov 04 04:45:46.511484 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.511451 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:46.511652 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.511575 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:46.511652 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:46.511599 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:45:46.511652 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:46.511650 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls podName:121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:48.511635107 +0000 UTC m=+42.401664519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwkrf" (UID: "121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1") : secret "insights-runtime-extractor-tls" not found Nov 04 04:45:46.511828 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:46.511672 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 04:45:46.511828 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:46.511717 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm podName:121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:48.511702802 +0000 UTC m=+42.401732205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zwkrf" (UID: "121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1") : configmap "kube-rbac-proxy" not found Nov 04 04:45:46.536297 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.536236 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-mp8tg-26z5w" podStartSLOduration=1.536220634 podStartE2EDuration="1.536220634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:46.535384686 +0000 UTC m=+40.425414106" watchObservedRunningTime="2026-11-04 04:45:46.536220634 +0000 UTC m=+40.426250056" Nov 04 04:45:46.652212 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.652137 2573 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-4ffpx"] Nov 04 04:45:46.657688 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.657653 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:46.710252 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.710222 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-4ffpx"] Nov 04 04:45:46.711740 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.711707 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Nov 04 04:45:46.711923 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.711907 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Nov 04 04:45:46.711974 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.711906 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-984zn\"" Nov 04 04:45:46.711974 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.711961 2573 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Nov 04 04:45:46.712053 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.712008 2573 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Nov 04 04:45:46.713403 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.713371 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rzzt\" (UniqueName: \"kubernetes.io/projected/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-kube-api-access-2rzzt\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:46.713584 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.713566 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-signing-key\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:46.713661 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.713609 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-signing-cabundle\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:46.815131 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.815072 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rzzt\" (UniqueName: \"kubernetes.io/projected/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-kube-api-access-2rzzt\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:46.815773 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.815746 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-signing-key\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:46.815911 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.815802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-signing-cabundle\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:46.816683 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.816654 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-signing-cabundle\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:46.819127 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.819102 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-signing-key\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:46.877362 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.877341 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rzzt\" (UniqueName: \"kubernetes.io/projected/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-kube-api-access-2rzzt\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:46.977571 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:46.977505 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:47.350285 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:47.350244 2573 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-4ffpx"] Nov 04 04:45:47.353054 ip-10-0-132-197 kubenswrapper[2573]: W1104 04:45:47.353024 2573 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7986ec05_d0d1_49ef_a8d5_2be22d20df8c.slice/crio-76505d6245df483f16d24c41ad1b7a2f096421962fd091b474d643980739175d WatchSource:0}: Error finding container 76505d6245df483f16d24c41ad1b7a2f096421962fd091b474d643980739175d: Status 404 returned error can't find the container with id 76505d6245df483f16d24c41ad1b7a2f096421962fd091b474d643980739175d Nov 04 04:45:47.946333 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:47.946279 2573 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:47.946511 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:47.946356 2573 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:47.946733 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:47.946718 2573 scope.go:122] "RemoveContainer" containerID="6e42effc280f254c979c893a004642bca2ab40c0fd64e589ba512f12038f705b" Nov 04 04:45:47.946930 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:47.946906 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-tqfqb_openshift-console-operator(6e75df29-4521-44fa-babe-a45b73155b91)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" podUID="6e75df29-4521-44fa-babe-a45b73155b91" Nov 04 04:45:47.953497 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:47.953469 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" event={"ID":"7986ec05-d0d1-49ef-a8d5-2be22d20df8c","Type":"ContainerStarted","Data":"9191a0f98dff1815d3a3a09bb98cdc6b53656b12bf6f135a0252015c0dc78128"} Nov 04 04:45:47.953645 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:47.953514 2573 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" event={"ID":"7986ec05-d0d1-49ef-a8d5-2be22d20df8c","Type":"ContainerStarted","Data":"76505d6245df483f16d24c41ad1b7a2f096421962fd091b474d643980739175d"} Nov 04 04:45:48.072047 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:48.071995 2573 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" podStartSLOduration=2.07198019 podStartE2EDuration="2.07198019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:45:48.071736302 +0000 UTC m=+41.961765725" watchObservedRunningTime="2026-11-04 04:45:48.07198019 +0000 UTC m=+41.962009624" Nov 04 04:45:48.532349 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:48.532255 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:48.532527 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:48.532402 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:45:48.532527 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:48.532454 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:48.532527 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:48.532482 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls podName:121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:52.532461976 +0000 UTC m=+46.422491394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwkrf" (UID: "121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1") : secret "insights-runtime-extractor-tls" not found Nov 04 04:45:48.532527 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:48.532509 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 04:45:48.532681 ip-10-0-132-197 kubenswrapper[2573]: E1104 04:45:48.532551 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm podName:121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:52.532540535 +0000 UTC m=+46.422569934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zwkrf" (UID: "121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1") : configmap "kube-rbac-proxy" not found Nov 04 04:45:48.560617 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:48.560587 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vjj7q_fb2998cb-3584-4d30-8ff9-9e1ca5dc8950/dns-node-resolver/0.log" Nov 04 04:45:49.123394 ip-10-0-132-197 kubenswrapper[2573]: I1104 04:45:49.123360 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f66bz_3751973e-ab65-4992-9b24-38a050b1324c/node-ca/0.log" Nov 04 04:45:49.455445 ip-10-0-132-197 systemd[1]: Stopping Kubernetes Kubelet... Nov 04 04:45:49.474726 ip-10-0-132-197 systemd[1]: kubelet.service: Deactivated successfully. Nov 04 04:45:49.474967 ip-10-0-132-197 systemd[1]: Stopped Kubernetes Kubelet. Nov 04 04:45:49.475034 ip-10-0-132-197 systemd[1]: kubelet.service: Consumed 2.976s CPU time. Nov 04 04:45:49.491732 ip-10-0-132-197 systemd[1]: Starting Kubernetes Kubelet... Nov 04 04:45:49.568557 ip-10-0-132-197 kubenswrapper[4955]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 04:45:49.568557 ip-10-0-132-197 kubenswrapper[4955]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 04:45:49.568557 ip-10-0-132-197 kubenswrapper[4955]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 04:45:49.568557 ip-10-0-132-197 kubenswrapper[4955]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 04:45:49.570572 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570492 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:49.570572 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570572 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570578 4955 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570581 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570584 4955 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570587 4955 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570589 4955 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570592 4955 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570595 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570598 4955 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570600 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570603 4955 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570605 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570608 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570611 4955 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570613 4955 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570618 4955 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570622 4955 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570625 4955 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570628 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:49.570647 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570630 4955 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570633 4955 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570636 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570638 4955 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570645 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570647 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570650 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570653 4955 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570656 4955 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570659 4955 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570662 4955 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570664 4955 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570667 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570670 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570672 4955 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570675 4955 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570677 4955 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570680 4955 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570682 4955 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570685 4955 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:49.571105 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570687 4955 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570690 4955 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570692 4955 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570695 4955 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570698 4955 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570701 4955 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570704 4955 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570706 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570711 4955 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570716 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570719 4955 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570721 4955 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570725 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570728 4955 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570731 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570734 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570736 4955 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570739 4955 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570742 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570744 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:49.571615 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570747 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570750 4955 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570752 4955 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570755 4955 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570758 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570760 4955 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570763 4955 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570765 4955 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570768 4955 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570772 4955 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570775 4955 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570777 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570780 4955 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570782 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570785 4955 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570788 4955 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570790 4955 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570793 4955 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570795 4955 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:49.572097 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570798 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570801 4955 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570803 4955 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570806 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570809 4955 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570811 4955 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570814 4955 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570816 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570820 4955 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570822 4955 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570825 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570828 4955 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570830 4955 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570833 4955 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570836 4955 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570838 4955 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570841 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570844 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570848 4955 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570850 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:49.572582 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570853 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570855 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570858 4955 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570860 4955 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570863 4955 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570865 4955 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.570868 4955 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571621 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571628 4955 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571631 4955 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571633 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571637 4955 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571640 4955 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571643 4955 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571646 4955 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571648 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571652 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571654 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571658 4955 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:49.573126 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571661 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571664 4955 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571667 4955 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571670 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571672 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571675 4955 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571677 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571680 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571683 4955 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571685 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571688 4955 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571690 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571692 4955 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571695 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571698 4955 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571700 4955 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571703 4955 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571705 4955 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571709 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571711 4955 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:49.573618 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571714 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571717 4955 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571720 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571722 4955 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571725 4955 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571728 4955 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571733 4955 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571736 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571738 4955 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571741 4955 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571744 4955 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571746 4955 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571749 4955 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571751 4955 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571754 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571757 4955 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571759 4955 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571762 4955 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571764 4955 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571767 4955 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:49.574098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571770 4955 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571772 4955 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571775 4955 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571777 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571780 4955 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571783 4955 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571785 4955 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571788 4955 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571790 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571793 4955 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571796 4955 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571798 4955 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571801 4955 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571804 4955 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571806 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571809 4955 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571811 4955 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571814 4955 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571818 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571820 4955 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:49.574609 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571830 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571833 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571835 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571838 4955 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571840 4955 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571843 4955 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571845 4955 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571848 4955 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571858 4955 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571862 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571865 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571868 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571872 4955 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571875 4955 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571878 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571881 4955 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571883 4955 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571886 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:49.575136 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571888 4955 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571891 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571893 4955 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571896 4955 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571899 4955 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571902 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571904 4955 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571907 4955 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571910 4955 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571912 4955 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571915 4955 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571917 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571921 4955 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571924 4955 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571926 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.571930 4955 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572447 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572454 4955 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572457 4955 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:49.575584 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572460 4955 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572463 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572465 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572468 4955 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572471 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572474 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572477 4955 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572480 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572482 4955 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572485 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572487 4955 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572490 4955 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572492 4955 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572495 4955 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572498 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572500 4955 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572503 4955 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572506 4955 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572509 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:49.576042 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572512 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572514 4955 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572518 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572520 4955 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572523 4955 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572525 4955 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572530 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572532 4955 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572535 4955 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572537 4955 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572540 4955 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572544 4955 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572548 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572551 4955 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572553 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572556 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572559 4955 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572562 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572564 4955 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:49.576794 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572567 4955 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572570 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572572 4955 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572575 4955 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572577 4955 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572580 4955 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572583 4955 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572585 4955 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572589 4955 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572591 4955 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572594 4955 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572597 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572600 4955 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572603 4955 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572605 4955 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572608 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572610 4955 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572613 4955 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572616 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572619 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:49.577612 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572622 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572625 4955 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572627 4955 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572630 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572632 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572635 4955 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572637 4955 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572640 4955 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572643 4955 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572645 4955 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572648 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572651 4955 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572654 4955 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572656 4955 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572659 4955 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572662 4955 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572664 4955 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572667 4955 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572669 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:49.578502 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572673 4955 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572677 4955 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572682 4955 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572685 4955 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572687 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572690 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572693 4955 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572695 4955 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572698 4955 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572700 4955 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572703 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572706 4955 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572710 4955 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572713 4955 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572715 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572718 4955 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572720 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572723 4955 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572725 4955 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572728 4955 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:49.579376 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572730 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572733 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572736 4955 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572738 4955 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572741 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.572745 4955 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572832 4955 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572843 4955 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572849 4955 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572854 4955 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572858 4955 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572861 4955 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572865 4955 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572870 4955 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572874 4955 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572877 4955 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572881 4955 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572884 4955 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572887 4955 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572890 4955 flags.go:64] FLAG: --cgroup-root="" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572893 4955 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572896 4955 flags.go:64] FLAG: --client-ca-file="" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572899 4955 flags.go:64] FLAG: --cloud-provider="external" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572902 4955 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 04:45:49.580277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572908 4955 flags.go:64] FLAG: --cluster-domain="" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572911 4955 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572914 4955 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572917 4955 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572921 4955 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572925 4955 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572928 4955 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572931 4955 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572934 4955 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572937 4955 flags.go:64] FLAG: --contention-profiling="false" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572940 4955 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572943 4955 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572946 4955 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572949 4955 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572954 4955 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572957 4955 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572960 4955 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572963 4955 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572966 4955 flags.go:64] FLAG: --enable-server="true" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572969 4955 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572973 4955 flags.go:64] FLAG: --event-burst="100" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572976 4955 flags.go:64] FLAG: --event-qps="50" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572980 4955 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572983 4955 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 04:45:49.581326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572986 4955 flags.go:64] FLAG: --eviction-hard="" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572990 4955 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572993 4955 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.572996 4955 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573000 4955 flags.go:64] FLAG: --eviction-soft="" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573003 4955 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573006 4955 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573009 4955 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573013 4955 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573016 4955 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573019 4955 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573022 4955 flags.go:64] FLAG: --feature-gates="" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573026 4955 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573029 4955 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573032 4955 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573035 4955 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573038 4955 flags.go:64] FLAG: --healthz-port="10248" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573041 4955 flags.go:64] FLAG: --help="false" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573044 4955 flags.go:64] FLAG: --hostname-override="ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573048 4955 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573051 4955 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573054 4955 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573057 4955 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 04:45:49.582155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573061 4955 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573064 4955 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573067 4955 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573070 4955 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573073 4955 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573076 4955 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573079 4955 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573084 4955 flags.go:64] FLAG: --kube-reserved="" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573087 4955 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573090 4955 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573093 4955 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573096 4955 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573099 4955 flags.go:64] FLAG: --lock-file="" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573102 4955 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573105 4955 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573108 4955 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573113 4955 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573117 4955 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573121 4955 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573124 4955 flags.go:64] FLAG: --logging-format="text" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573127 4955 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573130 4955 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573133 4955 flags.go:64] FLAG: --manifest-url="" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573136 4955 flags.go:64] FLAG: --manifest-url-header="" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573140 4955 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 04:45:49.582746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573143 4955 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573147 4955 flags.go:64] FLAG: --max-pods="110" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573150 4955 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573153 4955 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573156 4955 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573159 4955 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573162 4955 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573165 4955 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573172 4955 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573182 4955 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573186 4955 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573189 4955 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573192 4955 flags.go:64] FLAG: --pod-cidr="" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573194 4955 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573198 4955 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573201 4955 flags.go:64] FLAG: --pods-per-core="0" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573204 4955 flags.go:64] FLAG: --port="10250" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573207 4955 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573210 4955 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-00ffcc9d648dd10a7" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573213 4955 flags.go:64] FLAG: --qos-reserved="" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573216 4955 flags.go:64] FLAG: --read-only-port="10255" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573219 4955 flags.go:64] FLAG: --register-node="true" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573222 4955 flags.go:64] FLAG: --register-with-taints="" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573226 4955 flags.go:64] FLAG: --registry-burst="10" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573229 4955 flags.go:64] FLAG: --registry-qps="5" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573232 4955 flags.go:64] FLAG: --reserved-cpus="" Nov 04 04:45:49.583415 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573235 4955 flags.go:64] FLAG: --reserved-memory="" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573239 4955 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573242 4955 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573245 4955 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573247 4955 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573250 4955 flags.go:64] FLAG: --runonce="false" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573253 4955 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573256 4955 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573272 4955 flags.go:64] FLAG: --seccomp-default="false" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573275 4955 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573278 4955 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573281 4955 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573284 4955 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573287 4955 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573290 4955 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573293 4955 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573296 4955 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573299 4955 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573302 4955 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573305 4955 flags.go:64] FLAG: --system-cgroups="" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573309 4955 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573314 4955 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573317 4955 flags.go:64] FLAG: --tls-cert-file="" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573320 4955 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573328 4955 flags.go:64] FLAG: --tls-min-version="" Nov 04 04:45:49.584186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573331 4955 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573334 4955 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573337 4955 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573340 4955 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573343 4955 flags.go:64] FLAG: --v="2" Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573352 4955 flags.go:64] FLAG: --version="false" Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573356 4955 flags.go:64] FLAG: --vmodule="" Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573360 4955 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573363 4955 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573505 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573509 4955 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573512 4955 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573515 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573517 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573520 4955 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573523 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573525 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573528 4955 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573530 4955 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573533 4955 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573536 4955 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:49.585056 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573538 4955 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573541 4955 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573544 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573547 4955 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573550 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573552 4955 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573556 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573559 4955 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573561 4955 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573564 4955 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573566 4955 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573569 4955 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573571 4955 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573574 4955 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573577 4955 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573579 4955 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573581 4955 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573584 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573587 4955 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573589 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:49.585654 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573592 4955 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573595 4955 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573597 4955 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573600 4955 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573603 4955 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573605 4955 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573608 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573611 4955 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573614 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573616 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573619 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573621 4955 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573624 4955 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573627 4955 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573629 4955 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573633 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573635 4955 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573638 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573641 4955 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:49.586300 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573643 4955 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573646 4955 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573649 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573651 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573654 4955 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573657 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573659 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573661 4955 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573666 4955 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573668 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573671 4955 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573674 4955 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573676 4955 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573679 4955 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573681 4955 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573684 4955 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573687 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573689 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573692 4955 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573695 4955 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:49.586787 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573698 4955 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573700 4955 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573703 4955 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573705 4955 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573708 4955 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573711 4955 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573713 4955 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573716 4955 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573719 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573723 4955 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573727 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573730 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573733 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573736 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573739 4955 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573742 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573745 4955 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573747 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573750 4955 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:49.587347 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573753 4955 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573756 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573759 4955 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573763 4955 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573767 4955 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573770 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573773 4955 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573776 4955 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573779 4955 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573782 4955 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573784 4955 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573787 4955 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573790 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573792 4955 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573795 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573798 4955 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:49.587875 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.573822 4955 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573855 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573860 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573863 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573866 4955 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573869 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573872 4955 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573875 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573877 4955 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573880 4955 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573883 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573885 4955 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573889 4955 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573894 4955 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573897 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573900 4955 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573902 4955 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573905 4955 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573908 4955 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:49.588335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573911 4955 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573914 4955 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573916 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573919 4955 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573922 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573925 4955 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573927 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573930 4955 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573932 4955 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573935 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573938 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573940 4955 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573943 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573946 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573948 4955 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573951 4955 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573954 4955 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573956 4955 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573959 4955 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:49.588869 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573961 4955 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573964 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573967 4955 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573969 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573972 4955 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573974 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573977 4955 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573979 4955 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573982 4955 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573984 4955 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573987 4955 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573989 4955 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573994 4955 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.573997 4955 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574000 4955 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574002 4955 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574005 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574007 4955 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574010 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574013 4955 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:49.589361 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574016 4955 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574019 4955 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574022 4955 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574024 4955 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574027 4955 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574030 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574032 4955 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574035 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574037 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574040 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574043 4955 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574045 4955 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574048 4955 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574050 4955 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574052 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574055 4955 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574058 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574061 4955 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574063 4955 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:49.589849 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574066 4955 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574068 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574071 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574074 4955 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574077 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574080 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574083 4955 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574086 4955 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574089 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574091 4955 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574094 4955 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574097 4955 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574100 4955 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574102 4955 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574107 4955 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574110 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574112 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574115 4955 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574117 4955 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574120 4955 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:49.590308 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574123 4955 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574125 4955 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574128 4955 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574130 4955 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574133 4955 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574136 4955 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574139 4955 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574141 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574146 4955 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.574149 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.578660 4955 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.578676 4955 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.578701 4955 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.578708 4955 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578791 4955 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578800 4955 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578807 4955 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578813 4955 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:49.590810 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578819 4955 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578825 4955 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578830 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578834 4955 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578839 4955 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578843 4955 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578847 4955 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578851 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578856 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578861 4955 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578866 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578870 4955 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578875 4955 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578879 4955 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578883 4955 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578888 4955 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578892 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578896 4955 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578900 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578905 4955 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:49.591369 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578910 4955 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578914 4955 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578918 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578924 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578929 4955 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578934 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578938 4955 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578942 4955 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578947 4955 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578951 4955 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578955 4955 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578960 4955 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578964 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578968 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578974 4955 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578978 4955 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578983 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578987 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578992 4955 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:49.591851 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.578996 4955 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579000 4955 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579005 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579012 4955 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579018 4955 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579023 4955 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579028 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579032 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579036 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579041 4955 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579045 4955 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579049 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579054 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579058 4955 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579063 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579068 4955 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579072 4955 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579077 4955 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579081 4955 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:49.592310 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579086 4955 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579090 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579094 4955 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579098 4955 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579102 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579107 4955 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579111 4955 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579116 4955 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579120 4955 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579124 4955 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579129 4955 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579133 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579137 4955 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579142 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579146 4955 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579150 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579155 4955 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579160 4955 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579164 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579169 4955 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:49.592770 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579173 4955 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579178 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579182 4955 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579186 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579191 4955 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579196 4955 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579200 4955 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579204 4955 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579209 4955 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579213 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579217 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579222 4955 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579226 4955 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579231 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579235 4955 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579240 4955 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579244 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579249 4955 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579253 4955 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579257 4955 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:49.593243 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579280 4955 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579284 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579288 4955 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579292 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.579333 4955 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579542 4955 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579550 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579555 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579559 4955 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579564 4955 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579569 4955 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579573 4955 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579577 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579581 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579586 4955 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579590 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:49.593745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579594 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579598 4955 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579603 4955 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579607 4955 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579611 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579615 4955 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579619 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579623 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579630 4955 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579636 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579641 4955 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579645 4955 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579649 4955 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579653 4955 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579657 4955 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579662 4955 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579666 4955 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579670 4955 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579675 4955 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:49.594160 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579679 4955 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579683 4955 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579687 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579692 4955 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579696 4955 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579700 4955 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579705 4955 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579709 4955 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579713 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579717 4955 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579721 4955 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579726 4955 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579731 4955 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579734 4955 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579739 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579743 4955 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579747 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579751 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579755 4955 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:49.594641 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579760 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579764 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579768 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579773 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579777 4955 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579781 4955 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579786 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579790 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579794 4955 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579798 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579803 4955 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579807 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579811 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579815 4955 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579819 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579823 4955 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579827 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579831 4955 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579836 4955 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579840 4955 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:49.595092 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579844 4955 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579848 4955 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579852 4955 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579856 4955 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579860 4955 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579865 4955 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579868 4955 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579873 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579877 4955 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579881 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579885 4955 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579889 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579894 4955 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579898 4955 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579902 4955 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579906 4955 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579911 4955 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579915 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579919 4955 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:49.595666 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579923 4955 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579927 4955 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579932 4955 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579936 4955 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579940 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579945 4955 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579951 4955 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579957 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579962 4955 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579966 4955 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579971 4955 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579975 4955 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579979 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579983 4955 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579987 4955 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579991 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.579995 4955 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:49.596169 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580000 4955 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.580040 4955 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580090 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580097 4955 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580102 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580107 4955 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580111 4955 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580115 4955 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580119 4955 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580124 4955 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580128 4955 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580132 4955 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580136 4955 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580141 4955 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580146 4955 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580150 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:45:49.596620 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580154 4955 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580158 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580162 4955 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580167 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580171 4955 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580175 4955 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580179 4955 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580183 4955 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580188 4955 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580192 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580196 4955 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580201 4955 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580205 4955 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580209 4955 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580214 4955 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580218 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580222 4955 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580230 4955 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580237 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:45:49.597011 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580242 4955 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580247 4955 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580252 4955 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580256 4955 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580276 4955 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580281 4955 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580285 4955 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580289 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580293 4955 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580297 4955 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580301 4955 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580306 4955 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580310 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580315 4955 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580320 4955 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580324 4955 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580329 4955 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580335 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580339 4955 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580351 4955 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:45:49.597775 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580356 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580360 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580365 4955 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580369 4955 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580373 4955 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580378 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580382 4955 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580386 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580390 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580397 4955 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580404 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580409 4955 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580414 4955 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580419 4955 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580423 4955 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580427 4955 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580431 4955 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580436 4955 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580440 4955 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:45:49.598433 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580446 4955 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580450 4955 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580455 4955 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580459 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580463 4955 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580505 4955 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580597 4955 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580603 4955 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580608 4955 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580613 4955 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580621 4955 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580626 4955 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580631 4955 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580636 4955 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580641 4955 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580646 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580650 4955 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580655 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580659 4955 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580669 4955 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:45:49.598886 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580674 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580679 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580683 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580690 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580694 4955 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580699 4955 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580706 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580711 4955 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580715 4955 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580720 4955 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580730 4955 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580734 4955 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580739 4955 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:49.580744 4955 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.580852 4955 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.582561 4955 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.582614 4955 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.582801 4955 server.go:1014] "Starting client certificate rotation" Nov 04 04:45:49.599443 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.582933 4955 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 04:45:49.600030 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.583000 4955 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 04:40:06 +0000 UTC" deadline="2028-04-12 11:26:41.951980033 +0000 UTC" Nov 04 04:45:49.600030 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.583034 4955 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12606h40m52.368947541s" Nov 04 04:45:49.600030 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.583283 4955 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 04:45:49.600030 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.584287 4955 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 04:45:49.600030 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.585894 4955 log.go:25] "Validated CRI v1 runtime API" Nov 04 04:45:49.600030 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.587522 4955 log.go:25] "Validated CRI v1 image API" Nov 04 04:45:49.600030 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.588332 4955 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 04:45:49.600030 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.590165 4955 fs.go:135] Filesystem UUIDs: map[2595e2a5-5f0d-4407-93e3-5d4cb7f282bd:/dev/nvme0n1p4 76e86ad0-fd3e-4ae8-b6e6-b9f0746d0493:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Nov 04 04:45:49.600284 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.590183 4955 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/03fc0594b65365a6463b37907f6da78499301fc622db6af8a3a878079e4a5ad6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/03fc0594b65365a6463b37907f6da78499301fc622db6af8a3a878079e4a5ad6/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0c34a17ccf8f222c33197013e59b989754daeb18a1d7d91ed4bb73ef61730bc8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0c34a17ccf8f222c33197013e59b989754daeb18a1d7d91ed4bb73ef61730bc8/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1194de70ef1a63df8a4298d03ec9d73b821fb1689ecdf814a747480b57efd82b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1194de70ef1a63df8a4298d03ec9d73b821fb1689ecdf814a747480b57efd82b/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/155e2be44040f0ae4c2a5a2aaeb4bf3a647c188e4f7495a85ff1e8443d715acc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/155e2be44040f0ae4c2a5a2aaeb4bf3a647c188e4f7495a85ff1e8443d715acc/userdata/shm major:0 minor:91 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2631258c5b789f74650eef2e57a7f6affd10af1a0e530510a4f1bc1648e567ab/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2631258c5b789f74650eef2e57a7f6affd10af1a0e530510a4f1bc1648e567ab/userdata/shm major:0 minor:233 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/425ce514232109c05af0a5b0dd2ee2d2b7e1dcde98ef0c6bea435b5b0179efa0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/425ce514232109c05af0a5b0dd2ee2d2b7e1dcde98ef0c6bea435b5b0179efa0/userdata/shm major:0 minor:79 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/469e9630a173a2dd8817830d3d87dea45f803e17fbedd5930cdc5b16f84a8358/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/469e9630a173a2dd8817830d3d87dea45f803e17fbedd5930cdc5b16f84a8358/userdata/shm major:0 minor:219 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/595ebab5af0e3dc13e715b55966b7bece769b25159bd2e615d82b85baa49f9c8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/595ebab5af0e3dc13e715b55966b7bece769b25159bd2e615d82b85baa49f9c8/userdata/shm major:0 minor:223 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/65b09845f3a957ae48f5ee479bcc15cac4a19d81690a4be07e5bfdd6bd2595f1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/65b09845f3a957ae48f5ee479bcc15cac4a19d81690a4be07e5bfdd6bd2595f1/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/68d3b5c463d2b4253b999e800fd2f3208a00eb099a6a107b2315f77748012115/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/68d3b5c463d2b4253b999e800fd2f3208a00eb099a6a107b2315f77748012115/userdata/shm major:0 minor:289 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/72e78e303790e31c3cf6b560634ba9a36635f6109359974e50edd2a92e2375da/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/72e78e303790e31c3cf6b560634ba9a36635f6109359974e50edd2a92e2375da/userdata/shm major:0 minor:225 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/76505d6245df483f16d24c41ad1b7a2f096421962fd091b474d643980739175d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/76505d6245df483f16d24c41ad1b7a2f096421962fd091b474d643980739175d/userdata/shm major:0 minor:352 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/93f479b4ebd56a9c144f484e9b5589106530614777dada64be7e1642af1a7892/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/93f479b4ebd56a9c144f484e9b5589106530614777dada64be7e1642af1a7892/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/97979a55cc531c74cdce3ffc71aade9a5e4badbf06595870d591194d8bef4669/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/97979a55cc531c74cdce3ffc71aade9a5e4badbf06595870d591194d8bef4669/userdata/shm major:0 minor:239 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a20bde6ddb43854d9cf74a0d182eff35f2c602b5fc52ee41e59cc3a4383756ae/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a20bde6ddb43854d9cf74a0d182eff35f2c602b5fc52ee41e59cc3a4383756ae/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ba7e63ca6944959cffca724e2e68bd6fa51f8b2e71c82007accd3bd60fbec813/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ba7e63ca6944959cffca724e2e68bd6fa51f8b2e71c82007accd3bd60fbec813/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c0c0ff0c95c9a734d602aa61ca025816684e3bdee7c53698046204b3e4c547d2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c0c0ff0c95c9a734d602aa61ca025816684e3bdee7c53698046204b3e4c547d2/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cd1d3cc3e3163a0b4459a9b1b7a541f80bab722e34180064f14b5bc3de5ef80a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cd1d3cc3e3163a0b4459a9b1b7a541f80bab722e34180064f14b5bc3de5ef80a/userdata/shm major:0 minor:328 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ce0f8e5536a46a40523db36a3cb54280b47e17de9a98fb61c31d2b6ba6646f9d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ce0f8e5536a46a40523db36a3cb54280b47e17de9a98fb61c31d2b6ba6646f9d/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d79bdadc866e9dcdb8e6814b78839c7b113baee098941a07ab3aaab4b0bec0e8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d79bdadc866e9dcdb8e6814b78839c7b113baee098941a07ab3aaab4b0bec0e8/userdata/shm major:0 minor:288 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/db7c8953a88e5b1720836276cb1bdf0f1c33e86f476714dd69873cada67401d7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/db7c8953a88e5b1720836276cb1bdf0f1c33e86f476714dd69873cada67401d7/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f094f3c122dcdcf0590860fb5c64e0f2695f384cc9e02611d4bc7d57e25c19e2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f094f3c122dcdcf0590860fb5c64e0f2695f384cc9e02611d4bc7d57e25c19e2/userdata/shm major:0 minor:221 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f20e7d9c261d68f03284575088df97b83981d016703a3bfec8f7a9f2b11904ea/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f20e7d9c261d68f03284575088df97b83981d016703a3bfec8f7a9f2b11904ea/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f803cb825a272dfbf1196f8dc1daa43d520274af80e91b0f4318f921a1535842/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f803cb825a272dfbf1196f8dc1daa43d520274af80e91b0f4318f921a1535842/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0483be54-d5f5-4555-89c9-ef61cbee16ad/volumes/kubernetes.io~projected/kube-api-access-hxtdj:{mountpoint:/var/lib/kubelet/pods/0483be54-d5f5-4555-89c9-ef61cbee16ad/volumes/kubernetes.io~projected/kube-api-access-hxtdj major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0921fa80-a280-4013-8c90-530a9f1e45e1/volumes/kubernetes.io~projected/kube-api-access-l58ck:{mountpoint:/var/lib/kubelet/pods/0921fa80-a280-4013-8c90-530a9f1e45e1/volumes/kubernetes.io~projected/kube-api-access-l58ck major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0f55afb7-c026-4ad5-afe1-6c133692689e/volumes/kubernetes.io~projected/kube-api-access-wxcd2:{mountpoint:/var/lib/kubelet/pods/0f55afb7-c026-4ad5-afe1-6c133692689e/volumes/kubernetes.io~projected/kube-api-access-wxcd2 major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0f55afb7-c026-4ad5-afe1-6c133692689e/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/0f55afb7-c026-4ad5-afe1-6c133692689e/volumes/kubernetes.io~secret/default-certificate major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0f55afb7-c026-4ad5-afe1-6c133692689e/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/0f55afb7-c026-4ad5-afe1-6c133692689e/volumes/kubernetes.io~secret/stats-auth major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1/volumes/kubernetes.io~projected/kube-api-access-2qgh6:{mountpoint:/var/lib/kubelet/pods/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1/volumes/kubernetes.io~projected/kube-api-access-2qgh6 major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes/kubernetes.io~projected/kube-api-access-c59zf:{mountpoint:/var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes/kubernetes.io~projected/kube-api-access-c59zf major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34bc4578-ce85-4a2d-9f94-0305ae3267f2/volumes/kubernetes.io~projected/kube-api-access-8j7m2:{mountpoint:/var/lib/kubelet/pods/34bc4578-ce85-4a2d-9f94-0305ae3267f2/volumes/kubernetes.io~projected/kube-api-access-8j7m2 major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34bc4578-ce85-4a2d-9f94-0305ae3267f2/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/34bc4578-ce85-4a2d-9f94-0305ae3267f2/volumes/kubernetes.io~secret/cert major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3751973e-ab65-4992-9b24-38a050b1324c/volumes/kubernetes.io~projected/kube-api-access-2cvsc:{mountpoint:/var/lib/kubelet/pods/3751973e-ab65-4992-9b24-38a050b1324c/volumes/kubernetes.io~projected/kube-api-access-2cvsc major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7/volumes/kubernetes.io~projected/kube-api-access-sk5v2:{mountpoint:/var/lib/kubelet/pods/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7/volumes/kubernetes.io~projected/kube-api-access-sk5v2 major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/474ac538-e679-400a-89ee-db708dfcddda/volumes/kubernetes.io~projected/kube-api-access-hrsrc:{mountpoint:/var/lib/kubelet/pods/474ac538-e679-400a-89ee-db708dfcddda/volumes/kubernetes.io~projected/kube-api-access-hrsrc major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5331a9ab-3b27-4726-bf53-9ed1ac228c6c/volumes/kubernetes.io~projected/kube-api-access-ztj4f:{mountpoint:/var/lib/kubelet/pods/5331a9ab-3b27-4726-bf53-9ed1ac228c6c/volumes/kubernetes.io~projected/kube-api-access-ztj4f major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6491499f-48db-4ee8-9cc1-b27029b2c033/volumes/kubernetes.io~projected/kube-api-access-4xv8k:{mountpoint:/var/lib/kubelet/pods/6491499f-48db-4ee8-9cc1-b27029b2c033/volumes/kubernetes.io~projected/kube-api-access-4xv8k major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/66675bf0-7d80-414a-8ccc-a7e3718bbaaa/volumes/kubernetes.io~projected/kube-api-access-k5xp4:{mountpoint:/var/lib/kubelet/pods/66675bf0-7d80-414a-8ccc-a7e3718bbaaa/volumes/kubernetes.io~projected/kube-api-access-k5xp4 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/68796d82-fed3-494a-8239-32c07fa7c466/volumes/kubernetes.io~projected/kube-api-access-p9wkm:{mountpoint:/var/lib/kubelet/pods/68796d82-fed3-494a-8239-32c07fa7c466/volumes/kubernetes.io~projected/kube-api-access-p9wkm major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/68796d82-fed3-494a-8239-32c07fa7c466/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/68796d82-fed3-494a-8239-32c07fa7c466/volumes/kubernetes.io~secret/serving-cert major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6e75df29-4521-44fa-babe-a45b73155b91/volumes/kubernetes.io~projected/kube-api-access-pj7qq:{mountpoint:/var/lib/kubelet/pods/6e75df29-4521-44fa-babe-a45b73155b91/volumes/kubernetes.io~projected/kube-api-access-pj7qq major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6e75df29-4521-44fa-babe-a45b73155b91/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/6e75df29-4521-44fa-babe-a45b73155b91/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6febe6fa-de9b-47eb-a036-a63aea789894/volumes/kubernetes.io~projected/kube-api-access-tzrs5:{mountpoint:/var/lib/kubelet/pods/6febe6fa-de9b-47eb-a036-a63aea789894/volumes/kubernetes.io~projected/kube-api-access-tzrs5 major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/70407c80-19ed-467f-a4a4-8ff150518aef/volumes/kubernetes.io~projected/kube-api-access-v27tp:{mountpoint:/var/lib/kubelet/pods/70407c80-19ed-467f-a4a4-8ff150518aef/volumes/kubernetes.io~projected/kube-api-access-v27tp major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes/kubernetes.io~projected/kube-api-access-m66bl:{mountpoint:/var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes/kubernetes.io~projected/kube-api-access-m66bl major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7986ec05-d0d1-49ef-a8d5-2be22d20df8c/volumes/kubernetes.io~projected/kube-api-access-2rzzt:{mountpoint:/var/lib/kubelet/pods/7986ec05-d0d1-49ef-a8d5-2be22d20df8c/volumes/kubernetes.io~projected/kube-api-access-2rzzt major:0 minor:351 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7986ec05-d0d1-49ef-a8d5-2be22d20df8c/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/7986ec05-d0d1-49ef-a8d5-2be22d20df8c/volumes/kubernetes.io~secret/signing-key major:0 minor:346 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8272e327-372c-4b8c-9ca3-acf950c43690/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/8272e327-372c-4b8c-9ca3-acf950c43690/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8272e327-372c-4b8c-9ca3-acf950c43690/volumes/kubernetes.io~projected/kube-api-access-nhwrd:{mountpoint:/var/lib/kubelet/pods/8272e327-372c-4b8c-9ca3-acf950c43690/volumes/kubernetes.io~projected/kube-api-access-nhwrd major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8272e327-372c-4b8c-9ca3-acf950c43690/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/8272e327-372c-4b8c-9ca3-acf950c43690/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8dca566d-9570-433f-bde3-f47b3c7d2895/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/8dca566d-9570-433f-bde3-f47b3c7d2895/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8dca566d-9570-433f-bde3-f47b3c7d2895/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/8dca566d-9570-433f-bde3-f47b3c7d2895/volumes/kubernetes.io~empty-dir/tmp major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8dca566d-9570-433f-bde3-f47b3c7d2895/volumes/kubernetes.io~projected/kube-api-access-pgkkl:{mountpoint:/var/lib/kubelet/pods/8dca566d-9570-433f-bde3-f47b3c7d2895/volumes/kubernetes.io~projected/kube-api-access-pgkkl major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9283e782-7152-4c67-8ce3-e07042df088b/volumes/kubernetes.io~projected/kube-api-access-84g42:{mountpoint:/var/lib/kubelet/pods/9283e782-7152-4c67-8ce3-e07042df088b/volumes/kubernetes.io~projected/kube-api-access-84g42 major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/953e8e8a-3671-4896-9b02-cb40af9e1978/volumes/kubernetes.io~projected/kube-api-access-g98wr:{mountpoint:/var/lib/kubelet/pods/953e8e8a-3671-4896-9b02-cb40af9e1978/volumes/kubernetes.io~projected/kube-api-access-g98wr major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a9dc342a-1857-4691-a57b-d1672547d10c/volumes/kubernetes.io~projected/kube-api-access-ptvfj:{mountpoint:/var/lib/kubelet/pods/a9dc342a-1857-4691-a57b-d1672547d10c/volumes/kubernetes.io~projected/kube-api-access-ptvfj major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a9dc342a-1857-4691-a57b-d1672547d10c/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/a9dc342a-1857-4691-a57b-d1672547d10c/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c04074e7-79db-4586-9c75-ec922314ba54/volumes/kubernetes.io~projected/kube-api-access-c5ccn:{mountpoint:/var/lib/kubelet/pods/c04074e7-79db-4586-9c75-ec922314ba54/volumes/kubernetes.io~projected/kube-api-access-c5ccn major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c04074e7-79db-4586-9c75-ec922314ba54/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/c04074e7-79db-4586-9c75-ec922314ba54/volumes/kubernetes.io~secret/serving-cert major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d035486c-ba72-485c-88f9-0733ea426168/volumes/kubernetes.io~projected/kube-api-access-6f45v:{mountpoint:/var/lib/kubelet/pods/d035486c-ba72-485c-88f9-0733ea426168/volumes/kubernetes.io~projected/kube-api-access-6f45v major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d49dda15-d5d9-414e-b552-0d9bcab7bba0/volumes/kubernetes.io~projected/kube-api-access-kk2nv:{mountpoint:/var/lib/kubelet/pods/d49dda15-d5d9-414e-b552-0d9bcab7bba0/volumes/kubernetes.io~projected/kube-api-access-kk2nv major:0 minor:237 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1/volumes/kubernetes.io~projected/kube-api-access-bbfnh:{mountpoint:/var/lib/kubelet/pods/e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1/volumes/kubernetes.io~projected/kube-api-access-bbfnh major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639/volumes/kubernetes.io~projected/kube-api-access-6vznm:{mountpoint:/var/lib/kubelet/pods/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639/volumes/kubernetes.io~projected/kube-api-access-6vznm major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950/volumes/kubernetes.io~projected/kube-api-access-gm5s5:{mountpoint:/var/lib/kubelet/pods/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950/volumes/kubernetes.io~projected/kube-api-access-gm5s5 major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd26b2a0-3960-49b0-8d68-034665741c8a/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/fd26b2a0-3960-49b0-8d68-034665741c8a/volumes/kubernetes.io~secret/agent-certs major:0 minor:50 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/b5ecdd7c681daa97b9f9067b0777203040b4a48fae593bb97743870b5a10d61b/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/f6b8332bbc99403e87c1e37c12d48b9ca08fd0fcf29678ee9afd28da5464eb74/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/892f7e9c185eb51bd3a6b189467954b39ffb19f48107a5225caa3667396cb7a1/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/c7788d857cfef394c162997402197e1690c626d968c81567f5b788999d1ab3d5/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/87b8ed9ac27fbe2e47dece678e2862e1678995240f0c213a3e496ccb8168a82f/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/24b1ca93e3993c5e173e0ef902126a5da3dfee240790641bc3b5665a759212fa/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/443697756d525bb897d38e755866f716c1ed3d1344c1c13d47eb7b151e0e5ca3/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/0f7d7ea1e0f9fc295e9ff7f7de8459023b6d19d05334c182fb990a625e8e70a8/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/0cac36f52a8e6eafa727b08cf1424aabec0aeed07280790b70bd89c19e39d90f/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/ef8df1646eb5aff8f28ce78dedbd66a70d2716b1babedab72a2c6cc9f5792739/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/3681bdab82a1d67fc8b08051d651d0e32510892a00a2f81a0e4a294aec21a9dc/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/03012aba110e643e4782659b7f3736de77d6b64fa3bb050f4953fd0ceea3af22/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/56ca8e3daeada119b924ce04cd982257c2b7f340225e3769a4b0a5730ed77dd7/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/5cbce199e98a4a5004c125e5a05f4498bff72f63244ff67e74585ca2c93c545a/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/52712df5d65ce4333833767963ffc5aeb3e0d062bed9533a37fa5e8cd0db7874/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/ec246150204d74c78cfabd2006280bf92b41c2f05049a8e384f3a3105182ffbe/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/87d212b4818758ae1c2593a1ad2872a332bb37c4cbc0f2b95144d86a08000c2f/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/266038479a2e4aff972c4075fe9a63191a12ca3dd497e0ba8f1ef54fdac7a08e/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/a96511ef63fe18f5caed3ea1cdd22a204b0a1ffac39c8265f411fe27815db82d/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/ad8d665f4fa471c1a917ede2dc65b273666daf1421b2fbfef34d20c2b2bd9b9f/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/5729af9563ef760b4056676112f7ad9439033f9babcc1093eb5bc96c0436790e/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/74d50fc07694e936d8cc69139c09306b2f34d3b480d01d2f9667583af333eabb/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/6e06566c6d0a0cc946ded9e6b83180134deb0d5a80009ef8ee4c6aa30734aa22/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/edecf2a0e9c38378b63ab390fdf11e780be33e5d8327b3f742f184c7768f6570/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/c2c71430bf18cd13f3cc31e42685b5dfe8bb846608eb348e4326956317a79e7d/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/c969921504dfb9a5a10f1dc5a642cda6a510f94f1384e084415fa53926f28043/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/8745685d70e391f10a4ad46b2176ab2b7ddc99345fb74d490c2d58aa57913b7a/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/f8f4197cbfbb31fb32ecb0310a670810c57f9df8d4256fe62970adf2d00ccdf2/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/d457ecdcb63097fe43fa7866e6f901a420a46bc588331c071be34b1421fad7f4/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/c8034b7e591ab9044a576526727e1ddd4f5159b94826b8552aa256693eac3949/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-265:{mountpoint:/var/lib/containers/storage/overlay/43c5d91081fda4d3b8467ab02b9fa07091bdf0c348906824ac446a91f07d71eb/merged major:0 minor:265 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/d45d6c015c6a771ee51a3901660726f86bef6376bd468ca7100d6745273542b4/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-279:{mountpoint:/var/lib/containers/storage/overlay/8b277971bd51724245aad803a4eeffeb4fb0af9542760d59aaa658f20fc046ce/merged major:0 minor:279 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/a0f0a217b094f79ed8b7144d78beb55c6c9ef4b1d1c60aa8316010eac54e7f45/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-292:{mountpoint:/var/lib/containers/storage/overlay/108ee2609ba561c5e21b3759fd66c4152bb4869b555e7d967df2d55ba4f2e494/merged major:0 minor:292 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/1219dfcb7306d28e6e5681ea006198b1a5c3a8ad2e5707111d1303f39bef5dc5/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/24012e5dc65477951a15d7204c345ae268cbe4f96df21f4b7c17e2516735f4c3/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/f85ddce75ed305ce8402fdbf4e6a1bc7c600ee104daf7a651499645e7048f9e5/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/7ede45df27568b290b3f782bcbba5be1faca7b416c9953eaf09d2bdcaf91de88/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/74555af1f1bfed0eb5220d85083c4455394728bd38aa44e440ec432ee76461b6/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-317:{mountpoint:/var/lib/containers/storage/overlay/4ea12be6ed66792123ed4b6faf2e19d003d150eb53544aca4615f913f3aef69c/merged major:0 minor:317 fsType:overlay blockSize:0} overlay_0-330:{mountpoint:/var/lib/containers/storage/overlay/8987daec886cd971eba6a3772c37549a121e7561766a8214750e6942a1948a14/merged major:0 minor:330 fsType:overlay blockSize:0} overlay_0-332:{mountpoint:/var/lib/containers/storage/overlay/920ddf2c7a394f056a2adfff67c7e50997f90659111d3db12f1288ec481dae6f/merged major:0 minor:332 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/867a01a237c9a750c1dfbb5290ba6b0d32977958908aa37e9bd768433663c6bc/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/14e52f429f79f69e24fbea73b54729b9070d3e0f3257036b6cfef394778dc324/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/3164e3217aab3f48d49ffa9fc348ffac9b6a6d7d53d4a60dd86a8819aef6380a/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/a1868c53ea39816a885db84308eac663f0e2ced83ce08a02f091c9aa6dc5ee26/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/164b94a1ddcf8a838b8876aab12bf7bf3a3b8a2b7016243cd1d18a261652a804/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/530f60b8d5c639a8def424e24476bf784971e7d3f4d1b8686134985af5a40939/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/8002e3ad661b6ba525744a182556beebab75ba331fbca3c06e03822ea1c3139b/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/6411bc52e8a4b998266d57618ff5bb3e350fa7cbb30d2dadc4a03d9640f01239/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/9677e1475820a053da7beb3db951034323cabf2a292561a9b1d6d9e63f03e694/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/1382c34851b78a942a93ad1ea3c42ed40a95b3aca664e5743f267356a2050c45/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-81:{mountpoint:/var/lib/containers/storage/overlay/9b75356cf8f6c77bd9623875f16cfabda79e9c40f53c337f22e0b15cababba0f/merged major:0 minor:81 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/a1d8be91c3a197f92e34cb95a84f73166fcd03df3e2dc4356d752d52cfe16aed/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/5f3be5dc3aefe3b7452a51d08f1ad6dd494c1d4558edd06b4e55174814d95c6d/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-93:{mountpoint:/var/lib/containers/storage/overlay/2683192af563163f4320598008e0391b808f0fc168072c7d6762bb0d7ad044f2/merged major:0 minor:93 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/57b159d7f9c58b9b617d52d7710125cfad283ecf1893f03a7acae6c3f32ad7bb/merged major:0 minor:96 fsType:overlay blockSize:0}] Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.598098 4955 manager.go:217] Machine: {Timestamp:2026-11-04 04:45:49.597303299 +0000 UTC m=+0.067129430 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104043 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec201e640063449dadeacac160a9e71e SystemUUID:ec201e64-0063-449d-adea-cac160a9e71e BootID:5fcc7dee-162a-45be-8d40-8d9d612a56b0 Filesystems:[{Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7986ec05-d0d1-49ef-a8d5-2be22d20df8c/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:346 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1194de70ef1a63df8a4298d03ec9d73b821fb1689ecdf814a747480b57efd82b/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6491499f-48db-4ee8-9cc1-b27029b2c033/volumes/kubernetes.io~projected/kube-api-access-4xv8k DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:229 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ba7e63ca6944959cffca724e2e68bd6fa51f8b2e71c82007accd3bd60fbec813/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/953e8e8a-3671-4896-9b02-cb40af9e1978/volumes/kubernetes.io~projected/kube-api-access-g98wr DeviceMajor:0 DeviceMinor:53 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5331a9ab-3b27-4726-bf53-9ed1ac228c6c/volumes/kubernetes.io~projected/kube-api-access-ztj4f DeviceMajor:0 DeviceMinor:54 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950/volumes/kubernetes.io~projected/kube-api-access-gm5s5 DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes/kubernetes.io~projected/kube-api-access-c59zf DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/474ac538-e679-400a-89ee-db708dfcddda/volumes/kubernetes.io~projected/kube-api-access-hrsrc DeviceMajor:0 DeviceMinor:231 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9283e782-7152-4c67-8ce3-e07042df088b/volumes/kubernetes.io~projected/kube-api-access-84g42 DeviceMajor:0 DeviceMinor:230 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3751973e-ab65-4992-9b24-38a050b1324c/volumes/kubernetes.io~projected/kube-api-access-2cvsc DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d035486c-ba72-485c-88f9-0733ea426168/volumes/kubernetes.io~projected/kube-api-access-6f45v DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/155e2be44040f0ae4c2a5a2aaeb4bf3a647c188e4f7495a85ff1e8443d715acc/userdata/shm DeviceMajor:0 DeviceMinor:91 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes/kubernetes.io~projected/kube-api-access-m66bl DeviceMajor:0 DeviceMinor:235 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/425ce514232109c05af0a5b0dd2ee2d2b7e1dcde98ef0c6bea435b5b0179efa0/userdata/shm DeviceMajor:0 DeviceMinor:79 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/34bc4578-ce85-4a2d-9f94-0305ae3267f2/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:286 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-93 DeviceMajor:0 DeviceMinor:93 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1/volumes/kubernetes.io~projected/kube-api-access-2qgh6 DeviceMajor:0 DeviceMinor:316 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8272e327-372c-4b8c-9ca3-acf950c43690/volumes/kubernetes.io~projected/kube-api-access-nhwrd DeviceMajor:0 DeviceMinor:51 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/db7c8953a88e5b1720836276cb1bdf0f1c33e86f476714dd69873cada67401d7/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-265 DeviceMajor:0 DeviceMinor:265 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:214 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c04074e7-79db-4586-9c75-ec922314ba54/volumes/kubernetes.io~projected/kube-api-access-c5ccn DeviceMajor:0 DeviceMinor:234 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d79bdadc866e9dcdb8e6814b78839c7b113baee098941a07ab3aaab4b0bec0e8/userdata/shm DeviceMajor:0 DeviceMinor:288 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-332 DeviceMajor:0 DeviceMinor:332 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8272e327-372c-4b8c-9ca3-acf950c43690/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:49 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639/volumes/kubernetes.io~projected/kube-api-access-6vznm DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a9dc342a-1857-4691-a57b-d1672547d10c/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/97979a55cc531c74cdce3ffc71aade9a5e4badbf06595870d591194d8bef4669/userdata/shm DeviceMajor:0 DeviceMinor:239 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-330 DeviceMajor:0 DeviceMinor:330 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8dca566d-9570-433f-bde3-f47b3c7d2895/volumes/kubernetes.io~projected/kube-api-access-pgkkl DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0f55afb7-c026-4ad5-afe1-6c133692689e/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ce0f8e5536a46a40523db36a3cb54280b47e17de9a98fb61c31d2b6ba6646f9d/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8272e327-372c-4b8c-9ca3-acf950c43690/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/0483be54-d5f5-4555-89c9-ef61cbee16ad/volumes/kubernetes.io~projected/kube-api-access-hxtdj DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/72e78e303790e31c3cf6b560634ba9a36635f6109359974e50edd2a92e2375da/userdata/shm DeviceMajor:0 DeviceMinor:225 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/66675bf0-7d80-414a-8ccc-a7e3718bbaaa/volumes/kubernetes.io~projected/kube-api-access-k5xp4 DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f803cb825a272dfbf1196f8dc1daa43d520274af80e91b0f4318f921a1535842/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a9dc342a-1857-4691-a57b-d1672547d10c/volumes/kubernetes.io~projected/kube-api-access-ptvfj DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c0c0ff0c95c9a734d602aa61ca025816684e3bdee7c53698046204b3e4c547d2/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/68d3b5c463d2b4253b999e800fd2f3208a00eb099a6a107b2315f77748012115/userdata/shm DeviceMajor:0 DeviceMinor:289 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-279 DeviceMajor:0 DeviceMinor:279 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8dca566d-9570-433f-bde3-f47b3c7d2895/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:47 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8dca566d-9570-433f-bde3-f47b3c7d2895/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:48 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f20e7d9c261d68f03284575088df97b83981d016703a3bfec8f7a9f2b11904ea/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6e75df29-4521-44fa-babe-a45b73155b91/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/70407c80-19ed-467f-a4a4-8ff150518aef/volumes/kubernetes.io~projected/kube-api-access-v27tp DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0921fa80-a280-4013-8c90-530a9f1e45e1/volumes/kubernetes.io~projected/kube-api-access-l58ck DeviceMajor:0 DeviceMinor:52 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0f55afb7-c026-4ad5-afe1-6c133692689e/volumes/kubernetes.io~projected/kube-api-access-wxcd2 DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/595ebab5af0e3dc13e715b55966b7bece769b25159bd2e615d82b85baa49f9c8/userdata/shm DeviceMajor:0 DeviceMinor:223 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/03fc0594b65365a6463b37907f6da78499301fc622db6af8a3a878079e4a5ad6/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7/volumes/kubernetes.io~projected/kube-api-access-sk5v2 DeviceMajor:0 DeviceMinor:323 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cd1d3cc3e3163a0b4459a9b1b7a541f80bab722e34180064f14b5bc3de5ef80a/userdata/shm DeviceMajor:0 DeviceMinor:328 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c04074e7-79db-4586-9c75-ec922314ba54/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:218 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/68796d82-fed3-494a-8239-32c07fa7c466/volumes/kubernetes.io~projected/kube-api-access-p9wkm DeviceMajor:0 DeviceMinor:228 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0f55afb7-c026-4ad5-afe1-6c133692689e/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f094f3c122dcdcf0590860fb5c64e0f2695f384cc9e02611d4bc7d57e25c19e2/userdata/shm DeviceMajor:0 DeviceMinor:221 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7986ec05-d0d1-49ef-a8d5-2be22d20df8c/volumes/kubernetes.io~projected/kube-api-access-2rzzt DeviceMajor:0 DeviceMinor:351 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d49dda15-d5d9-414e-b552-0d9bcab7bba0/volumes/kubernetes.io~projected/kube-api-access-kk2nv DeviceMajor:0 DeviceMinor:237 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-292 DeviceMajor:0 DeviceMinor:292 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/76505d6245df483f16d24c41ad1b7a2f096421962fd091b474d643980739175d/userdata/shm DeviceMajor:0 DeviceMinor:352 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fd26b2a0-3960-49b0-8d68-034665741c8a/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:50 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1/volumes/kubernetes.io~projected/kube-api-access-bbfnh DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/68796d82-fed3-494a-8239-32c07fa7c466/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/34bc4578-ce85-4a2d-9f94-0305ae3267f2/volumes/kubernetes.io~projected/kube-api-access-8j7m2 DeviceMajor:0 DeviceMinor:232 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/65b09845f3a957ae48f5ee479bcc15cac4a19d81690a4be07e5bfdd6bd2595f1/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6e75df29-4521-44fa-babe-a45b73155b91/volumes/kubernetes.io~projected/kube-api-access-pj7qq DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/93f479b4ebd56a9c144f484e9b5589106530614777dada64be7e1642af1a7892/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-317 DeviceMajor:0 DeviceMinor:317 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0c34a17ccf8f222c33197013e59b989754daeb18a1d7d91ed4bb73ef61730bc8/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a20bde6ddb43854d9cf74a0d182eff35f2c602b5fc52ee41e59cc3a4383756ae/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-81 DeviceMajor:0 DeviceMinor:81 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/469e9630a173a2dd8817830d3d87dea45f803e17fbedd5930cdc5b16f84a8358/userdata/shm DeviceMajor:0 DeviceMinor:219 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6febe6fa-de9b-47eb-a036-a63aea789894/volumes/kubernetes.io~projected/kube-api-access-tzrs5 DeviceMajor:0 DeviceMinor:287 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2631258c5b789f74650eef2e57a7f6affd10af1a0e530510a4f1bc1648e567ab/userdata/shm DeviceMajor:0 DeviceMinor:233 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:03fc0594b65365a MacAddress:5a:08:1b:ab:6a:d5 Speed:10000 Mtu:8901} {Name:2631258c5b789f7 MacAddress:fe:ec:fc:af:7c:cb Speed:10000 Mtu:8901} {Name:469e9630a173a2d MacAddress:ae:92:f1:c8:0d:ca Speed:10000 Mtu:8901} {Name:595ebab5af0e3dc MacAddress:6a:ac:db:d4:d2:ea Speed:10000 Mtu:8901} {Name:68d3b5c463d2b42 MacAddress:62:3b:a9:db:76:62 Speed:10000 Mtu:8901} {Name:72e78e303790e31 MacAddress:8e:0e:4d:4d:0e:42 Speed:10000 Mtu:8901} {Name:76505d6245df483 MacAddress:3a:9f:64:9c:0e:01 Speed:10000 Mtu:8901} {Name:93f479b4ebd56a9 MacAddress:16:b5:37:35:b4:78 Speed:10000 Mtu:8901} {Name:97979a55cc531c7 MacAddress:f6:48:5f:05:6c:27 Speed:10000 Mtu:8901} {Name:ba7e63ca6944959 MacAddress:1e:ab:29:3b:1c:c4 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:e8:3d:7b:db Speed:0 Mtu:9001} {Name:br-int MacAddress:ca:d2:aa:7a:b0:b4 Speed:0 Mtu:8901} {Name:cd1d3cc3e3163a0 MacAddress:0a:99:5d:47:12:5b Speed:10000 Mtu:8901} {Name:d79bdadc866e9dc MacAddress:7e:f5:a3:e9:52:60 Speed:10000 Mtu:8901} {Name:db7c8953a88e5b1 MacAddress:52:52:ff:0b:f6:68 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:e8:3d:7b:db Speed:0 Mtu:9001} {Name:f094f3c122dcdcf MacAddress:b2:86:26:90:ac:35 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:de:6c:0b:e9:2f:f6 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:be:ce:e9:11:8b:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.598704 4955 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.598760 4955 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599022 4955 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599046 4955 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-197.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599163 4955 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599169 4955 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599179 4955 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599191 4955 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599208 4955 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599376 4955 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599471 4955 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599501 4955 kubelet.go:493] "Attempting to sync node with API server" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599510 4955 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599519 4955 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599528 4955 kubelet.go:405] "Adding apiserver pod source" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.599535 4955 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.600163 4955 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 04:45:49.600565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.600174 4955 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 04:45:49.601249 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.600655 4955 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 04:45:49.602898 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.602883 4955 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 04:45:49.602898 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.602898 4955 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 04:45:49.602998 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.602989 4955 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 04 04:45:49.603193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603181 4955 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 04:45:49.603226 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603210 4955 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 04:45:49.603323 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603314 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 04:45:49.603353 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603328 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 04:45:49.603353 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603335 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 04:45:49.603353 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603340 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 04:45:49.603353 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603345 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 04:45:49.603353 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603350 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 04:45:49.603489 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603356 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 04:45:49.603489 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603362 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 04:45:49.603489 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603369 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 04:45:49.603489 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603375 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 04:45:49.603489 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603390 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 04:45:49.603489 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603400 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 04:45:49.603489 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603423 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 04:45:49.603489 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.603428 4955 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 04:45:49.606793 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.606779 4955 server.go:1263] "Started kubelet" Nov 04 04:45:49.606896 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.606848 4955 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 04:45:49.607405 ip-10-0-132-197 systemd[1]: Started Kubernetes Kubelet. Nov 04 04:45:49.608185 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.607387 4955 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 04:45:49.608185 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.607468 4955 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 04:45:49.608185 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.607781 4955 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 04:45:49.609211 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.609198 4955 server.go:317] "Adding debug handlers to kubelet server" Nov 04 04:45:49.611962 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.611932 4955 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 04:45:49.613287 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.612467 4955 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 04:45:49.613287 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.612499 4955 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 04:40:07 +0000 UTC" deadline="2028-06-18 14:32:04.154488204 +0000 UTC" Nov 04 04:45:49.613287 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.612521 4955 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14217h46m14.541968769s" Nov 04 04:45:49.613287 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.612596 4955 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 04:45:49.613287 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.612608 4955 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 04:45:49.613287 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:49.612716 4955 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-197.us-west-2.compute.internal\" not found" Nov 04 04:45:49.613287 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.612925 4955 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 04:45:49.615174 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.614774 4955 factory.go:55] Registering systemd factory Nov 04 04:45:49.615174 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.614796 4955 factory.go:223] Registration of the systemd container factory successfully Nov 04 04:45:49.615174 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.615033 4955 factory.go:153] Registering CRI-O factory Nov 04 04:45:49.615174 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.615045 4955 factory.go:223] Registration of the crio container factory successfully Nov 04 04:45:49.615174 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.615109 4955 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 04:45:49.615174 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.615129 4955 factory.go:103] Registering Raw factory Nov 04 04:45:49.615676 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.615661 4955 manager.go:1199] Started watching for new ooms in manager Nov 04 04:45:49.616046 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.616030 4955 manager.go:319] Starting recovery of all containers Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618010 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f55afb7-c026-4ad5-afe1-6c133692689e" volumeName="kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-default-certificate" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618058 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="68796d82-fed3-494a-8239-32c07fa7c466" volumeName="kubernetes.io/secret/68796d82-fed3-494a-8239-32c07fa7c466-serving-cert" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618072 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7074b62a-f130-413b-ae9d-53b113f9f58c" volumeName="kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-kube-api-access-m66bl" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618086 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c04074e7-79db-4586-9c75-ec922314ba54" volumeName="kubernetes.io/secret/c04074e7-79db-4586-9c75-ec922314ba54-serving-cert" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618100 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24e214b2-5e33-4022-8f14-edf1cb11f820" volumeName="kubernetes.io/empty-dir/24e214b2-5e33-4022-8f14-edf1cb11f820-ca-trust-extracted" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618113 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24e214b2-5e33-4022-8f14-edf1cb11f820" volumeName="kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-image-registry-private-configuration" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618126 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" volumeName="kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-service-ca-bundle" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618138 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6491499f-48db-4ee8-9cc1-b27029b2c033" volumeName="kubernetes.io/empty-dir/6491499f-48db-4ee8-9cc1-b27029b2c033-tmp-dir" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618154 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6e75df29-4521-44fa-babe-a45b73155b91" volumeName="kubernetes.io/configmap/6e75df29-4521-44fa-babe-a45b73155b91-config" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618172 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6febe6fa-de9b-47eb-a036-a63aea789894" volumeName="kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618185 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7074b62a-f130-413b-ae9d-53b113f9f58c" volumeName="kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-certificates" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618197 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9283e782-7152-4c67-8ce3-e07042df088b" volumeName="kubernetes.io/projected/9283e782-7152-4c67-8ce3-e07042df088b-kube-api-access-84g42" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618210 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0921fa80-a280-4013-8c90-530a9f1e45e1" volumeName="kubernetes.io/configmap/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-daemon-config" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618223 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0921fa80-a280-4013-8c90-530a9f1e45e1" volumeName="kubernetes.io/projected/0921fa80-a280-4013-8c90-530a9f1e45e1-kube-api-access-l58ck" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618256 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7074b62a-f130-413b-ae9d-53b113f9f58c" volumeName="kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-trusted-ca" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618357 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7074b62a-f130-413b-ae9d-53b113f9f58c" volumeName="kubernetes.io/empty-dir/7074b62a-f130-413b-ae9d-53b113f9f58c-ca-trust-extracted" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618369 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8272e327-372c-4b8c-9ca3-acf950c43690" volumeName="kubernetes.io/secret/8272e327-372c-4b8c-9ca3-acf950c43690-ovn-node-metrics-cert" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618383 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24e214b2-5e33-4022-8f14-edf1cb11f820" volumeName="kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-bound-sa-token" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618396 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24e214b2-5e33-4022-8f14-edf1cb11f820" volumeName="kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-installation-pull-secrets" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618410 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3751973e-ab65-4992-9b24-38a050b1324c" volumeName="kubernetes.io/configmap/3751973e-ab65-4992-9b24-38a050b1324c-serviceca" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618435 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6e75df29-4521-44fa-babe-a45b73155b91" volumeName="kubernetes.io/configmap/6e75df29-4521-44fa-babe-a45b73155b91-trusted-ca" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618448 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70407c80-19ed-467f-a4a4-8ff150518aef" volumeName="kubernetes.io/projected/70407c80-19ed-467f-a4a4-8ff150518aef-kube-api-access-v27tp" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618461 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f55afb7-c026-4ad5-afe1-6c133692689e" volumeName="kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-stats-auth" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618472 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" volumeName="kubernetes.io/projected/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-kube-api-access-sk5v2" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618487 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="474ac538-e679-400a-89ee-db708dfcddda" volumeName="kubernetes.io/projected/474ac538-e679-400a-89ee-db708dfcddda-kube-api-access-hrsrc" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618498 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="68796d82-fed3-494a-8239-32c07fa7c466" volumeName="kubernetes.io/projected/68796d82-fed3-494a-8239-32c07fa7c466-kube-api-access-p9wkm" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618510 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9dc342a-1857-4691-a57b-d1672547d10c" volumeName="kubernetes.io/projected/a9dc342a-1857-4691-a57b-d1672547d10c-kube-api-access-ptvfj" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618523 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b" volumeName="kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618541 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34bc4578-ce85-4a2d-9f94-0305ae3267f2" volumeName="kubernetes.io/secret/34bc4578-ce85-4a2d-9f94-0305ae3267f2-cert" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618553 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" volumeName="kubernetes.io/empty-dir/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-archives-path" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618565 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="68796d82-fed3-494a-8239-32c07fa7c466" volumeName="kubernetes.io/empty-dir/68796d82-fed3-494a-8239-32c07fa7c466-tmp" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618578 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7074b62a-f130-413b-ae9d-53b113f9f58c" volumeName="kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-bound-sa-token" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618589 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8272e327-372c-4b8c-9ca3-acf950c43690" volumeName="kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-ovnkube-script-lib" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618602 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd26b2a0-3960-49b0-8d68-034665741c8a" volumeName="kubernetes.io/secret/fd26b2a0-3960-49b0-8d68-034665741c8a-agent-certs" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618616 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f55afb7-c026-4ad5-afe1-6c133692689e" volumeName="kubernetes.io/projected/0f55afb7-c026-4ad5-afe1-6c133692689e-kube-api-access-wxcd2" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618627 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1" volumeName="kubernetes.io/projected/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-api-access-2qgh6" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618642 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24e214b2-5e33-4022-8f14-edf1cb11f820" volumeName="kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-kube-api-access-c59zf" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618654 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="953e8e8a-3671-4896-9b02-cb40af9e1978" volumeName="kubernetes.io/configmap/953e8e8a-3671-4896-9b02-cb40af9e1978-iptables-alerter-script" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618666 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d035486c-ba72-485c-88f9-0733ea426168" volumeName="kubernetes.io/projected/d035486c-ba72-485c-88f9-0733ea426168-kube-api-access-6f45v" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618678 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24e214b2-5e33-4022-8f14-edf1cb11f820" volumeName="kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-certificates" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618691 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" volumeName="kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cni-sysctl-allowlist" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618703 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="66675bf0-7d80-414a-8ccc-a7e3718bbaaa" volumeName="kubernetes.io/projected/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-kube-api-access-k5xp4" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618715 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="68796d82-fed3-494a-8239-32c07fa7c466" volumeName="kubernetes.io/configmap/68796d82-fed3-494a-8239-32c07fa7c466-trusted-ca-bundle" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618727 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7074b62a-f130-413b-ae9d-53b113f9f58c" volumeName="kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-image-registry-private-configuration" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618740 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8dca566d-9570-433f-bde3-f47b3c7d2895" volumeName="kubernetes.io/empty-dir/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-tuned" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618752 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8dca566d-9570-433f-bde3-f47b3c7d2895" volumeName="kubernetes.io/projected/8dca566d-9570-433f-bde3-f47b3c7d2895-kube-api-access-pgkkl" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618765 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="953e8e8a-3671-4896-9b02-cb40af9e1978" volumeName="kubernetes.io/projected/953e8e8a-3671-4896-9b02-cb40af9e1978-kube-api-access-g98wr" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618778 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0483be54-d5f5-4555-89c9-ef61cbee16ad" volumeName="kubernetes.io/configmap/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-config" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618790 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0483be54-d5f5-4555-89c9-ef61cbee16ad" volumeName="kubernetes.io/projected/0483be54-d5f5-4555-89c9-ef61cbee16ad-kube-api-access-hxtdj" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618819 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1" volumeName="kubernetes.io/empty-dir/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-data-volume" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618832 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3751973e-ab65-4992-9b24-38a050b1324c" volumeName="kubernetes.io/projected/3751973e-ab65-4992-9b24-38a050b1324c-kube-api-access-2cvsc" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618843 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" volumeName="kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618854 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6491499f-48db-4ee8-9cc1-b27029b2c033" volumeName="kubernetes.io/projected/6491499f-48db-4ee8-9cc1-b27029b2c033-kube-api-access-4xv8k" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618867 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7074b62a-f130-413b-ae9d-53b113f9f58c" volumeName="kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-installation-pull-secrets" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618879 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d49dda15-d5d9-414e-b552-0d9bcab7bba0" volumeName="kubernetes.io/projected/d49dda15-d5d9-414e-b552-0d9bcab7bba0-kube-api-access-kk2nv" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618891 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6491499f-48db-4ee8-9cc1-b27029b2c033" volumeName="kubernetes.io/configmap/6491499f-48db-4ee8-9cc1-b27029b2c033-config-volume" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618914 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7986ec05-d0d1-49ef-a8d5-2be22d20df8c" volumeName="kubernetes.io/projected/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-kube-api-access-2rzzt" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618925 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8272e327-372c-4b8c-9ca3-acf950c43690" volumeName="kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-env-overrides" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618940 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9dc342a-1857-4691-a57b-d1672547d10c" volumeName="kubernetes.io/secret/a9dc342a-1857-4691-a57b-d1672547d10c-serving-cert" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618951 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c04074e7-79db-4586-9c75-ec922314ba54" volumeName="kubernetes.io/projected/c04074e7-79db-4586-9c75-ec922314ba54-kube-api-access-c5ccn" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618964 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1" volumeName="kubernetes.io/projected/e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1-kube-api-access-bbfnh" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.618977 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0921fa80-a280-4013-8c90-530a9f1e45e1" volumeName="kubernetes.io/configmap/0921fa80-a280-4013-8c90-530a9f1e45e1-cni-binary-copy" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619000 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6e75df29-4521-44fa-babe-a45b73155b91" volumeName="kubernetes.io/projected/6e75df29-4521-44fa-babe-a45b73155b91-kube-api-access-pj7qq" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619011 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8dca566d-9570-433f-bde3-f47b3c7d2895" volumeName="kubernetes.io/empty-dir/8dca566d-9570-433f-bde3-f47b3c7d2895-tmp" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619023 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb2998cb-3584-4d30-8ff9-9e1ca5dc8950" volumeName="kubernetes.io/empty-dir/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-tmp-dir" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619039 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" volumeName="kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cni-binary-copy" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619051 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6e75df29-4521-44fa-babe-a45b73155b91" volumeName="kubernetes.io/secret/6e75df29-4521-44fa-babe-a45b73155b91-serving-cert" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619062 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7986ec05-d0d1-49ef-a8d5-2be22d20df8c" volumeName="kubernetes.io/secret/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-signing-key" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619074 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8272e327-372c-4b8c-9ca3-acf950c43690" volumeName="kubernetes.io/projected/8272e327-372c-4b8c-9ca3-acf950c43690-kube-api-access-nhwrd" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619086 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8dfe4c5-4264-40e3-a284-69e2d64be1f5" volumeName="kubernetes.io/configmap/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-nginx-conf" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619098 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d49dda15-d5d9-414e-b552-0d9bcab7bba0" volumeName="kubernetes.io/configmap/d49dda15-d5d9-414e-b552-0d9bcab7bba0-telemetry-config" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619109 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb2998cb-3584-4d30-8ff9-9e1ca5dc8950" volumeName="kubernetes.io/projected/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-kube-api-access-gm5s5" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619122 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd26b2a0-3960-49b0-8d68-034665741c8a" volumeName="kubernetes.io/configmap/fd26b2a0-3960-49b0-8d68-034665741c8a-konnectivity-ca" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619134 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="68796d82-fed3-494a-8239-32c07fa7c466" volumeName="kubernetes.io/configmap/68796d82-fed3-494a-8239-32c07fa7c466-service-ca-bundle" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619145 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="68796d82-fed3-494a-8239-32c07fa7c466" volumeName="kubernetes.io/empty-dir/68796d82-fed3-494a-8239-32c07fa7c466-snapshots" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619156 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7986ec05-d0d1-49ef-a8d5-2be22d20df8c" volumeName="kubernetes.io/configmap/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-signing-cabundle" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619168 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c04074e7-79db-4586-9c75-ec922314ba54" volumeName="kubernetes.io/configmap/c04074e7-79db-4586-9c75-ec922314ba54-config" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619181 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24e214b2-5e33-4022-8f14-edf1cb11f820" volumeName="kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-trusted-ca" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619194 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34bc4578-ce85-4a2d-9f94-0305ae3267f2" volumeName="kubernetes.io/projected/34bc4578-ce85-4a2d-9f94-0305ae3267f2-kube-api-access-8j7m2" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619206 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4cfdbb2-d02d-46a4-8d69-4d7418f8c639" volumeName="kubernetes.io/projected/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-kube-api-access-6vznm" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619218 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" volumeName="kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-trusted-ca-bundle" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619231 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" volumeName="kubernetes.io/projected/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-kube-api-access-ztj4f" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619245 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8272e327-372c-4b8c-9ca3-acf950c43690" volumeName="kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-ovnkube-config" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619292 4955 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a9dc342a-1857-4691-a57b-d1672547d10c" volumeName="kubernetes.io/configmap/a9dc342a-1857-4691-a57b-d1672547d10c-config" seLinuxMountContext="" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619305 4955 reconstruct.go:97] "Volume reconstruction finished" Nov 04 04:45:49.619648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.619312 4955 reconciler.go:29] "Reconciler: start to sync state" Nov 04 04:45:49.632751 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.631796 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/1.log" Nov 04 04:45:49.633914 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.633725 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/1.log" Nov 04 04:45:49.646063 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.646036 4955 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 04:45:49.647589 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.647570 4955 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 04:45:49.647589 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.647589 4955 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 04:45:49.647729 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.647610 4955 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 04:45:49.647729 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:49.647650 4955 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 04 04:45:49.674392 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.674365 4955 generic.go:356] "Generic (PLEG): container finished" podID="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" containerID="b1fd50dcfb3e1e771e7d8c97f2955db27625fed5655af46967ebf43b100d01c9" exitCode=0 Nov 04 04:45:49.674392 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.674391 4955 generic.go:356] "Generic (PLEG): container finished" podID="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" containerID="84034a1eca1c9d73b83d70ccc34edcc5ded2b23b6c3ca4aad0075278650139b2" exitCode=0 Nov 04 04:45:49.674565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.674399 4955 generic.go:356] "Generic (PLEG): container finished" podID="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" containerID="05841ebabdefdaea77d7cd25a92480180c7f3b564e25091d76dcac8f60fbf5fc" exitCode=0 Nov 04 04:45:49.674565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.674407 4955 generic.go:356] "Generic (PLEG): container finished" podID="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" containerID="6ad6ad0bfa3a894262fab7ac063fe0ed5736c811a5c074d4f37df547a2f64268" exitCode=0 Nov 04 04:45:49.674565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.674414 4955 generic.go:356] "Generic (PLEG): container finished" podID="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" containerID="424cc35471635ff973fe9526ee63ecf439e6632ba138ccd02136d0d6816165a7" exitCode=0 Nov 04 04:45:49.674565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.674424 4955 generic.go:356] "Generic (PLEG): container finished" podID="5331a9ab-3b27-4726-bf53-9ed1ac228c6c" containerID="f2b851fc83d15d2dfd8562a42be401f7ca8b0452b31a89e6e25429711966b26d" exitCode=0 Nov 04 04:45:49.690291 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.690253 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/1.log" Nov 04 04:45:49.690390 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.690302 4955 generic.go:356] "Generic (PLEG): container finished" podID="6e75df29-4521-44fa-babe-a45b73155b91" containerID="6e42effc280f254c979c893a004642bca2ab40c0fd64e589ba512f12038f705b" exitCode=255 Nov 04 04:45:49.693950 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.693925 4955 generic.go:356] "Generic (PLEG): container finished" podID="1de2404c5cc3fbadf16c719910f8d787" containerID="b547781123afb2d7d3730d7193545e6658cab3e65e26d59f4dfb69a823536e50" exitCode=0 Nov 04 04:45:49.710205 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.709118 4955 manager.go:324] Recovery completed Nov 04 04:45:49.712797 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:49.712778 4955 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-132-197.us-west-2.compute.internal\" not found" Nov 04 04:45:49.726233 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.726219 4955 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:49.727684 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.727662 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:49.727759 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.727691 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:49.727759 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.727701 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:49.730099 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730083 4955 cpu_manager.go:226] "Starting" policy="none" Nov 04 04:45:49.730099 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730095 4955 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 04:45:49.730221 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730115 4955 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 04:45:49.730221 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730098 4955 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:49.730340 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730284 4955 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 04 04:45:49.730340 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730299 4955 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 04 04:45:49.730340 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730322 4955 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 04 04:45:49.730340 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730331 4955 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 04 04:45:49.730340 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730339 4955 policy_none.go:50] "Start" Nov 04 04:45:49.730644 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730351 4955 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 04:45:49.730644 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730367 4955 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 04:45:49.730644 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730535 4955 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 04 04:45:49.730644 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730546 4955 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 04 04:45:49.730644 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.730554 4955 policy_none.go:44] "Start" Nov 04 04:45:49.731018 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.731001 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:49.731101 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.731031 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:49.731101 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.731042 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:49.735000 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.734971 4955 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 04:45:49.737539 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.737525 4955 manager.go:341] "Starting Device Plugin manager" Nov 04 04:45:49.737617 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:49.737548 4955 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 04:45:49.737617 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.737558 4955 server.go:87] "Starting device plugin registration server" Nov 04 04:45:49.737800 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.737788 4955 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 04:45:49.737850 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.737801 4955 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 04:45:49.737889 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.737877 4955 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 04:45:49.738012 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.737974 4955 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 04:45:49.738082 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.738021 4955 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 04:45:49.738082 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.738028 4955 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 04:45:49.738150 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.738076 4955 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T04:45:49.738007379Z","UUID":"761c846b-9794-44b2-aaf7-7756244a170a","Handler":null,"Name":"","Endpoint":""} Nov 04 04:45:49.740076 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:49.739572 4955 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 04:45:49.740076 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:49.739624 4955 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-197.us-west-2.compute.internal\" not found" Nov 04 04:45:49.742499 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.742476 4955 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 04:45:49.742499 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.742512 4955 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 04:45:49.748208 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.747698 4955 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal"] Nov 04 04:45:49.748352 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.748331 4955 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:49.749096 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.749080 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:49.749170 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.749110 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:49.749170 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.749124 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:49.749457 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.749443 4955 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:49.749618 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.749606 4955 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:49.750136 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.750120 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:49.750224 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.750145 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:49.750224 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.750159 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:49.750224 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.750200 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:49.750224 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.750220 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:49.750433 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.750234 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:49.750433 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:49.750402 4955 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-197.us-west-2.compute.internal\" not found" node="ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:49.750655 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.750626 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" event={"ID":"c77202defc6f17821d20368d232c24c4","Type":"ContainerStarted","Data":"d0d1d4ae150bbc454450c626e9b0874360f6426fcee34482d2708489be6d5367"} Nov 04 04:45:49.750719 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.750664 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" event={"ID":"c77202defc6f17821d20368d232c24c4","Type":"ContainerStarted","Data":"0c34a17ccf8f222c33197013e59b989754daeb18a1d7d91ed4bb73ef61730bc8"} Nov 04 04:45:49.750719 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.750691 4955 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:49.750719 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.750695 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" event={"ID":"1de2404c5cc3fbadf16c719910f8d787","Type":"ContainerStarted","Data":"61ad9021089982d620438eaf292fc828b8ced9de24a11fd2bbf2a9f33eadf603"} Nov 04 04:45:49.750719 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.750713 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" event={"ID":"1de2404c5cc3fbadf16c719910f8d787","Type":"ContainerDied","Data":"b547781123afb2d7d3730d7193545e6658cab3e65e26d59f4dfb69a823536e50"} Nov 04 04:45:49.750883 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.750731 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" event={"ID":"1de2404c5cc3fbadf16c719910f8d787","Type":"ContainerStarted","Data":"f803cb825a272dfbf1196f8dc1daa43d520274af80e91b0f4318f921a1535842"} Nov 04 04:45:49.751455 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.751439 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:49.751493 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.751471 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:49.751493 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.751482 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:49.751607 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:49.751596 4955 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-197.us-west-2.compute.internal\" not found" node="ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:49.805841 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.805820 4955 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:45:49.805969 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.805864 4955 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:45:49.805969 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.805902 4955 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 04 04:45:49.806691 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.806674 4955 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:45:49.813790 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.813773 4955 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:49.839993 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.839978 4955 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:45:49.840942 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.840918 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:45:49.841022 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.840946 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:45:49.841022 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.840955 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeHasSufficientPID" Nov 04 04:45:49.841022 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.840996 4955 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:49.853410 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.853391 4955 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:45:49.897212 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.897189 4955 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 04:45:49.897305 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:49.897234 4955 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:49.897305 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.897251 4955 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:49.906590 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.906568 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1de2404c5cc3fbadf16c719910f8d787-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"1de2404c5cc3fbadf16c719910f8d787\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:49.906673 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.906601 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1de2404c5cc3fbadf16c719910f8d787-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"1de2404c5cc3fbadf16c719910f8d787\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:49.906673 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.906621 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c77202defc6f17821d20368d232c24c4-config\") pod \"kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"c77202defc6f17821d20368d232c24c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:49.952636 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.952615 4955 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:49.952716 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.952677 4955 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:49.953222 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.953209 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeNotReady" Nov 04 04:45:49.953257 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.953238 4955 setters.go:546] "Node became not ready" node="ip-10-0-132-197.us-west-2.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-11-04T04:45:49Z","lastTransitionTime":"2026-11-04T04:45:49Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"} Nov 04 04:45:49.957099 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.957081 4955 nodeinfomanager.go:471] existing CSINode "ip-10-0-132-197.us-west-2.compute.internal" is owned by different node (oldNodeID="a0504d99-adef-4c52-ae39-867eaadaf67f", newNodeID=""), cleaning up... Nov 04 04:45:49.970489 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:49.970448 4955 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 04:45:49.970489 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:49.970478 4955 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:50.006897 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.006876 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1de2404c5cc3fbadf16c719910f8d787-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"1de2404c5cc3fbadf16c719910f8d787\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:50.006971 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.006900 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1de2404c5cc3fbadf16c719910f8d787-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"1de2404c5cc3fbadf16c719910f8d787\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:50.006971 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.006916 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c77202defc6f17821d20368d232c24c4-config\") pod \"kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"c77202defc6f17821d20368d232c24c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:50.006971 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.006955 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c77202defc6f17821d20368d232c24c4-config\") pod \"kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"c77202defc6f17821d20368d232c24c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:50.007092 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.006976 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1de2404c5cc3fbadf16c719910f8d787-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"1de2404c5cc3fbadf16c719910f8d787\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:50.007092 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.006983 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1de2404c5cc3fbadf16c719910f8d787-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" (UID: \"1de2404c5cc3fbadf16c719910f8d787\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:50.600671 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.600646 4955 apiserver.go:52] "Watching apiserver" Nov 04 04:45:50.703278 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.703241 4955 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:50.703421 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.703369 4955 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:50.790965 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.790934 4955 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 04:45:50.791174 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:50.790992 4955 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:50.791174 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.790934 4955 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 04:45:50.791174 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:50.791070 4955 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal" Nov 04 04:45:50.791597 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.791582 4955 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 04:45:50.792183 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.792161 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-qkwm9","openshift-network-operator/iptables-alerter-8rtt2","kube-system/kas-connection-checker-685895c7c9-vc88q","kube-system/kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal","openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b","openshift-dns/node-resolver-vjj7q","openshift-multus/multus-additional-cni-plugins-j5j9g","openshift-image-registry/node-ca-f66bz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-197.us-west-2.compute.internal","openshift-insights/insights-operator-7c4986d449-crv79","openshift-insights/periodic-gathering-mp8tg-26z5w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4","kube-system/global-pull-secret-syncer-cnvdz","openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68","openshift-insights/insights-runtime-extractor-zwkrf","openshift-network-console/networking-console-plugin-86c478bb88-8959q","openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5","openshift-console-operator/console-operator-7cd56b8dbc-tqfqb","openshift-image-registry/image-registry-6c46895cdd-h2frf","kube-system/kas-connection-checker-685895c7c9-blxqr","openshift-ingress/router-default-5d56d655f9-pdqrc","openshift-service-ca/service-ca-5fffc97bdf-4ffpx","openshift-multus/network-metrics-daemon-d25j9","openshift-ovn-kubernetes/ovnkube-node-8mrwd","openshift-network-diagnostics/network-check-target-f7dtz","openshift-cluster-node-tuning-operator/tuned-rrnq6","openshift-dns/dns-default-ntz9h","openshift-image-registry/image-registry-867f9c6749-4gj2n","openshift-multus/multus-bmvjp","kube-system/kas-connection-checker-685895c7c9-trz8n","openshift-ingress-canary/ingress-canary-vqqr6"] Nov 04 04:45:50.793350 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.793329 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:50.794959 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.794942 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:50.795662 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.795643 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:50.796063 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.796043 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.796765 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.796746 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:50.797961 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.797944 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:50.799974 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.799957 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.803933 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.803913 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:50.808966 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.808945 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:50.814919 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.814903 4955 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 04:45:50.844397 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844376 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Nov 04 04:45:50.844499 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844409 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.844499 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844416 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Nov 04 04:45:50.844499 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844426 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Nov 04 04:45:50.844499 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844453 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.844499 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844482 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 04 04:45:50.844499 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844489 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844515 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844525 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844538 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844553 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844553 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844571 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844613 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844637 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844660 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844681 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844694 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844556 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844755 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844805 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844816 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.844852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844845 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.845680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.844905 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Nov 04 04:45:50.845680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.845075 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Nov 04 04:45:50.845680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.845079 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.845680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.845166 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Nov 04 04:45:50.845680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.845196 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.845680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.845231 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.845680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.845330 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Nov 04 04:45:50.845680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.845341 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Nov 04 04:45:50.845680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.845375 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.845680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.845479 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.845680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.845483 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Nov 04 04:45:50.887744 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.887674 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 04 04:45:50.891239 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891223 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 04 04:45:50.891239 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891231 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891428 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891461 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891465 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891504 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891548 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891569 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891587 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891588 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891608 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891638 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891647 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891678 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 04:45:50.891690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891687 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891729 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891749 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891766 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891783 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891807 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891814 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891824 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891842 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891863 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891866 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891877 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891889 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891892 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891918 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891925 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891928 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.891936 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.892210 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.892236 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.892244 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.892469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.892300 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 04:45:50.893364 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.892546 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 04:45:50.893364 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.893335 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 04 04:45:50.913255 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913231 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68796d82-fed3-494a-8239-32c07fa7c466-tmp\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:50.913348 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913277 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68796d82-fed3-494a-8239-32c07fa7c466-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:50.913348 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913307 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-sys\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.913348 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913330 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dca566d-9570-433f-bde3-f47b3c7d2895-tmp\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.913471 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913378 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68796d82-fed3-494a-8239-32c07fa7c466-tmp\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:50.913471 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913360 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk2nv\" (UniqueName: \"kubernetes.io/projected/d49dda15-d5d9-414e-b552-0d9bcab7bba0-kube-api-access-kk2nv\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:50.913590 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913573 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-system-cni-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.913625 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913594 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dca566d-9570-433f-bde3-f47b3c7d2895-tmp\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.913655 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913631 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-kubelet\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.913693 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913683 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-etc-kubernetes\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.913726 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913704 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-systemd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.913754 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913730 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.913783 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913764 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rzzt\" (UniqueName: \"kubernetes.io/projected/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-kube-api-access-2rzzt\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:50.913814 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913782 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c59zf\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-kube-api-access-c59zf\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.913814 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913797 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68796d82-fed3-494a-8239-32c07fa7c466-snapshots\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:50.913867 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.913813 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-trusted-ca\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.914158 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914137 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68796d82-fed3-494a-8239-32c07fa7c466-snapshots\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:50.914282 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914192 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-systemd\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.914355 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914296 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c04074e7-79db-4586-9c75-ec922314ba54-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:50.914407 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914354 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-signing-cabundle\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:50.914454 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914399 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:50.914454 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914444 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:50.914542 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914481 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.914542 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914512 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:50.914646 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914549 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-multus-certs\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.914646 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914591 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84g42\" (UniqueName: \"kubernetes.io/projected/9283e782-7152-4c67-8ce3-e07042df088b-kube-api-access-84g42\") pod \"volume-data-source-validator-58c9f5f46d-jqjsh\" (UID: \"9283e782-7152-4c67-8ce3-e07042df088b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh" Nov 04 04:45:50.914646 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914607 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68796d82-fed3-494a-8239-32c07fa7c466-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:50.914646 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914627 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:50.914829 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914660 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztj4f\" (UniqueName: \"kubernetes.io/projected/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-kube-api-access-ztj4f\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:50.914829 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914724 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c04074e7-79db-4586-9c75-ec922314ba54-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:50.914829 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914762 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-dbus\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:50.914966 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.914820 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-etc-selinux\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:50.915093 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915071 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-run-netns\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.915174 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915135 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:50.915174 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915169 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24e214b2-5e33-4022-8f14-edf1cb11f820-ca-trust-extracted\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.915322 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915200 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptvfj\" (UniqueName: \"kubernetes.io/projected/a9dc342a-1857-4691-a57b-d1672547d10c-kube-api-access-ptvfj\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:50.915394 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915365 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:50.915480 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915435 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-signing-cabundle\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:50.915550 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915517 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24e214b2-5e33-4022-8f14-edf1cb11f820-ca-trust-extracted\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.915625 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915561 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:50.915625 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915565 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-socket-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:50.915758 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915640 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj7qq\" (UniqueName: \"kubernetes.io/projected/6e75df29-4521-44fa-babe-a45b73155b91-kube-api-access-pj7qq\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:50.915758 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915700 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhwrd\" (UniqueName: \"kubernetes.io/projected/8272e327-372c-4b8c-9ca3-acf950c43690-kube-api-access-nhwrd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.915758 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915752 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-bound-sa-token\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.915953 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915795 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-netns\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.915953 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915828 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:50.915953 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915856 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-env-overrides\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.915953 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.915887 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm5s5\" (UniqueName: \"kubernetes.io/projected/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-kube-api-access-gm5s5\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:50.916229 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.916184 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-trusted-ca\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.916387 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.916245 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-env-overrides\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.916387 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.916246 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0921fa80-a280-4013-8c90-530a9f1e45e1-cni-binary-copy\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.916387 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.916316 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l58ck\" (UniqueName: \"kubernetes.io/projected/0921fa80-a280-4013-8c90-530a9f1e45e1-kube-api-access-l58ck\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.916606 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.916526 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0921fa80-a280-4013-8c90-530a9f1e45e1-cni-binary-copy\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.916680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.916615 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-cni-bin\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.916680 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.916642 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3751973e-ab65-4992-9b24-38a050b1324c-host\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:50.916803 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.916706 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3751973e-ab65-4992-9b24-38a050b1324c-serviceca\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:50.916803 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.916770 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vznm\" (UniqueName: \"kubernetes.io/projected/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-kube-api-access-6vznm\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:50.916936 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.916802 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d49dda15-d5d9-414e-b552-0d9bcab7bba0-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:50.917096 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917080 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cnibin\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:50.917178 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917125 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:50.917178 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917163 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6491499f-48db-4ee8-9cc1-b27029b2c033-config-volume\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:50.917425 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917409 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:50.917524 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917459 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-node-log\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.917524 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917502 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrsrc\" (UniqueName: \"kubernetes.io/projected/474ac538-e679-400a-89ee-db708dfcddda-kube-api-access-hrsrc\") pod \"network-check-source-6f78d59f99-r8sp5\" (UID: \"474ac538-e679-400a-89ee-db708dfcddda\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5" Nov 04 04:45:50.917646 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917538 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68796d82-fed3-494a-8239-32c07fa7c466-service-ca-bundle\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:50.917646 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917573 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:50.917646 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917602 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v27tp\" (UniqueName: \"kubernetes.io/projected/70407c80-19ed-467f-a4a4-8ff150518aef-kube-api-access-v27tp\") pod \"kas-connection-checker-685895c7c9-vc88q\" (UID: \"70407c80-19ed-467f-a4a4-8ff150518aef\") " pod="kube-system/kas-connection-checker-685895c7c9-vc88q" Nov 04 04:45:50.917842 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917722 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-etc-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.917842 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917760 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-stats-auth\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:50.917842 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917798 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:50.917842 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917835 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9dc342a-1857-4691-a57b-d1672547d10c-serving-cert\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:50.918084 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917862 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.918084 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917900 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e75df29-4521-44fa-babe-a45b73155b91-serving-cert\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:50.918084 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917931 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysctl-conf\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.918084 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.917964 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-hosts-file\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:50.918366 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918092 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-data-volume\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:50.918366 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918133 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-certificates\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.918366 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918167 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5xp4\" (UniqueName: \"kubernetes.io/projected/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-kube-api-access-k5xp4\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:50.918366 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918197 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-kubernetes\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.918366 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918230 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-cni-bin\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.918366 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918282 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xv8k\" (UniqueName: \"kubernetes.io/projected/6491499f-48db-4ee8-9cc1-b27029b2c033-kube-api-access-4xv8k\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:50.918366 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918317 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:50.918366 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918354 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-image-registry-private-configuration\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.918806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918390 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9wkm\" (UniqueName: \"kubernetes.io/projected/68796d82-fed3-494a-8239-32c07fa7c466-kube-api-access-p9wkm\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:50.918806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918427 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd26b2a0-3960-49b0-8d68-034665741c8a-agent-certs\") pod \"konnectivity-agent-qkwm9\" (UID: \"fd26b2a0-3960-49b0-8d68-034665741c8a\") " pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:50.918806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918455 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd26b2a0-3960-49b0-8d68-034665741c8a-konnectivity-ca\") pod \"konnectivity-agent-qkwm9\" (UID: \"fd26b2a0-3960-49b0-8d68-034665741c8a\") " pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:50.918806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918489 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-image-registry-private-configuration\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.918806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918523 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-installation-pull-secrets\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.918806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918570 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-device-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:50.918806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918599 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-cni-netd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.918806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918635 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-ovnkube-script-lib\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.918806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918757 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-default-certificate\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:50.918806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918763 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-data-volume\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918861 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-trusted-ca-bundle\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918908 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68796d82-fed3-494a-8239-32c07fa7c466-serving-cert\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918946 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysconfig\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.918973 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-k8s-cni-cncf-io\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919015 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5ccn\" (UniqueName: \"kubernetes.io/projected/c04074e7-79db-4586-9c75-ec922314ba54-kube-api-access-c5ccn\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919148 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-kubelet\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919149 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd26b2a0-3960-49b0-8d68-034665741c8a-konnectivity-ca\") pod \"konnectivity-agent-qkwm9\" (UID: \"fd26b2a0-3960-49b0-8d68-034665741c8a\") " pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919183 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-archives-path\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919200 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-ovnkube-script-lib\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919219 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7074b62a-f130-413b-ae9d-53b113f9f58c-ca-trust-extracted\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919235 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-image-registry-private-configuration\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919252 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-run\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919161 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-installation-pull-secrets\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919242 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-certificates\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.919502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919420 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-default-certificate\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919567 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-stats-auth\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919580 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d49dda15-d5d9-414e-b552-0d9bcab7bba0-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919588 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-archives-path\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919652 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3751973e-ab65-4992-9b24-38a050b1324c-serviceca\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919670 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-conf-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919687 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6491499f-48db-4ee8-9cc1-b27029b2c033-config-volume\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919704 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/953e8e8a-3671-4896-9b02-cb40af9e1978-host-slash\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919743 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919785 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e75df29-4521-44fa-babe-a45b73155b91-config\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919835 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68796d82-fed3-494a-8239-32c07fa7c466-serving-cert\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919852 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9dc342a-1857-4691-a57b-d1672547d10c-serving-cert\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919925 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-hostroot\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919956 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7074b62a-f130-413b-ae9d-53b113f9f58c-ca-trust-extracted\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919965 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g98wr\" (UniqueName: \"kubernetes.io/projected/953e8e8a-3671-4896-9b02-cb40af9e1978-kube-api-access-g98wr\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919974 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-trusted-ca-bundle\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.919983 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68796d82-fed3-494a-8239-32c07fa7c466-service-ca-bundle\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920007 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-image-registry-private-configuration\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920014 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-systemd-units\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920102 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-var-lib-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.920186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920138 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk5v2\" (UniqueName: \"kubernetes.io/projected/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-kube-api-access-sk5v2\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:50.920885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920211 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e75df29-4521-44fa-babe-a45b73155b91-config\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:50.920885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920223 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9dc342a-1857-4691-a57b-d1672547d10c-config\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:50.920885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920552 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-crio-socket\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:50.920885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920640 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e75df29-4521-44fa-babe-a45b73155b91-serving-cert\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:50.920885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920689 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-log-socket\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.920885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920733 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-var-lib-kubelet\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.920885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920752 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9dc342a-1857-4691-a57b-d1672547d10c-config\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:50.920885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920772 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6491499f-48db-4ee8-9cc1-b27029b2c033-tmp-dir\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:50.920885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920811 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34bc4578-ce85-4a2d-9f94-0305ae3267f2-cert\") pod \"ingress-canary-vqqr6\" (UID: \"34bc4578-ce85-4a2d-9f94-0305ae3267f2\") " pod="openshift-ingress-canary/ingress-canary-vqqr6" Nov 04 04:45:50.920885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920824 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6491499f-48db-4ee8-9cc1-b27029b2c033-tmp-dir\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:50.921329 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920901 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.921329 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920931 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxcd2\" (UniqueName: \"kubernetes.io/projected/0f55afb7-c026-4ad5-afe1-6c133692689e-kube-api-access-wxcd2\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:50.921329 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.920969 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:50.921329 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921071 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-service-ca-bundle\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:50.921329 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921090 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-host\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.921329 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921136 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-cni-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.921329 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921181 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c04074e7-79db-4586-9c75-ec922314ba54-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:50.921329 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921296 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxtdj\" (UniqueName: \"kubernetes.io/projected/0483be54-d5f5-4555-89c9-ef61cbee16ad-kube-api-access-hxtdj\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:50.921329 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921327 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-system-cni-dir\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:50.921641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921344 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m66bl\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-kube-api-access-m66bl\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.921641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921364 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-lib-modules\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.921641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921379 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:50.921641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921457 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzrs5\" (UniqueName: \"kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5\") pod \"network-check-target-f7dtz\" (UID: \"6febe6fa-de9b-47eb-a036-a63aea789894\") " pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:50.921641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921460 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c04074e7-79db-4586-9c75-ec922314ba54-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:50.921641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921480 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-trusted-ca\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.921641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921569 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-registration-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:50.921641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921586 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-slash\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.922019 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921687 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.922019 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921716 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-service-ca-bundle\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:50.922019 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921729 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8272e327-372c-4b8c-9ca3-acf950c43690-ovn-node-metrics-cert\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.922019 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921796 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:50.922019 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921824 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysctl-d\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.922019 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921864 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-trusted-ca\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.922019 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921873 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-daemon-config\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.922019 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921912 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-ovn\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.922019 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921941 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-installation-pull-secrets\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.922019 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.921997 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:50.922378 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922028 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-bound-sa-token\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.922378 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922091 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/953e8e8a-3671-4896-9b02-cb40af9e1978-iptables-alerter-script\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:50.922378 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922094 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-daemon-config\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.922378 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922144 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-installation-pull-secrets\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.922378 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922182 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j7m2\" (UniqueName: \"kubernetes.io/projected/34bc4578-ce85-4a2d-9f94-0305ae3267f2-kube-api-access-8j7m2\") pod \"ingress-canary-vqqr6\" (UID: \"34bc4578-ce85-4a2d-9f94-0305ae3267f2\") " pod="openshift-ingress-canary/ingress-canary-vqqr6" Nov 04 04:45:50.922378 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922292 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-ovnkube-config\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.922538 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922383 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-signing-key\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:50.922538 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922396 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/953e8e8a-3671-4896-9b02-cb40af9e1978-iptables-alerter-script\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:50.922538 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922402 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:50.922538 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922441 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-sys-fs\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:50.922538 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922468 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvsc\" (UniqueName: \"kubernetes.io/projected/3751973e-ab65-4992-9b24-38a050b1324c-kube-api-access-2cvsc\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:50.922538 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922523 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-tmp-dir\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:50.922727 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922583 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8272e327-372c-4b8c-9ca3-acf950c43690-ovnkube-config\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.922727 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922586 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-kubelet-config\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:50.922727 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922640 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-tmp-dir\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:50.922727 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922673 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgkkl\" (UniqueName: \"kubernetes.io/projected/8dca566d-9570-433f-bde3-f47b3c7d2895-kube-api-access-pgkkl\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.922727 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922702 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:50.922856 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922736 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:50.922856 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922756 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-certificates\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.922856 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922771 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qgh6\" (UniqueName: \"kubernetes.io/projected/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-api-access-2qgh6\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:50.922856 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922787 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-cnibin\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.922856 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922803 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-socket-dir-parent\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.922856 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922820 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:50.923012 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922866 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-modprobe-d\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.923012 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922898 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f45v\" (UniqueName: \"kubernetes.io/projected/d035486c-ba72-485c-88f9-0733ea426168-kube-api-access-6f45v\") pod \"kas-connection-checker-685895c7c9-trz8n\" (UID: \"d035486c-ba72-485c-88f9-0733ea426168\") " pod="kube-system/kas-connection-checker-685895c7c9-trz8n" Nov 04 04:45:50.923012 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922930 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbfnh\" (UniqueName: \"kubernetes.io/projected/e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1-kube-api-access-bbfnh\") pod \"kas-connection-checker-685895c7c9-blxqr\" (UID: \"e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1\") " pod="kube-system/kas-connection-checker-685895c7c9-blxqr" Nov 04 04:45:50.923012 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.922956 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-certificates\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.923012 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.923004 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e75df29-4521-44fa-babe-a45b73155b91-trusted-ca\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:50.923137 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.923101 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-tuned\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.923171 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.923143 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-cni-multus\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.923226 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.923211 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-tuned\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.923343 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.923324 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e75df29-4521-44fa-babe-a45b73155b91-trusted-ca\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:50.942879 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.942855 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 04:45:50.943048 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943031 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 04:45:50.943401 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943385 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 04:45:50.943465 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943424 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-rrdk2\"" Nov 04 04:45:50.943518 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943505 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kjpq6\"" Nov 04 04:45:50.943594 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943581 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ss4dp\"" Nov 04 04:45:50.943650 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943639 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 04:45:50.943691 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943666 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 04:45:50.943756 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943745 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Nov 04 04:45:50.943806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943772 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-4k9ql\"" Nov 04 04:45:50.943806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943781 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 04 04:45:50.943877 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943809 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Nov 04 04:45:50.943924 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943879 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nhf59\"" Nov 04 04:45:50.943924 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943878 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-45k46\"" Nov 04 04:45:50.943924 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943900 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m97m8\"" Nov 04 04:45:50.943924 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.943918 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l2xwd\"" Nov 04 04:45:50.944083 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944020 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7qqph\"" Nov 04 04:45:50.944083 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944039 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8xbd4\"" Nov 04 04:45:50.944083 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944068 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 04:45:50.944213 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944087 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-frtvg\"" Nov 04 04:45:50.944213 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944094 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jn85r\"" Nov 04 04:45:50.944213 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944102 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-hmct5\"" Nov 04 04:45:50.944213 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944103 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xq7xw\"" Nov 04 04:45:50.944213 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944128 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sfklt\"" Nov 04 04:45:50.944213 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944161 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-gwbb5\"" Nov 04 04:45:50.944213 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944169 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-984zn\"" Nov 04 04:45:50.944213 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944174 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 04:45:50.944445 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944225 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-77ccl\"" Nov 04 04:45:50.944445 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944309 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 04:45:50.944445 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.944366 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-95fm7\"" Nov 04 04:45:50.950153 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.950138 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd26b2a0-3960-49b0-8d68-034665741c8a-agent-certs\") pod \"konnectivity-agent-qkwm9\" (UID: \"fd26b2a0-3960-49b0-8d68-034665741c8a\") " pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:50.951281 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.951255 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34bc4578-ce85-4a2d-9f94-0305ae3267f2-cert\") pod \"ingress-canary-vqqr6\" (UID: \"34bc4578-ce85-4a2d-9f94-0305ae3267f2\") " pod="openshift-ingress-canary/ingress-canary-vqqr6" Nov 04 04:45:50.952361 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.952338 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8272e327-372c-4b8c-9ca3-acf950c43690-ovn-node-metrics-cert\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.953543 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.953529 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-signing-key\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:50.953543 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.953546 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-original-pull-secret\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:50.973424 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.973333 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptvfj\" (UniqueName: \"kubernetes.io/projected/a9dc342a-1857-4691-a57b-d1672547d10c-kube-api-access-ptvfj\") pod \"service-ca-operator-544d749c8c-wqb4b\" (UID: \"a9dc342a-1857-4691-a57b-d1672547d10c\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" Nov 04 04:45:50.973534 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.973447 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84g42\" (UniqueName: \"kubernetes.io/projected/9283e782-7152-4c67-8ce3-e07042df088b-kube-api-access-84g42\") pod \"volume-data-source-validator-58c9f5f46d-jqjsh\" (UID: \"9283e782-7152-4c67-8ce3-e07042df088b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jqjsh" Nov 04 04:45:50.973534 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.973520 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-bound-sa-token\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.973648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.973629 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vznm\" (UniqueName: \"kubernetes.io/projected/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-kube-api-access-6vznm\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:50.973648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.973638 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj7qq\" (UniqueName: \"kubernetes.io/projected/6e75df29-4521-44fa-babe-a45b73155b91-kube-api-access-pj7qq\") pod \"console-operator-7cd56b8dbc-tqfqb\" (UID: \"6e75df29-4521-44fa-babe-a45b73155b91\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:50.973814 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.973763 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rzzt\" (UniqueName: \"kubernetes.io/projected/7986ec05-d0d1-49ef-a8d5-2be22d20df8c-kube-api-access-2rzzt\") pod \"service-ca-5fffc97bdf-4ffpx\" (UID: \"7986ec05-d0d1-49ef-a8d5-2be22d20df8c\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4ffpx" Nov 04 04:45:50.973814 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.973778 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c59zf\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-kube-api-access-c59zf\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:50.973814 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.973795 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk2nv\" (UniqueName: \"kubernetes.io/projected/d49dda15-d5d9-414e-b552-0d9bcab7bba0-kube-api-access-kk2nv\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:50.974038 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.974019 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztj4f\" (UniqueName: \"kubernetes.io/projected/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-kube-api-access-ztj4f\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:50.974143 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.974121 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhwrd\" (UniqueName: \"kubernetes.io/projected/8272e327-372c-4b8c-9ca3-acf950c43690-kube-api-access-nhwrd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:50.974190 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.974177 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l58ck\" (UniqueName: \"kubernetes.io/projected/0921fa80-a280-4013-8c90-530a9f1e45e1-kube-api-access-l58ck\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:50.974370 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.974351 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm5s5\" (UniqueName: \"kubernetes.io/projected/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-kube-api-access-gm5s5\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:50.974583 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.974568 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrsrc\" (UniqueName: \"kubernetes.io/projected/474ac538-e679-400a-89ee-db708dfcddda-kube-api-access-hrsrc\") pod \"network-check-source-6f78d59f99-r8sp5\" (UID: \"474ac538-e679-400a-89ee-db708dfcddda\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-r8sp5" Nov 04 04:45:50.974627 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.974613 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v27tp\" (UniqueName: \"kubernetes.io/projected/70407c80-19ed-467f-a4a4-8ff150518aef-kube-api-access-v27tp\") pod \"kas-connection-checker-685895c7c9-vc88q\" (UID: \"70407c80-19ed-467f-a4a4-8ff150518aef\") " pod="kube-system/kas-connection-checker-685895c7c9-vc88q" Nov 04 04:45:50.975512 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.975482 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9wkm\" (UniqueName: \"kubernetes.io/projected/68796d82-fed3-494a-8239-32c07fa7c466-kube-api-access-p9wkm\") pod \"insights-operator-7c4986d449-crv79\" (UID: \"68796d82-fed3-494a-8239-32c07fa7c466\") " pod="openshift-insights/insights-operator-7c4986d449-crv79" Nov 04 04:45:50.975648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.975630 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5ccn\" (UniqueName: \"kubernetes.io/projected/c04074e7-79db-4586-9c75-ec922314ba54-kube-api-access-c5ccn\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-qbt68\" (UID: \"c04074e7-79db-4586-9c75-ec922314ba54\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" Nov 04 04:45:50.978856 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.978835 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xv8k\" (UniqueName: \"kubernetes.io/projected/6491499f-48db-4ee8-9cc1-b27029b2c033-kube-api-access-4xv8k\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:50.979184 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.979169 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g98wr\" (UniqueName: \"kubernetes.io/projected/953e8e8a-3671-4896-9b02-cb40af9e1978-kube-api-access-g98wr\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:50.979426 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.979407 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5xp4\" (UniqueName: \"kubernetes.io/projected/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-kube-api-access-k5xp4\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:50.979838 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.979820 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk5v2\" (UniqueName: \"kubernetes.io/projected/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-kube-api-access-sk5v2\") pod \"periodic-gathering-mp8tg-26z5w\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:45:50.980741 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.980723 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzrs5\" (UniqueName: \"kubernetes.io/projected/6febe6fa-de9b-47eb-a036-a63aea789894-kube-api-access-tzrs5\") pod \"network-check-target-f7dtz\" (UID: \"6febe6fa-de9b-47eb-a036-a63aea789894\") " pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:50.980843 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.980823 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxcd2\" (UniqueName: \"kubernetes.io/projected/0f55afb7-c026-4ad5-afe1-6c133692689e-kube-api-access-wxcd2\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:50.980892 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.980865 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-bound-sa-token\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.980984 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.980970 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j7m2\" (UniqueName: \"kubernetes.io/projected/34bc4578-ce85-4a2d-9f94-0305ae3267f2-kube-api-access-8j7m2\") pod \"ingress-canary-vqqr6\" (UID: \"34bc4578-ce85-4a2d-9f94-0305ae3267f2\") " pod="openshift-ingress-canary/ingress-canary-vqqr6" Nov 04 04:45:50.981560 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.981544 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cvsc\" (UniqueName: \"kubernetes.io/projected/3751973e-ab65-4992-9b24-38a050b1324c-kube-api-access-2cvsc\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:50.981820 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.981805 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m66bl\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-kube-api-access-m66bl\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:50.984457 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.984438 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgkkl\" (UniqueName: \"kubernetes.io/projected/8dca566d-9570-433f-bde3-f47b3c7d2895-kube-api-access-pgkkl\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:50.984538 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.984514 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qgh6\" (UniqueName: \"kubernetes.io/projected/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-api-access-2qgh6\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:50.984733 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.984715 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbfnh\" (UniqueName: \"kubernetes.io/projected/e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1-kube-api-access-bbfnh\") pod \"kas-connection-checker-685895c7c9-blxqr\" (UID: \"e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1\") " pod="kube-system/kas-connection-checker-685895c7c9-blxqr" Nov 04 04:45:50.984843 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.984828 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f45v\" (UniqueName: \"kubernetes.io/projected/d035486c-ba72-485c-88f9-0733ea426168-kube-api-access-6f45v\") pod \"kas-connection-checker-685895c7c9-trz8n\" (UID: \"d035486c-ba72-485c-88f9-0733ea426168\") " pod="kube-system/kas-connection-checker-685895c7c9-trz8n" Nov 04 04:45:50.985028 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:50.985014 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxtdj\" (UniqueName: \"kubernetes.io/projected/0483be54-d5f5-4555-89c9-ef61cbee16ad-kube-api-access-hxtdj\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:51.024481 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024457 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-dbus\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:51.024569 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024488 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-etc-selinux\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:51.024569 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024511 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-run-netns\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.024569 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024535 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:51.024718 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024580 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-run-netns\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.024718 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024582 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-etc-selinux\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:51.024718 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024604 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-socket-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:51.024718 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024633 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-netns\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.024718 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024644 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-socket-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:51.024718 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024648 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:51.024718 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024580 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-dbus\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:51.024718 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024680 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-cni-bin\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.024718 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024705 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3751973e-ab65-4992-9b24-38a050b1324c-host\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:51.024718 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024710 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-cni-bin\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024722 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-netns\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024731 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cnibin\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.024708 4955 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024746 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3751973e-ab65-4992-9b24-38a050b1324c-host\") pod \"node-ca-f66bz\" (UID: \"3751973e-ab65-4992-9b24-38a050b1324c\") " pod="openshift-image-registry/node-ca-f66bz" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024758 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-node-log\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024783 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-cnibin\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024783 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.024817 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls podName:6491499f-48db-4ee8-9cc1-b27029b2c033 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:51.524787907 +0000 UTC m=+1.994614048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls") pod "dns-default-ntz9h" (UID: "6491499f-48db-4ee8-9cc1-b27029b2c033") : secret "dns-default-metrics-tls" not found Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024822 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-node-log\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024829 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024845 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-etc-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024871 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024899 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024907 4955 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024919 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysctl-conf\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024923 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-etc-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024943 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-hosts-file\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.024973 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-kubernetes\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.025003 4955 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.025017 4955 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867f9c6749-4gj2n: secret "image-registry-tls" not found Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025024 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysctl-conf\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025043 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-cni-bin\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025049 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb2998cb-3584-4d30-8ff9-9e1ca5dc8950-hosts-file\") pod \"node-resolver-vjj7q\" (UID: \"fb2998cb-3584-4d30-8ff9-9e1ca5dc8950\") " pod="openshift-dns/node-resolver-vjj7q" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025065 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-kubernetes\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025093 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-cni-bin\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.025073 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls podName:7074b62a-f130-413b-ae9d-53b113f9f58c nodeName:}" failed. No retries permitted until 2026-11-04 04:45:51.525059331 +0000 UTC m=+1.994885463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls") pod "image-registry-867f9c6749-4gj2n" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c") : secret "image-registry-tls" not found Nov 04 04:45:51.025129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025124 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025152 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-device-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025173 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-cni-netd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.025192 4955 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025200 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysconfig\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025207 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-device-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025207 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-cni-netd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025222 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-k8s-cni-cncf-io\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025244 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-k8s-cni-cncf-io\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.025246 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls podName:d49dda15-d5d9-414e-b552-0d9bcab7bba0 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:51.525231419 +0000 UTC m=+1.995057535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fzt9v" (UID: "d49dda15-d5d9-414e-b552-0d9bcab7bba0") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025282 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysconfig\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025306 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-kubelet\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025325 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-run\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025339 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-conf-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025354 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/953e8e8a-3671-4896-9b02-cb40af9e1978-host-slash\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025374 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025398 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-hostroot\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025415 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-run\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025422 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-kubelet\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025455 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-conf-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025466 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-systemd-units\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025423 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-systemd-units\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025483 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025504 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-hostroot\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025545 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-var-lib-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025583 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/953e8e8a-3671-4896-9b02-cb40af9e1978-host-slash\") pod \"iptables-alerter-8rtt2\" (UID: \"953e8e8a-3671-4896-9b02-cb40af9e1978\") " pod="openshift-network-operator/iptables-alerter-8rtt2" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025591 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-var-lib-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025622 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-crio-socket\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025652 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-crio-socket\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025651 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-log-socket\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025680 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-var-lib-kubelet\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025688 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-log-socket\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025709 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025726 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-var-lib-kubelet\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025735 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-host\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025754 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-cni-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025762 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025773 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-system-cni-dir\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025789 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-lib-modules\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025803 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-host\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025810 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-registration-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025827 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-cni-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025834 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5331a9ab-3b27-4726-bf53-9ed1ac228c6c-system-cni-dir\") pod \"multus-additional-cni-plugins-j5j9g\" (UID: \"5331a9ab-3b27-4726-bf53-9ed1ac228c6c\") " pod="openshift-multus/multus-additional-cni-plugins-j5j9g" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025834 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-slash\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025871 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025881 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-slash\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025897 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysctl-d\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025921 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-openvswitch\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025939 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-ovn\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025891 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-registration-dir\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025966 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-sys-fs\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025990 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-kubelet-config\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.025996 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-ovn\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026011 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026024 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-lib-modules\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026032 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-sysctl-d\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026035 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026055 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66675bf0-7d80-414a-8ccc-a7e3718bbaaa-sys-fs\") pod \"aws-ebs-csi-driver-node-27tp4\" (UID: \"66675bf0-7d80-414a-8ccc-a7e3718bbaaa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-27tp4" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026087 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b-kubelet-config\") pod \"global-pull-secret-syncer-cnvdz\" (UID: \"ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b\") " pod="kube-system/global-pull-secret-syncer-cnvdz" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026143 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-cnibin\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026169 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-socket-dir-parent\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026204 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:51.026193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026214 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-cnibin\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026243 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-modprobe-d\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026289 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-multus-socket-dir-parent\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026329 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-cni-multus\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026291 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-cni-multus\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026366 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-sys\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026372 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-modprobe-d\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026396 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-system-cni-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026420 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-kubelet\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026424 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-sys\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026443 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-etc-kubernetes\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026474 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-systemd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026500 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026507 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-etc-kubernetes\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026531 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-systemd\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026544 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-var-lib-kubelet\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026473 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-system-cni-dir\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026557 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026590 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026616 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026631 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8dca566d-9570-433f-bde3-f47b3c7d2895-etc-systemd\") pod \"tuned-rrnq6\" (UID: \"8dca566d-9570-433f-bde3-f47b3c7d2895\") " pod="openshift-cluster-node-tuning-operator/tuned-rrnq6" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026644 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-multus-certs\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026668 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026713 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0921fa80-a280-4013-8c90-530a9f1e45e1-host-run-multus-certs\") pod \"multus-bmvjp\" (UID: \"0921fa80-a280-4013-8c90-530a9f1e45e1\") " pod="openshift-multus/multus-bmvjp" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026593 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8272e327-372c-4b8c-9ca3-acf950c43690-run-systemd\") pod \"ovnkube-node-8mrwd\" (UID: \"8272e327-372c-4b8c-9ca3-acf950c43690\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.026739 4955 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.026757 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.026785 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls podName:121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:51.526767326 +0000 UTC m=+1.996593481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwkrf" (UID: "121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1") : secret "insights-runtime-extractor-tls" not found Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.026796 4955 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.026808 4955 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46895cdd-h2frf: secret "image-registry-tls" not found Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.026844 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls podName:24e214b2-5e33-4022-8f14-edf1cb11f820 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:51.526831161 +0000 UTC m=+1.996657295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls") pod "image-registry-6c46895cdd-h2frf" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820") : secret "image-registry-tls" not found Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.027390 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f55afb7-c026-4ad5-afe1-6c133692689e-service-ca-bundle\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.027518 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0483be54-d5f5-4555-89c9-ef61cbee16ad-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-zzpt5\" (UID: \"0483be54-d5f5-4555-89c9-ef61cbee16ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.027989 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c8dfe4c5-4264-40e3-a284-69e2d64be1f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8959q\" (UID: \"c8dfe4c5-4264-40e3-a284-69e2d64be1f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:51.028422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.028431 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4cfdbb2-d02d-46a4-8d69-4d7418f8c639-metrics-certs\") pod \"network-metrics-daemon-d25j9\" (UID: \"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639\") " pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:51.029319 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.028545 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f55afb7-c026-4ad5-afe1-6c133692689e-metrics-certs\") pod \"router-default-5d56d655f9-pdqrc\" (UID: \"0f55afb7-c026-4ad5-afe1-6c133692689e\") " pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:51.096009 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.095989 4955 scope.go:122] "RemoveContainer" containerID="6e42effc280f254c979c893a004642bca2ab40c0fd64e589ba512f12038f705b" Nov 04 04:45:51.096089 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.096049 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" Nov 04 04:45:51.096152 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.096135 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:51.097000 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.096984 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" Nov 04 04:45:51.098368 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.098349 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d25j9" Nov 04 04:45:51.326982 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.326960 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:51.480787 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.480723 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5"] Nov 04 04:45:51.530949 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.530923 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-8959q"] Nov 04 04:45:51.532275 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.532239 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:51.532396 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.532282 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:51.532396 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.532307 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:51.532396 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.532379 4955 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:45:51.532521 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.532406 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:51.532521 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.532435 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls podName:121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:52.532420798 +0000 UTC m=+3.002246915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwkrf" (UID: "121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1") : secret "insights-runtime-extractor-tls" not found Nov 04 04:45:51.532521 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.532456 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:51.532775 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.532751 4955 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:51.532839 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.532778 4955 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867f9c6749-4gj2n: secret "image-registry-tls" not found Nov 04 04:45:51.532839 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.532786 4955 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:45:51.532839 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.532818 4955 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:51.532839 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.532831 4955 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46895cdd-h2frf: secret "image-registry-tls" not found Nov 04 04:45:51.533005 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.532843 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls podName:7074b62a-f130-413b-ae9d-53b113f9f58c nodeName:}" failed. No retries permitted until 2026-11-04 04:45:52.532816406 +0000 UTC m=+3.002642555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls") pod "image-registry-867f9c6749-4gj2n" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c") : secret "image-registry-tls" not found Nov 04 04:45:51.533005 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.532883 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls podName:6491499f-48db-4ee8-9cc1-b27029b2c033 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:52.532852685 +0000 UTC m=+3.002678837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls") pod "dns-default-ntz9h" (UID: "6491499f-48db-4ee8-9cc1-b27029b2c033") : secret "dns-default-metrics-tls" not found Nov 04 04:45:51.533005 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.532901 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls podName:24e214b2-5e33-4022-8f14-edf1cb11f820 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:52.532889908 +0000 UTC m=+3.002716042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls") pod "image-registry-6c46895cdd-h2frf" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820") : secret "image-registry-tls" not found Nov 04 04:45:51.533005 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.532924 4955 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:51.533188 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.533098 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls podName:d49dda15-d5d9-414e-b552-0d9bcab7bba0 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:52.533081755 +0000 UTC m=+3.002907887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fzt9v" (UID: "d49dda15-d5d9-414e-b552-0d9bcab7bba0") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:51.536151 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.536122 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d56d655f9-pdqrc"] Nov 04 04:45:51.564147 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.564133 4955 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 04:45:51.579080 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:51.579057 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8dfe4c5_4264_40e3_a284_69e2d64be1f5.slice/crio-bed01d78ea1c40f068a077e48c7dea2a0c81abb2249f0d9a93b2449e82f06ca4 WatchSource:0}: Error finding container bed01d78ea1c40f068a077e48c7dea2a0c81abb2249f0d9a93b2449e82f06ca4: Status 404 returned error can't find the container with id bed01d78ea1c40f068a077e48c7dea2a0c81abb2249f0d9a93b2449e82f06ca4 Nov 04 04:45:51.579925 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:51.579891 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f55afb7_c026_4ad5_afe1_6c133692689e.slice/crio-59d150b8dbf76f4e770c6598c1297b04b93e52df18f9fc405f112e5ce7159248 WatchSource:0}: Error finding container 59d150b8dbf76f4e770c6598c1297b04b93e52df18f9fc405f112e5ce7159248: Status 404 returned error can't find the container with id 59d150b8dbf76f4e770c6598c1297b04b93e52df18f9fc405f112e5ce7159248 Nov 04 04:45:51.581612 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.581590 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d25j9"] Nov 04 04:45:51.589323 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:51.589302 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4cfdbb2_d02d_46a4_8d69_4d7418f8c639.slice/crio-ea30eaaeaeccc8a18b3b0649afa8a0dc892a1abb109657f77737b8c83692fb2c WatchSource:0}: Error finding container ea30eaaeaeccc8a18b3b0649afa8a0dc892a1abb109657f77737b8c83692fb2c: Status 404 returned error can't find the container with id ea30eaaeaeccc8a18b3b0649afa8a0dc892a1abb109657f77737b8c83692fb2c Nov 04 04:45:51.708090 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.708063 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/2.log" Nov 04 04:45:51.708488 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.708464 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/1.log" Nov 04 04:45:51.708525 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.708493 4955 generic.go:356] "Generic (PLEG): container finished" podID="6e75df29-4521-44fa-babe-a45b73155b91" containerID="56b4b9141e852e0b7e0703a1839e83af98fdc6489bcf28b92080f09bb1518f22" exitCode=255 Nov 04 04:45:51.708588 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.708563 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" event={"ID":"6e75df29-4521-44fa-babe-a45b73155b91","Type":"ContainerDied","Data":"56b4b9141e852e0b7e0703a1839e83af98fdc6489bcf28b92080f09bb1518f22"} Nov 04 04:45:51.708641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.708625 4955 scope.go:122] "RemoveContainer" containerID="6e42effc280f254c979c893a004642bca2ab40c0fd64e589ba512f12038f705b" Nov 04 04:45:51.708815 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.708797 4955 scope.go:122] "RemoveContainer" containerID="56b4b9141e852e0b7e0703a1839e83af98fdc6489bcf28b92080f09bb1518f22" Nov 04 04:45:51.709005 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:51.708986 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-tqfqb_openshift-console-operator(6e75df29-4521-44fa-babe-a45b73155b91)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" podUID="6e75df29-4521-44fa-babe-a45b73155b91" Nov 04 04:45:51.709780 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.709761 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" event={"ID":"0483be54-d5f5-4555-89c9-ef61cbee16ad","Type":"ContainerStarted","Data":"4b649bd3be6e7982fc7ffec145a49691e9b49d202024b6cc657b2b60d53e3a41"} Nov 04 04:45:51.710841 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.710823 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d25j9" event={"ID":"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639","Type":"ContainerStarted","Data":"ea30eaaeaeccc8a18b3b0649afa8a0dc892a1abb109657f77737b8c83692fb2c"} Nov 04 04:45:51.711877 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.711860 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" event={"ID":"c8dfe4c5-4264-40e3-a284-69e2d64be1f5","Type":"ContainerStarted","Data":"bed01d78ea1c40f068a077e48c7dea2a0c81abb2249f0d9a93b2449e82f06ca4"} Nov 04 04:45:51.713435 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.713407 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d56d655f9-pdqrc" event={"ID":"0f55afb7-c026-4ad5-afe1-6c133692689e","Type":"ContainerStarted","Data":"45d0e54ca652149d27caa45d7c6d5e81e2ecbf6f462ff189c68b3b0f403df712"} Nov 04 04:45:51.713507 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:51.713450 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d56d655f9-pdqrc" event={"ID":"0f55afb7-c026-4ad5-afe1-6c133692689e","Type":"ContainerStarted","Data":"59d150b8dbf76f4e770c6598c1297b04b93e52df18f9fc405f112e5ce7159248"} Nov 04 04:45:52.096433 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:52.096403 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:52.098755 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:52.098734 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:52.542087 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:52.542057 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:52.542235 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:52.542096 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:52.542235 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:52.542182 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:52.542235 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.542209 4955 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:52.542235 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.542227 4955 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-867f9c6749-4gj2n: secret "image-registry-tls" not found Nov 04 04:45:52.542235 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:52.542227 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:52.542524 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.542240 4955 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:52.542524 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:52.542276 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:52.542524 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.542295 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls podName:7074b62a-f130-413b-ae9d-53b113f9f58c nodeName:}" failed. No retries permitted until 2026-11-04 04:45:54.542275771 +0000 UTC m=+5.012101908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls") pod "image-registry-867f9c6749-4gj2n" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c") : secret "image-registry-tls" not found Nov 04 04:45:52.542524 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.542320 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls podName:d49dda15-d5d9-414e-b552-0d9bcab7bba0 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:54.542308453 +0000 UTC m=+5.012134573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-fzt9v" (UID: "d49dda15-d5d9-414e-b552-0d9bcab7bba0") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:45:52.542524 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.542332 4955 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:45:52.542524 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.542363 4955 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:45:52.542524 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.542379 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls podName:121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:54.542367963 +0000 UTC m=+5.012194084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwkrf" (UID: "121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1") : secret "insights-runtime-extractor-tls" not found Nov 04 04:45:52.542524 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.542381 4955 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:45:52.542524 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.542399 4955 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46895cdd-h2frf: secret "image-registry-tls" not found Nov 04 04:45:52.542524 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.542401 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls podName:6491499f-48db-4ee8-9cc1-b27029b2c033 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:54.542390879 +0000 UTC m=+5.012216996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls") pod "dns-default-ntz9h" (UID: "6491499f-48db-4ee8-9cc1-b27029b2c033") : secret "dns-default-metrics-tls" not found Nov 04 04:45:52.542524 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.542458 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls podName:24e214b2-5e33-4022-8f14-edf1cb11f820 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:54.542444886 +0000 UTC m=+5.012271017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls") pod "image-registry-6c46895cdd-h2frf" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820") : secret "image-registry-tls" not found Nov 04 04:45:52.718726 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:52.718694 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/2.log" Nov 04 04:45:52.719129 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:52.719056 4955 scope.go:122] "RemoveContainer" containerID="56b4b9141e852e0b7e0703a1839e83af98fdc6489bcf28b92080f09bb1518f22" Nov 04 04:45:52.719290 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:52.719244 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-tqfqb_openshift-console-operator(6e75df29-4521-44fa-babe-a45b73155b91)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" podUID="6e75df29-4521-44fa-babe-a45b73155b91" Nov 04 04:45:53.721959 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:53.721936 4955 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 04:45:54.562481 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.562451 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:54.562614 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.562493 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:54.562614 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.562527 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:54.562614 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.562554 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:54.562614 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.562580 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:54.562808 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:54.562620 4955 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:45:54.562808 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:54.562665 4955 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:45:54.562808 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:54.562695 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls podName:121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:58.562672439 +0000 UTC m=+9.032498579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwkrf" (UID: "121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1") : secret "insights-runtime-extractor-tls" not found Nov 04 04:45:54.562808 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:54.562719 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls podName:6491499f-48db-4ee8-9cc1-b27029b2c033 nodeName:}" failed. No retries permitted until 2026-11-04 04:45:58.562703306 +0000 UTC m=+9.032529432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls") pod "dns-default-ntz9h" (UID: "6491499f-48db-4ee8-9cc1-b27029b2c033") : secret "dns-default-metrics-tls" not found Nov 04 04:45:54.565366 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.565343 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"image-registry-6c46895cdd-h2frf\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:54.565446 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.565389 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"image-registry-867f9c6749-4gj2n\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:54.565822 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.565796 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d49dda15-d5d9-414e-b552-0d9bcab7bba0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-fzt9v\" (UID: \"d49dda15-d5d9-414e-b552-0d9bcab7bba0\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:54.694721 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.694529 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" Nov 04 04:45:54.696689 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.696663 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:45:54.700832 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.700811 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:54.730979 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.730953 4955 generic.go:356] "Generic (PLEG): container finished" podID="68796d82-fed3-494a-8239-32c07fa7c466" containerID="8805e7ab11569c8f01b17808f59f19f949e2cfef18ed59a75afbf3274e2de7ca" exitCode=0 Nov 04 04:45:54.731439 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.730999 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-crv79" event={"ID":"68796d82-fed3-494a-8239-32c07fa7c466","Type":"ContainerDied","Data":"8805e7ab11569c8f01b17808f59f19f949e2cfef18ed59a75afbf3274e2de7ca"} Nov 04 04:45:54.731439 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.731410 4955 scope.go:122] "RemoveContainer" containerID="8805e7ab11569c8f01b17808f59f19f949e2cfef18ed59a75afbf3274e2de7ca" Nov 04 04:45:54.734225 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.734119 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d25j9" event={"ID":"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639","Type":"ContainerStarted","Data":"307647848f5b59efdca0a6fe2f7d898f7baa943de7c797373cd6abfbf694b041"} Nov 04 04:45:54.750383 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.749495 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-8959q" event={"ID":"c8dfe4c5-4264-40e3-a284-69e2d64be1f5","Type":"ContainerStarted","Data":"5765ea870738d2601d02b1eacf391a3462faaabce66247bf2b729c97d108465e"} Nov 04 04:45:54.869379 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:54.869347 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:55.144646 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.144612 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v"] Nov 04 04:45:55.153114 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:55.153082 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd49dda15_d5d9_414e_b552_0d9bcab7bba0.slice/crio-21c5e1ec37296b5ff6d5da348c4d66bc6608478e21209f003a18bdfde97b84ec WatchSource:0}: Error finding container 21c5e1ec37296b5ff6d5da348c4d66bc6608478e21209f003a18bdfde97b84ec: Status 404 returned error can't find the container with id 21c5e1ec37296b5ff6d5da348c4d66bc6608478e21209f003a18bdfde97b84ec Nov 04 04:45:55.193328 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.193305 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-867f9c6749-4gj2n"] Nov 04 04:45:55.208779 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:55.208756 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7074b62a_f130_413b_ae9d_53b113f9f58c.slice/crio-b340b7e5ae400362fc400e2ecbf00db7727122366b0c3faa8dc2296c32fd1672 WatchSource:0}: Error finding container b340b7e5ae400362fc400e2ecbf00db7727122366b0c3faa8dc2296c32fd1672: Status 404 returned error can't find the container with id b340b7e5ae400362fc400e2ecbf00db7727122366b0c3faa8dc2296c32fd1672 Nov 04 04:45:55.244456 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.244434 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c46895cdd-h2frf"] Nov 04 04:45:55.252923 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:55.252887 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e214b2_5e33_4022_8f14_edf1cb11f820.slice/crio-2137d54013d9ed6fa2f136f85679027b4ea361fcbb25403a306b40b8c43ca17e WatchSource:0}: Error finding container 2137d54013d9ed6fa2f136f85679027b4ea361fcbb25403a306b40b8c43ca17e: Status 404 returned error can't find the container with id 2137d54013d9ed6fa2f136f85679027b4ea361fcbb25403a306b40b8c43ca17e Nov 04 04:45:55.754678 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.754588 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" event={"ID":"0483be54-d5f5-4555-89c9-ef61cbee16ad","Type":"ContainerStarted","Data":"8cd424590d81decc37c9a632461661afc8e2b82e2f18509a3ca1ecd26f310739"} Nov 04 04:45:55.754678 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.754655 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-zzpt5" event={"ID":"0483be54-d5f5-4555-89c9-ef61cbee16ad","Type":"ContainerStarted","Data":"ef96f722558065e0d0626d30e6ed3dd9f90f8bf815c73c4e2fba8bbd8c06fc5d"} Nov 04 04:45:55.756138 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.756107 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" event={"ID":"7074b62a-f130-413b-ae9d-53b113f9f58c","Type":"ContainerStarted","Data":"bccfc00849f8d8611b41978835a4e573d2ed9069afa920e0eb79c722f1cb09e7"} Nov 04 04:45:55.756275 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.756160 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" event={"ID":"7074b62a-f130-413b-ae9d-53b113f9f58c","Type":"ContainerStarted","Data":"b340b7e5ae400362fc400e2ecbf00db7727122366b0c3faa8dc2296c32fd1672"} Nov 04 04:45:55.757920 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.757895 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d25j9" event={"ID":"e4cfdbb2-d02d-46a4-8d69-4d7418f8c639","Type":"ContainerStarted","Data":"e79825a8931a48e9f2b7a5817687414986ac5824e42d6663caffff4964c43374"} Nov 04 04:45:55.759532 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.759505 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" event={"ID":"24e214b2-5e33-4022-8f14-edf1cb11f820","Type":"ContainerStarted","Data":"7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093"} Nov 04 04:45:55.759640 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.759552 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" event={"ID":"24e214b2-5e33-4022-8f14-edf1cb11f820","Type":"ContainerStarted","Data":"2137d54013d9ed6fa2f136f85679027b4ea361fcbb25403a306b40b8c43ca17e"} Nov 04 04:45:55.759640 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.759590 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:45:55.761246 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.761224 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-crv79" event={"ID":"68796d82-fed3-494a-8239-32c07fa7c466","Type":"ContainerStarted","Data":"fef724430f25ce20453d14a3534522b8986d1ca6f0a3d2142b8556f2d9c766c9"} Nov 04 04:45:55.762319 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:55.762296 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" event={"ID":"d49dda15-d5d9-414e-b552-0d9bcab7bba0","Type":"ContainerStarted","Data":"21c5e1ec37296b5ff6d5da348c4d66bc6608478e21209f003a18bdfde97b84ec"} Nov 04 04:45:56.223251 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:56.223225 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qkwm9" Nov 04 04:45:56.767657 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:56.767619 4955 generic.go:356] "Generic (PLEG): container finished" podID="c04074e7-79db-4586-9c75-ec922314ba54" containerID="2a441bad9e11af3361353762e6e7876856489055cbf63225e876f6261f383b9e" exitCode=0 Nov 04 04:45:56.768124 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:56.767710 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" event={"ID":"c04074e7-79db-4586-9c75-ec922314ba54","Type":"ContainerDied","Data":"2a441bad9e11af3361353762e6e7876856489055cbf63225e876f6261f383b9e"} Nov 04 04:45:56.768124 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:56.767769 4955 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 04:45:56.768671 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:56.768655 4955 scope.go:122] "RemoveContainer" containerID="2a441bad9e11af3361353762e6e7876856489055cbf63225e876f6261f383b9e" Nov 04 04:45:57.409855 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:57.409817 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:57.410030 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:57.409964 4955 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 04:45:57.411079 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:57.411053 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d56d655f9-pdqrc" Nov 04 04:45:57.773377 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:57.773303 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-qbt68" event={"ID":"c04074e7-79db-4586-9c75-ec922314ba54","Type":"ContainerStarted","Data":"f21983170e105b6224b66c22b50319a9f94a0a84b73cff2b8c262fd2f7fdfeaa"} Nov 04 04:45:58.598336 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:58.598302 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:58.598336 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:58.598346 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:58.600810 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:58.600781 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwkrf\" (UID: \"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1\") " pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:58.600810 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:58.600799 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6491499f-48db-4ee8-9cc1-b27029b2c033-metrics-tls\") pod \"dns-default-ntz9h\" (UID: \"6491499f-48db-4ee8-9cc1-b27029b2c033\") " pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:58.604757 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:58.604733 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ntz9h" Nov 04 04:45:58.609838 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:58.609817 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zwkrf" Nov 04 04:45:58.929006 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:58.928917 4955 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qkwm9_fd26b2a0-3960-49b0-8d68-034665741c8a/konnectivity-agent/0.log" limit=1024 Nov 04 04:45:59.000704 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:59.000672 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ntz9h"] Nov 04 04:45:59.008855 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:59.008825 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6491499f_48db_4ee8_9cc1_b27029b2c033.slice/crio-31f952612a3230d466b4830dd7bdfac9dfb79beb7dfdf8e880772c6ab15e6171 WatchSource:0}: Error finding container 31f952612a3230d466b4830dd7bdfac9dfb79beb7dfdf8e880772c6ab15e6171: Status 404 returned error can't find the container with id 31f952612a3230d466b4830dd7bdfac9dfb79beb7dfdf8e880772c6ab15e6171 Nov 04 04:45:59.053161 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:59.053126 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zwkrf"] Nov 04 04:45:59.062431 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:45:59.062389 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod121a3fcd_9a18_44b7_ba8b_ffd5f1d16da1.slice/crio-3a2187b193e13e3844a61af56b796fa363f5303345bcfb22dd49e8abf1c756b7 WatchSource:0}: Error finding container 3a2187b193e13e3844a61af56b796fa363f5303345bcfb22dd49e8abf1c756b7: Status 404 returned error can't find the container with id 3a2187b193e13e3844a61af56b796fa363f5303345bcfb22dd49e8abf1c756b7 Nov 04 04:45:59.246827 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:59.246749 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:45:59.310796 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:59.310768 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:45:59.311004 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:59.310989 4955 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 04:45:59.744632 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:59.744599 4955 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:45:59.745031 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:59.745011 4955 scope.go:122] "RemoveContainer" containerID="56b4b9141e852e0b7e0703a1839e83af98fdc6489bcf28b92080f09bb1518f22" Nov 04 04:45:59.745300 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:45:59.745273 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-tqfqb_openshift-console-operator(6e75df29-4521-44fa-babe-a45b73155b91)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" podUID="6e75df29-4521-44fa-babe-a45b73155b91" Nov 04 04:45:59.782029 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:59.781949 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-fzt9v" event={"ID":"d49dda15-d5d9-414e-b552-0d9bcab7bba0","Type":"ContainerStarted","Data":"dbebd8b785b1e43e9d0ce834288f881f2aae2291d779debc33e12c6895ce78fa"} Nov 04 04:45:59.783478 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:59.783452 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwkrf" event={"ID":"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1","Type":"ContainerStarted","Data":"5312d2cc452912efce5f5459b1f64a12b40a15659d36138cebb0875f3192eed1"} Nov 04 04:45:59.783594 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:59.783503 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwkrf" event={"ID":"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1","Type":"ContainerStarted","Data":"3a2187b193e13e3844a61af56b796fa363f5303345bcfb22dd49e8abf1c756b7"} Nov 04 04:45:59.784518 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:45:59.784497 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntz9h" event={"ID":"6491499f-48db-4ee8-9cc1-b27029b2c033","Type":"ContainerStarted","Data":"31f952612a3230d466b4830dd7bdfac9dfb79beb7dfdf8e880772c6ab15e6171"} Nov 04 04:46:00.210282 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:00.210229 4955 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-132-197.us-west-2.compute.internal" event="NodeReady" Nov 04 04:46:01.327909 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:01.327868 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:46:01.328401 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:01.328373 4955 scope.go:122] "RemoveContainer" containerID="56b4b9141e852e0b7e0703a1839e83af98fdc6489bcf28b92080f09bb1518f22" Nov 04 04:46:01.793628 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:01.793545 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwkrf" event={"ID":"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1","Type":"ContainerStarted","Data":"15d3370f0f948eef0a49c463c409c789ed4e6d8209b41699e40847ce13d1dbaf"} Nov 04 04:46:01.795342 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:01.795323 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/2.log" Nov 04 04:46:01.795452 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:01.795416 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" event={"ID":"6e75df29-4521-44fa-babe-a45b73155b91","Type":"ContainerStarted","Data":"e18ca571cf658fabcd0d6f1e0b5511bcb6b19bddbdb26097f90c2feec778082e"} Nov 04 04:46:01.795704 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:01.795684 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:46:02.056549 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:02.056523 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-tqfqb" Nov 04 04:46:02.072741 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:02.072712 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:46:03.806064 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:03.806026 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntz9h" event={"ID":"6491499f-48db-4ee8-9cc1-b27029b2c033","Type":"ContainerStarted","Data":"ff608dc2853b0acd99c8fcba4fbff308044c60ce85f5ae44559839ef0fc68f40"} Nov 04 04:46:03.806549 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:03.806087 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ntz9h" event={"ID":"6491499f-48db-4ee8-9cc1-b27029b2c033","Type":"ContainerStarted","Data":"f5b8c2a20dda7eff8a05d1b6f330d821e42728568445f7fa32c9b26c71942052"} Nov 04 04:46:03.806549 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:03.806355 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ntz9h" Nov 04 04:46:04.737297 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.737209 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-c7n2n"] Nov 04 04:46:04.753963 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.753936 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-5mjzm"] Nov 04 04:46:04.754118 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.754045 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-c7n2n" Nov 04 04:46:04.768088 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.768064 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-5mjzm" Nov 04 04:46:04.783084 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.783062 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-lr776"] Nov 04 04:46:04.800876 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.800855 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-867f9c6749-4gj2n"] Nov 04 04:46:04.801013 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.800995 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-lr776" Nov 04 04:46:04.823834 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.823790 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwkrf" event={"ID":"121a3fcd-9a18-44b7-ba8b-ffd5f1d16da1","Type":"ContainerStarted","Data":"ba59cbcb9139e8f232b0b24d4fe2ab7460852fdb996ba34bbc21b38ba157d61f"} Nov 04 04:46:04.828558 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.828535 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 04 04:46:04.828675 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.828559 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 04 04:46:04.828675 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.828667 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lspnb\"" Nov 04 04:46:04.842364 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.842320 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-c7n2n"] Nov 04 04:46:04.843505 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.843467 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-5mjzm"] Nov 04 04:46:04.850205 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.848740 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m"] Nov 04 04:46:04.851746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.851715 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7ccn\" (UniqueName: \"kubernetes.io/projected/b2983639-80ca-48a7-aee8-4dd6a244468f-kube-api-access-c7ccn\") pod \"migrator-66df5d496b-5mjzm\" (UID: \"b2983639-80ca-48a7-aee8-4dd6a244468f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-5mjzm" Nov 04 04:46:04.851887 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.851860 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59dgp\" (UniqueName: \"kubernetes.io/projected/1b8e1ddb-06b3-4d9e-bacc-4e9db2a5b5c3-kube-api-access-59dgp\") pod \"migrator-66df5d496b-c7n2n\" (UID: \"1b8e1ddb-06b3-4d9e-bacc-4e9db2a5b5c3\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-c7n2n" Nov 04 04:46:04.851941 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.851909 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdfe3981-5581-4b32-a1f5-e82b88f99a86-tmp\") pod \"downloads-6dd789c8b7-lr776\" (UID: \"bdfe3981-5581-4b32-a1f5-e82b88f99a86\") " pod="openshift-console/downloads-6dd789c8b7-lr776" Nov 04 04:46:04.851985 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.851936 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj5d6\" (UniqueName: \"kubernetes.io/projected/bdfe3981-5581-4b32-a1f5-e82b88f99a86-kube-api-access-fj5d6\") pod \"downloads-6dd789c8b7-lr776\" (UID: \"bdfe3981-5581-4b32-a1f5-e82b88f99a86\") " pod="openshift-console/downloads-6dd789c8b7-lr776" Nov 04 04:46:04.857383 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.857365 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 04 04:46:04.857466 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.857391 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 04 04:46:04.860400 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.860382 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7648764544-b9s89"] Nov 04 04:46:04.860515 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.860499 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m" Nov 04 04:46:04.872482 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.872464 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:04.881088 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.881065 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-lr776"] Nov 04 04:46:04.902740 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.902721 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-8zbkb\"" Nov 04 04:46:04.916739 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.916674 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m"] Nov 04 04:46:04.930448 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.930417 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7648764544-b9s89"] Nov 04 04:46:04.952452 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.952422 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea944676-510e-4b4a-bc2a-506f3aff196e-installation-pull-secrets\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:04.952570 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.952465 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea944676-510e-4b4a-bc2a-506f3aff196e-registry-tls\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:04.952570 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.952487 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea944676-510e-4b4a-bc2a-506f3aff196e-bound-sa-token\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:04.952570 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.952511 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea944676-510e-4b4a-bc2a-506f3aff196e-ca-trust-extracted\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:04.952685 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.952576 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59dgp\" (UniqueName: \"kubernetes.io/projected/1b8e1ddb-06b3-4d9e-bacc-4e9db2a5b5c3-kube-api-access-59dgp\") pod \"migrator-66df5d496b-c7n2n\" (UID: \"1b8e1ddb-06b3-4d9e-bacc-4e9db2a5b5c3\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-c7n2n" Nov 04 04:46:04.952685 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.952668 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea944676-510e-4b4a-bc2a-506f3aff196e-image-registry-private-configuration\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:04.952796 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.952711 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdfe3981-5581-4b32-a1f5-e82b88f99a86-tmp\") pod \"downloads-6dd789c8b7-lr776\" (UID: \"bdfe3981-5581-4b32-a1f5-e82b88f99a86\") " pod="openshift-console/downloads-6dd789c8b7-lr776" Nov 04 04:46:04.952846 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.952824 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj5d6\" (UniqueName: \"kubernetes.io/projected/bdfe3981-5581-4b32-a1f5-e82b88f99a86-kube-api-access-fj5d6\") pod \"downloads-6dd789c8b7-lr776\" (UID: \"bdfe3981-5581-4b32-a1f5-e82b88f99a86\") " pod="openshift-console/downloads-6dd789c8b7-lr776" Nov 04 04:46:04.952898 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.952854 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea944676-510e-4b4a-bc2a-506f3aff196e-trusted-ca\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:04.952944 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.952890 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkltd\" (UniqueName: \"kubernetes.io/projected/ea944676-510e-4b4a-bc2a-506f3aff196e-kube-api-access-pkltd\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:04.953000 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.952946 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7ccn\" (UniqueName: \"kubernetes.io/projected/b2983639-80ca-48a7-aee8-4dd6a244468f-kube-api-access-c7ccn\") pod \"migrator-66df5d496b-5mjzm\" (UID: \"b2983639-80ca-48a7-aee8-4dd6a244468f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-5mjzm" Nov 04 04:46:04.953000 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.952973 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea944676-510e-4b4a-bc2a-506f3aff196e-registry-certificates\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:04.953105 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.953069 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/11f7f6b8-7884-4f43-ae05-eb294e4d3283-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-jm58m\" (UID: \"11f7f6b8-7884-4f43-ae05-eb294e4d3283\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m" Nov 04 04:46:04.953533 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:04.953513 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdfe3981-5581-4b32-a1f5-e82b88f99a86-tmp\") pod \"downloads-6dd789c8b7-lr776\" (UID: \"bdfe3981-5581-4b32-a1f5-e82b88f99a86\") " pod="openshift-console/downloads-6dd789c8b7-lr776" Nov 04 04:46:05.003092 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.003031 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Nov 04 04:46:05.003092 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.003045 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n5kb5\"" Nov 04 04:46:05.009384 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.009367 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7ccn\" (UniqueName: \"kubernetes.io/projected/b2983639-80ca-48a7-aee8-4dd6a244468f-kube-api-access-c7ccn\") pod \"migrator-66df5d496b-5mjzm\" (UID: \"b2983639-80ca-48a7-aee8-4dd6a244468f\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-5mjzm" Nov 04 04:46:05.009618 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.009600 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59dgp\" (UniqueName: \"kubernetes.io/projected/1b8e1ddb-06b3-4d9e-bacc-4e9db2a5b5c3-kube-api-access-59dgp\") pod \"migrator-66df5d496b-c7n2n\" (UID: \"1b8e1ddb-06b3-4d9e-bacc-4e9db2a5b5c3\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-c7n2n" Nov 04 04:46:05.009654 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.009635 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj5d6\" (UniqueName: \"kubernetes.io/projected/bdfe3981-5581-4b32-a1f5-e82b88f99a86-kube-api-access-fj5d6\") pod \"downloads-6dd789c8b7-lr776\" (UID: \"bdfe3981-5581-4b32-a1f5-e82b88f99a86\") " pod="openshift-console/downloads-6dd789c8b7-lr776" Nov 04 04:46:05.053978 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.053954 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea944676-510e-4b4a-bc2a-506f3aff196e-trusted-ca\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.054073 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.053982 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkltd\" (UniqueName: \"kubernetes.io/projected/ea944676-510e-4b4a-bc2a-506f3aff196e-kube-api-access-pkltd\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.054073 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.054003 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea944676-510e-4b4a-bc2a-506f3aff196e-registry-certificates\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.054073 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.054045 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/11f7f6b8-7884-4f43-ae05-eb294e4d3283-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-jm58m\" (UID: \"11f7f6b8-7884-4f43-ae05-eb294e4d3283\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m" Nov 04 04:46:05.054202 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.054081 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea944676-510e-4b4a-bc2a-506f3aff196e-installation-pull-secrets\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.054202 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.054121 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea944676-510e-4b4a-bc2a-506f3aff196e-registry-tls\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.054354 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.054330 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea944676-510e-4b4a-bc2a-506f3aff196e-bound-sa-token\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.054436 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.054388 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea944676-510e-4b4a-bc2a-506f3aff196e-ca-trust-extracted\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.054495 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.054461 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea944676-510e-4b4a-bc2a-506f3aff196e-image-registry-private-configuration\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.054912 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.054879 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea944676-510e-4b4a-bc2a-506f3aff196e-ca-trust-extracted\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.055004 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.054965 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea944676-510e-4b4a-bc2a-506f3aff196e-registry-certificates\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.055280 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.055235 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea944676-510e-4b4a-bc2a-506f3aff196e-trusted-ca\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.056633 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.056589 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea944676-510e-4b4a-bc2a-506f3aff196e-installation-pull-secrets\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.056633 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.056627 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea944676-510e-4b4a-bc2a-506f3aff196e-registry-tls\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.056981 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.056961 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/11f7f6b8-7884-4f43-ae05-eb294e4d3283-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-jm58m\" (UID: \"11f7f6b8-7884-4f43-ae05-eb294e4d3283\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m" Nov 04 04:46:05.057101 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.057083 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea944676-510e-4b4a-bc2a-506f3aff196e-image-registry-private-configuration\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.076951 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.076931 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-c7n2n" Nov 04 04:46:05.093948 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.093925 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-5mjzm" Nov 04 04:46:05.114224 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.113700 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea944676-510e-4b4a-bc2a-506f3aff196e-bound-sa-token\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.114224 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.114182 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkltd\" (UniqueName: \"kubernetes.io/projected/ea944676-510e-4b4a-bc2a-506f3aff196e-kube-api-access-pkltd\") pod \"image-registry-7648764544-b9s89\" (UID: \"ea944676-510e-4b4a-bc2a-506f3aff196e\") " pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.123955 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.123926 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-lr776" Nov 04 04:46:05.181778 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.181753 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m" Nov 04 04:46:05.195291 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.195150 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.468520 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.468472 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-c7n2n"] Nov 04 04:46:05.475745 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:46:05.475714 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8e1ddb_06b3_4d9e_bacc_4e9db2a5b5c3.slice/crio-c5d91719f217f55c6ea7d71fb5184f3dd392bad57f8ec8761771bf1bfbf9880d WatchSource:0}: Error finding container c5d91719f217f55c6ea7d71fb5184f3dd392bad57f8ec8761771bf1bfbf9880d: Status 404 returned error can't find the container with id c5d91719f217f55c6ea7d71fb5184f3dd392bad57f8ec8761771bf1bfbf9880d Nov 04 04:46:05.528410 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.528348 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-lr776"] Nov 04 04:46:05.536331 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:46:05.536309 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdfe3981_5581_4b32_a1f5_e82b88f99a86.slice/crio-e543208d878c6247db32cab922511b937a188e89e34d5161b8f67837d8677f5a WatchSource:0}: Error finding container e543208d878c6247db32cab922511b937a188e89e34d5161b8f67837d8677f5a: Status 404 returned error can't find the container with id e543208d878c6247db32cab922511b937a188e89e34d5161b8f67837d8677f5a Nov 04 04:46:05.582352 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.582333 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m"] Nov 04 04:46:05.590014 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:46:05.589990 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f7f6b8_7884_4f43_ae05_eb294e4d3283.slice/crio-5ecb4d14d4402bbc7cc2b28ae48bc61c8f2307c0775305e8a95b74083cc1a91e WatchSource:0}: Error finding container 5ecb4d14d4402bbc7cc2b28ae48bc61c8f2307c0775305e8a95b74083cc1a91e: Status 404 returned error can't find the container with id 5ecb4d14d4402bbc7cc2b28ae48bc61c8f2307c0775305e8a95b74083cc1a91e Nov 04 04:46:05.607526 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.607502 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7648764544-b9s89"] Nov 04 04:46:05.615080 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:46:05.615057 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea944676_510e_4b4a_bc2a_506f3aff196e.slice/crio-715d0e7a2431850a2bc952fec268af06a7f9109c0167870e237a032f220e7fdb WatchSource:0}: Error finding container 715d0e7a2431850a2bc952fec268af06a7f9109c0167870e237a032f220e7fdb: Status 404 returned error can't find the container with id 715d0e7a2431850a2bc952fec268af06a7f9109c0167870e237a032f220e7fdb Nov 04 04:46:05.641251 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.641230 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-5mjzm"] Nov 04 04:46:05.649255 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:46:05.649228 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2983639_80ca_48a7_aee8_4dd6a244468f.slice/crio-f2b17aa11bcd8a11adb9ac925139032c0feb4881e166b2159caa90e111217475 WatchSource:0}: Error finding container f2b17aa11bcd8a11adb9ac925139032c0feb4881e166b2159caa90e111217475: Status 404 returned error can't find the container with id f2b17aa11bcd8a11adb9ac925139032c0feb4881e166b2159caa90e111217475 Nov 04 04:46:05.829603 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.829571 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m" event={"ID":"11f7f6b8-7884-4f43-ae05-eb294e4d3283","Type":"ContainerStarted","Data":"5ecb4d14d4402bbc7cc2b28ae48bc61c8f2307c0775305e8a95b74083cc1a91e"} Nov 04 04:46:05.831206 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.831175 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7648764544-b9s89" event={"ID":"ea944676-510e-4b4a-bc2a-506f3aff196e","Type":"ContainerStarted","Data":"c5d52aa295cb79c2c8d1067a3f004993498695ef25a97c8147f83ff0c68baa64"} Nov 04 04:46:05.831376 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.831218 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7648764544-b9s89" event={"ID":"ea944676-510e-4b4a-bc2a-506f3aff196e","Type":"ContainerStarted","Data":"715d0e7a2431850a2bc952fec268af06a7f9109c0167870e237a032f220e7fdb"} Nov 04 04:46:05.831376 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.831248 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:05.832444 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.832419 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-5mjzm" event={"ID":"b2983639-80ca-48a7-aee8-4dd6a244468f","Type":"ContainerStarted","Data":"f2b17aa11bcd8a11adb9ac925139032c0feb4881e166b2159caa90e111217475"} Nov 04 04:46:05.833589 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.833557 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-lr776" event={"ID":"bdfe3981-5581-4b32-a1f5-e82b88f99a86","Type":"ContainerStarted","Data":"e543208d878c6247db32cab922511b937a188e89e34d5161b8f67837d8677f5a"} Nov 04 04:46:05.834718 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.834689 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-c7n2n" event={"ID":"1b8e1ddb-06b3-4d9e-bacc-4e9db2a5b5c3","Type":"ContainerStarted","Data":"c5d91719f217f55c6ea7d71fb5184f3dd392bad57f8ec8761771bf1bfbf9880d"} Nov 04 04:46:05.944417 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:05.944347 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7648764544-b9s89" podStartSLOduration=1.944331389 podStartE2EDuration="1.944331389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:46:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:05.942997841 +0000 UTC m=+16.412823991" watchObservedRunningTime="2026-11-04 04:46:05.944331389 +0000 UTC m=+16.414157529" Nov 04 04:46:06.327373 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:06.327342 4955 patch_prober.go:29] interesting pod/image-registry-6c46895cdd-h2frf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Nov 04 04:46:06.327531 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:06.327391 4955 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" podUID="24e214b2-5e33-4022-8f14-edf1cb11f820" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 04:46:08.852840 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:08.852402 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-5mjzm" event={"ID":"b2983639-80ca-48a7-aee8-4dd6a244468f","Type":"ContainerStarted","Data":"a3ab6f155886ab4b54fd8fb0b425d07d2dcf80b6a2566d64024ac3a099ddabf4"} Nov 04 04:46:08.854070 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:08.854039 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-c7n2n" event={"ID":"1b8e1ddb-06b3-4d9e-bacc-4e9db2a5b5c3","Type":"ContainerStarted","Data":"90034b8d6f58c2211e520fc955f87453109b6e96383eba2fa67cf6ef88de423b"} Nov 04 04:46:08.855433 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:08.855412 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m" event={"ID":"11f7f6b8-7884-4f43-ae05-eb294e4d3283","Type":"ContainerStarted","Data":"a68ec6b52c88f12d4b4a11fc7c44e9036105f47ea462df272da0a2cbd6d5ac91"} Nov 04 04:46:08.855506 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:08.855454 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m" Nov 04 04:46:08.860097 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:08.860079 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m" Nov 04 04:46:08.959771 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:08.959727 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-5mjzm" podStartSLOduration=2.447324615 podStartE2EDuration="4.959715334s" totalImagesPullingTime="2.512390719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:08.959490162 +0000 UTC m=+19.429316301" watchObservedRunningTime="2026-11-04 04:46:08.959715334 +0000 UTC m=+19.429541473" Nov 04 04:46:09.067410 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:09.067361 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-c7n2n" podStartSLOduration=2.56090265 podStartE2EDuration="5.067349755s" totalImagesPullingTime="2.506447105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:09.066908434 +0000 UTC m=+19.536734574" watchObservedRunningTime="2026-11-04 04:46:09.067349755 +0000 UTC m=+19.537175928" Nov 04 04:46:09.179124 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:09.179039 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-jm58m" podStartSLOduration=2.507206856 podStartE2EDuration="5.179024613s" totalImagesPullingTime="2.671817757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:09.178346285 +0000 UTC m=+19.648172427" watchObservedRunningTime="2026-11-04 04:46:09.179024613 +0000 UTC m=+19.648850749" Nov 04 04:46:13.826782 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:13.826750 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ntz9h" Nov 04 04:46:14.807466 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:14.807433 4955 patch_prober.go:29] interesting pod/image-registry-867f9c6749-4gj2n container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Nov 04 04:46:14.807627 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:14.807477 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" podUID="7074b62a-f130-413b-ae9d-53b113f9f58c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 04:46:16.772703 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:16.772674 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:46:18.659072 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.659019 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dqksz"] Nov 04 04:46:18.664969 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.664533 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.759803 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.759772 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 04 04:46:18.759803 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.759794 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mjbxn\"" Nov 04 04:46:18.760011 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.759838 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 04 04:46:18.760011 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.759847 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 04 04:46:18.760011 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.759913 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 04 04:46:18.774571 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.774544 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-wtmp\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.774693 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.774604 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.774752 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.774730 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7258d89b-22db-4890-9f48-dd1d80020143-root\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.774795 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.774782 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-tls\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.774829 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.774805 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-textfile\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.774915 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.774896 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7258d89b-22db-4890-9f48-dd1d80020143-metrics-client-ca\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.774949 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.774937 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7258d89b-22db-4890-9f48-dd1d80020143-sys\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.774983 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.774973 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-accelerators-collector-config\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.775016 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.774999 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rslws\" (UniqueName: \"kubernetes.io/projected/7258d89b-22db-4890-9f48-dd1d80020143-kube-api-access-rslws\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.875746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.875717 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7258d89b-22db-4890-9f48-dd1d80020143-metrics-client-ca\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.875921 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.875756 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7258d89b-22db-4890-9f48-dd1d80020143-sys\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.875921 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.875780 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-accelerators-collector-config\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.875921 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.875800 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rslws\" (UniqueName: \"kubernetes.io/projected/7258d89b-22db-4890-9f48-dd1d80020143-kube-api-access-rslws\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.875921 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.875819 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-wtmp\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.875921 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.875857 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.875921 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.875893 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7258d89b-22db-4890-9f48-dd1d80020143-root\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.875921 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.875922 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-tls\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.876162 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.875945 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-textfile\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.876251 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.876224 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-textfile\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.876670 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.876655 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7258d89b-22db-4890-9f48-dd1d80020143-metrics-client-ca\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.876718 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.876706 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7258d89b-22db-4890-9f48-dd1d80020143-sys\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.877002 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.876988 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-accelerators-collector-config\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.877313 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.877299 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-wtmp\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.877610 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.877586 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7258d89b-22db-4890-9f48-dd1d80020143-root\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.879709 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.879688 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.881395 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.881373 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7258d89b-22db-4890-9f48-dd1d80020143-node-exporter-tls\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.935070 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.934984 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rslws\" (UniqueName: \"kubernetes.io/projected/7258d89b-22db-4890-9f48-dd1d80020143-kube-api-access-rslws\") pod \"node-exporter-dqksz\" (UID: \"7258d89b-22db-4890-9f48-dd1d80020143\") " pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:18.984540 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:18.984515 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dqksz" Nov 04 04:46:19.019298 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:46:19.019249 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7258d89b_22db_4890_9f48_dd1d80020143.slice/crio-74420090b3712aa49324264d51e22361dfd1b17eec2824b689a1737b5c2db59b WatchSource:0}: Error finding container 74420090b3712aa49324264d51e22361dfd1b17eec2824b689a1737b5c2db59b: Status 404 returned error can't find the container with id 74420090b3712aa49324264d51e22361dfd1b17eec2824b689a1737b5c2db59b Nov 04 04:46:19.249368 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:19.249302 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f7dtz" Nov 04 04:46:19.903749 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:19.903703 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dqksz" event={"ID":"7258d89b-22db-4890-9f48-dd1d80020143","Type":"ContainerStarted","Data":"74420090b3712aa49324264d51e22361dfd1b17eec2824b689a1737b5c2db59b"} Nov 04 04:46:20.259403 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:20.259325 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mrwd" Nov 04 04:46:22.920544 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:22.920502 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dqksz" event={"ID":"7258d89b-22db-4890-9f48-dd1d80020143","Type":"ContainerStarted","Data":"3e43bc736dc23d36b0c75e39eadbebe992f8e9b88aa72b62500dbb1baed550c9"} Nov 04 04:46:23.925637 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:23.925598 4955 generic.go:356] "Generic (PLEG): container finished" podID="7258d89b-22db-4890-9f48-dd1d80020143" containerID="3e43bc736dc23d36b0c75e39eadbebe992f8e9b88aa72b62500dbb1baed550c9" exitCode=0 Nov 04 04:46:23.926009 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:23.925682 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dqksz" event={"ID":"7258d89b-22db-4890-9f48-dd1d80020143","Type":"ContainerDied","Data":"3e43bc736dc23d36b0c75e39eadbebe992f8e9b88aa72b62500dbb1baed550c9"} Nov 04 04:46:24.806047 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:24.806020 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:46:24.933136 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:24.933100 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dqksz" event={"ID":"7258d89b-22db-4890-9f48-dd1d80020143","Type":"ContainerStarted","Data":"65a513fc96083fa221a110582677c75108e3b75b6367aa5d81431c68a1d64fa9"} Nov 04 04:46:24.933518 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:24.933152 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dqksz" event={"ID":"7258d89b-22db-4890-9f48-dd1d80020143","Type":"ContainerStarted","Data":"2569e63d381048ee00cad69b0da35f2375bf1ec92aedb75f8f33d4e44e96e455"} Nov 04 04:46:25.045168 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:25.045111 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dqksz" podStartSLOduration=3.232790876 podStartE2EDuration="7.045097927s" totalImagesPullingTime="3.734570705s" totalInitContainerRuntime="77.736346ms" isStatefulPod=true podCreationTimestamp="2026-11-04 04:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:25.044279547 +0000 UTC m=+35.514105676" watchObservedRunningTime="2026-11-04 04:46:25.045097927 +0000 UTC m=+35.514924087" Nov 04 04:46:26.844737 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:26.844710 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7648764544-b9s89" Nov 04 04:46:27.088693 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:27.088658 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c46895cdd-h2frf"] Nov 04 04:46:28.189693 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:46:28.189646 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:46:29.823028 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:29.822932 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" podUID="7074b62a-f130-413b-ae9d-53b113f9f58c" containerName="registry" containerID="cri-o://bccfc00849f8d8611b41978835a4e573d2ed9069afa920e0eb79c722f1cb09e7" gracePeriod=30 Nov 04 04:46:29.962460 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:29.962424 4955 generic.go:356] "Generic (PLEG): container finished" podID="7074b62a-f130-413b-ae9d-53b113f9f58c" containerID="bccfc00849f8d8611b41978835a4e573d2ed9069afa920e0eb79c722f1cb09e7" exitCode=0 Nov 04 04:46:29.962674 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:29.962503 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" event={"ID":"7074b62a-f130-413b-ae9d-53b113f9f58c","Type":"ContainerDied","Data":"bccfc00849f8d8611b41978835a4e573d2ed9069afa920e0eb79c722f1cb09e7"} Nov 04 04:46:30.091097 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.091041 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:46:30.282221 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.282192 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-kube-api-access-m66bl\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-kube-api-access-m66bl\") pod \"7074b62a-f130-413b-ae9d-53b113f9f58c\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " Nov 04 04:46:30.282519 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.282233 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") pod \"7074b62a-f130-413b-ae9d-53b113f9f58c\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " Nov 04 04:46:30.282519 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.282302 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-certificates\") pod \"7074b62a-f130-413b-ae9d-53b113f9f58c\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " Nov 04 04:46:30.282685 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.282657 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-trusted-ca\") pod \"7074b62a-f130-413b-ae9d-53b113f9f58c\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " Nov 04 04:46:30.282742 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.282714 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-certificates" pod "7074b62a-f130-413b-ae9d-53b113f9f58c" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:46:30.282802 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.282735 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7074b62a-f130-413b-ae9d-53b113f9f58c-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7074b62a-f130-413b-ae9d-53b113f9f58c-ca-trust-extracted\") pod \"7074b62a-f130-413b-ae9d-53b113f9f58c\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " Nov 04 04:46:30.282861 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.282799 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-image-registry-private-configuration\") pod \"7074b62a-f130-413b-ae9d-53b113f9f58c\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " Nov 04 04:46:30.282861 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.282831 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-installation-pull-secrets\") pod \"7074b62a-f130-413b-ae9d-53b113f9f58c\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " Nov 04 04:46:30.282959 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.282862 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-bound-sa-token\") pod \"7074b62a-f130-413b-ae9d-53b113f9f58c\" (UID: \"7074b62a-f130-413b-ae9d-53b113f9f58c\") " Nov 04 04:46:30.283378 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.283078 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-trusted-ca" pod "7074b62a-f130-413b-ae9d-53b113f9f58c" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:46:30.283378 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.283188 4955 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-certificates\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:30.283378 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.283212 4955 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7074b62a-f130-413b-ae9d-53b113f9f58c-trusted-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:30.286063 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.285996 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-bound-sa-token" pod "7074b62a-f130-413b-ae9d-53b113f9f58c" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:46:30.286309 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.286280 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-image-registry-private-configuration" pod "7074b62a-f130-413b-ae9d-53b113f9f58c" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:46:30.286418 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.286345 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls" pod "7074b62a-f130-413b-ae9d-53b113f9f58c" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:46:30.286512 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.286491 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-kube-api-access-m66bl" pod "7074b62a-f130-413b-ae9d-53b113f9f58c" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c"). InnerVolumeSpecName "kube-api-access-m66bl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:46:30.286605 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.286576 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-installation-pull-secrets" pod "7074b62a-f130-413b-ae9d-53b113f9f58c" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:46:30.290655 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.290616 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7074b62a-f130-413b-ae9d-53b113f9f58c-ca-trust-extracted" pod "7074b62a-f130-413b-ae9d-53b113f9f58c" (UID: "7074b62a-f130-413b-ae9d-53b113f9f58c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:46:30.384422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.384339 4955 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7074b62a-f130-413b-ae9d-53b113f9f58c-ca-trust-extracted\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:30.384422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.384373 4955 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-image-registry-private-configuration\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:30.384422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.384391 4955 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7074b62a-f130-413b-ae9d-53b113f9f58c-installation-pull-secrets\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:30.384422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.384408 4955 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-bound-sa-token\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:30.384662 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.384427 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m66bl\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-kube-api-access-m66bl\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:30.384662 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.384442 4955 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7074b62a-f130-413b-ae9d-53b113f9f58c-registry-tls\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:30.969569 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.969536 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" event={"ID":"7074b62a-f130-413b-ae9d-53b113f9f58c","Type":"ContainerDied","Data":"b340b7e5ae400362fc400e2ecbf00db7727122366b0c3faa8dc2296c32fd1672"} Nov 04 04:46:30.970031 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.969599 4955 scope.go:122] "RemoveContainer" containerID="bccfc00849f8d8611b41978835a4e573d2ed9069afa920e0eb79c722f1cb09e7" Nov 04 04:46:30.970031 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:30.969760 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867f9c6749-4gj2n" Nov 04 04:46:31.170193 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:31.170164 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-867f9c6749-4gj2n"] Nov 04 04:46:31.216150 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:31.216098 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-867f9c6749-4gj2n"] Nov 04 04:46:31.653994 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:31.653955 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7074b62a-f130-413b-ae9d-53b113f9f58c" path="/var/lib/kubelet/pods/7074b62a-f130-413b-ae9d-53b113f9f58c/volumes" Nov 04 04:46:36.999000 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:36.998965 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-lr776" event={"ID":"bdfe3981-5581-4b32-a1f5-e82b88f99a86","Type":"ContainerStarted","Data":"3501fc37764facf260bfd5467fbf090052e6b18e06aa78be22671c187c847a10"} Nov 04 04:46:36.999432 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:36.999206 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-lr776" Nov 04 04:46:37.000884 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:37.000861 4955 patch_prober.go:29] interesting pod/downloads-6dd789c8b7-lr776 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.28:8080/\": dial tcp 10.132.0.28:8080: connect: connection refused" start-of-body= Nov 04 04:46:37.000967 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:37.000907 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6dd789c8b7-lr776" podUID="bdfe3981-5581-4b32-a1f5-e82b88f99a86" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.28:8080/\": dial tcp 10.132.0.28:8080: connect: connection refused" Nov 04 04:46:37.142887 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:37.142828 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-lr776" podStartSLOduration=1.769615687 podStartE2EDuration="33.142808837s" totalImagesPullingTime="31.37319315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:37.120765741 +0000 UTC m=+47.590591871" watchObservedRunningTime="2026-11-04 04:46:37.142808837 +0000 UTC m=+47.612634976" Nov 04 04:46:37.661768 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:37.661730 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-mp8tg-26z5w"] Nov 04 04:46:37.662019 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:37.661961 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-mp8tg-26z5w" podUID="3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" containerName="insights-gathering" containerID="cri-o://2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2" gracePeriod=30 Nov 04 04:46:37.987986 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:37.987949 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:46:38.005789 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.005756 4955 generic.go:356] "Generic (PLEG): container finished" podID="3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" containerID="2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2" exitCode=2 Nov 04 04:46:38.006296 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.005820 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-mp8tg-26z5w" Nov 04 04:46:38.006296 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.005844 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-mp8tg-26z5w" event={"ID":"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7","Type":"ContainerDied","Data":"2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2"} Nov 04 04:46:38.006296 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.005947 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-mp8tg-26z5w" event={"ID":"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7","Type":"ContainerDied","Data":"cd1d3cc3e3163a0b4459a9b1b7a541f80bab722e34180064f14b5bc3de5ef80a"} Nov 04 04:46:38.006296 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.005975 4955 scope.go:122] "RemoveContainer" containerID="2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2" Nov 04 04:46:38.016006 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.015980 4955 scope.go:122] "RemoveContainer" containerID="2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2" Nov 04 04:46:38.016337 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:46:38.016301 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2\": container with ID starting with 2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2 not found: ID does not exist" containerID="2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2" Nov 04 04:46:38.016437 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.016347 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2"} err="failed to get container status \"2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2\": rpc error: code = NotFound desc = could not find container \"2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2\": container with ID starting with 2807835b6894418601012bf98d1485a99a4a57870ba1d744c9b9e14f8a53c6b2 not found: ID does not exist" Nov 04 04:46:38.016780 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.016761 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-lr776" Nov 04 04:46:38.045905 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.045874 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-trusted-ca-bundle\") pod \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " Nov 04 04:46:38.046028 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.045940 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-kube-api-access-sk5v2\" (UniqueName: \"kubernetes.io/projected/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-kube-api-access-sk5v2\") pod \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " Nov 04 04:46:38.046095 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.046077 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-archives-path\") pod \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " Nov 04 04:46:38.046198 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.046175 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-service-ca-bundle\") pod \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\" (UID: \"3e6fc28e-9b9c-46c8-ae55-d100b49a43d7\") " Nov 04 04:46:38.046758 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.046425 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-trusted-ca-bundle" pod "3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" (UID: "3e6fc28e-9b9c-46c8-ae55-d100b49a43d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:46:38.046758 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.046454 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-archives-path" pod "3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" (UID: "3e6fc28e-9b9c-46c8-ae55-d100b49a43d7"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:46:38.046758 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.046540 4955 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-archives-path\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:38.046758 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.046551 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-service-ca-bundle" pod "3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" (UID: "3e6fc28e-9b9c-46c8-ae55-d100b49a43d7"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:46:38.046758 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.046562 4955 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-trusted-ca-bundle\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:38.048910 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.048888 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-kube-api-access-sk5v2" pod "3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" (UID: "3e6fc28e-9b9c-46c8-ae55-d100b49a43d7"). InnerVolumeSpecName "kube-api-access-sk5v2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:46:38.147778 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.147742 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk5v2\" (UniqueName: \"kubernetes.io/projected/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-kube-api-access-sk5v2\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:38.147778 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.147778 4955 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7-service-ca-bundle\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:38.421794 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.421756 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-mp8tg-26z5w"] Nov 04 04:46:38.425869 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:38.425837 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-mp8tg-26z5w"] Nov 04 04:46:39.654727 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:39.654689 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" path="/var/lib/kubelet/pods/3e6fc28e-9b9c-46c8-ae55-d100b49a43d7/volumes" Nov 04 04:46:52.111899 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.111845 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" podUID="24e214b2-5e33-4022-8f14-edf1cb11f820" containerName="registry" containerID="cri-o://7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093" gracePeriod=30 Nov 04 04:46:52.386494 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.386434 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:46:52.468605 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.468575 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-kube-api-access-c59zf\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-kube-api-access-c59zf\") pod \"24e214b2-5e33-4022-8f14-edf1cb11f820\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " Nov 04 04:46:52.468754 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.468647 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-trusted-ca\") pod \"24e214b2-5e33-4022-8f14-edf1cb11f820\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " Nov 04 04:46:52.468754 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.468670 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-bound-sa-token\") pod \"24e214b2-5e33-4022-8f14-edf1cb11f820\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " Nov 04 04:46:52.468754 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.468717 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") pod \"24e214b2-5e33-4022-8f14-edf1cb11f820\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " Nov 04 04:46:52.468754 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.468736 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-image-registry-private-configuration\") pod \"24e214b2-5e33-4022-8f14-edf1cb11f820\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " Nov 04 04:46:52.468971 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.468870 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-installation-pull-secrets\") pod \"24e214b2-5e33-4022-8f14-edf1cb11f820\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " Nov 04 04:46:52.468971 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.468926 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24e214b2-5e33-4022-8f14-edf1cb11f820-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24e214b2-5e33-4022-8f14-edf1cb11f820-ca-trust-extracted\") pod \"24e214b2-5e33-4022-8f14-edf1cb11f820\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " Nov 04 04:46:52.468971 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.468968 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-certificates\") pod \"24e214b2-5e33-4022-8f14-edf1cb11f820\" (UID: \"24e214b2-5e33-4022-8f14-edf1cb11f820\") " Nov 04 04:46:52.469197 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.469162 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-trusted-ca" pod "24e214b2-5e33-4022-8f14-edf1cb11f820" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:46:52.469339 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.469306 4955 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-trusted-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:52.469597 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.469565 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-certificates" pod "24e214b2-5e33-4022-8f14-edf1cb11f820" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:46:52.471235 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.471200 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-bound-sa-token" pod "24e214b2-5e33-4022-8f14-edf1cb11f820" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:46:52.471407 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.471374 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls" pod "24e214b2-5e33-4022-8f14-edf1cb11f820" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:46:52.471509 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.471449 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-image-registry-private-configuration" pod "24e214b2-5e33-4022-8f14-edf1cb11f820" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:46:52.471555 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.471505 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-kube-api-access-c59zf" pod "24e214b2-5e33-4022-8f14-edf1cb11f820" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820"). InnerVolumeSpecName "kube-api-access-c59zf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:46:52.471592 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.471543 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-installation-pull-secrets" pod "24e214b2-5e33-4022-8f14-edf1cb11f820" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:46:52.475584 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.475560 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24e214b2-5e33-4022-8f14-edf1cb11f820-ca-trust-extracted" pod "24e214b2-5e33-4022-8f14-edf1cb11f820" (UID: "24e214b2-5e33-4022-8f14-edf1cb11f820"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:46:52.570131 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.570101 4955 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-tls\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:52.570131 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.570128 4955 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-image-registry-private-configuration\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:52.570328 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.570139 4955 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24e214b2-5e33-4022-8f14-edf1cb11f820-installation-pull-secrets\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:52.570328 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.570150 4955 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24e214b2-5e33-4022-8f14-edf1cb11f820-ca-trust-extracted\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:52.570328 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.570161 4955 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24e214b2-5e33-4022-8f14-edf1cb11f820-registry-certificates\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:52.570328 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.570170 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c59zf\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-kube-api-access-c59zf\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:52.570328 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:52.570179 4955 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24e214b2-5e33-4022-8f14-edf1cb11f820-bound-sa-token\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:46:53.068670 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:53.068635 4955 generic.go:356] "Generic (PLEG): container finished" podID="24e214b2-5e33-4022-8f14-edf1cb11f820" containerID="7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093" exitCode=0 Nov 04 04:46:53.068838 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:53.068682 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" Nov 04 04:46:53.068838 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:53.068702 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" event={"ID":"24e214b2-5e33-4022-8f14-edf1cb11f820","Type":"ContainerDied","Data":"7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093"} Nov 04 04:46:53.068838 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:53.068758 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c46895cdd-h2frf" event={"ID":"24e214b2-5e33-4022-8f14-edf1cb11f820","Type":"ContainerDied","Data":"2137d54013d9ed6fa2f136f85679027b4ea361fcbb25403a306b40b8c43ca17e"} Nov 04 04:46:53.068838 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:53.068784 4955 scope.go:122] "RemoveContainer" containerID="7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093" Nov 04 04:46:53.077435 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:53.077417 4955 scope.go:122] "RemoveContainer" containerID="7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093" Nov 04 04:46:53.077681 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:46:53.077662 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093\": container with ID starting with 7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093 not found: ID does not exist" containerID="7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093" Nov 04 04:46:53.077744 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:53.077695 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093"} err="failed to get container status \"7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093\": rpc error: code = NotFound desc = could not find container \"7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093\": container with ID starting with 7c5b4d58680aa99f7a7d7368b5bda23464c5e62970a856c92b6cc86fe9d7e093 not found: ID does not exist" Nov 04 04:46:53.222716 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:53.222677 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c46895cdd-h2frf"] Nov 04 04:46:53.269080 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:53.269057 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c46895cdd-h2frf"] Nov 04 04:46:53.653572 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:46:53.653544 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="24e214b2-5e33-4022-8f14-edf1cb11f820" path="/var/lib/kubelet/pods/24e214b2-5e33-4022-8f14-edf1cb11f820/volumes" Nov 04 04:46:58.188957 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:46:58.188924 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:47:00.098763 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:47:00.098718 4955 generic.go:356] "Generic (PLEG): container finished" podID="a9dc342a-1857-4691-a57b-d1672547d10c" containerID="567a898b779a49aa0bfc6952bf2d8eb2f90e035895489b5ec6af3b7ef120ea64" exitCode=0 Nov 04 04:47:00.099179 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:47:00.098782 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" event={"ID":"a9dc342a-1857-4691-a57b-d1672547d10c","Type":"ContainerDied","Data":"567a898b779a49aa0bfc6952bf2d8eb2f90e035895489b5ec6af3b7ef120ea64"} Nov 04 04:47:00.099179 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:47:00.099109 4955 scope.go:122] "RemoveContainer" containerID="567a898b779a49aa0bfc6952bf2d8eb2f90e035895489b5ec6af3b7ef120ea64" Nov 04 04:47:01.104175 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:47:01.104141 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-wqb4b" event={"ID":"a9dc342a-1857-4691-a57b-d1672547d10c","Type":"ContainerStarted","Data":"23477237bd3085c14cf5b46cefc83f92b7d372e8e165d42ddcc8c9654481455b"} Nov 04 04:47:25.200874 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:47:25.200837 4955 generic.go:356] "Generic (PLEG): container finished" podID="68796d82-fed3-494a-8239-32c07fa7c466" containerID="fef724430f25ce20453d14a3534522b8986d1ca6f0a3d2142b8556f2d9c766c9" exitCode=0 Nov 04 04:47:25.201423 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:47:25.200912 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-crv79" event={"ID":"68796d82-fed3-494a-8239-32c07fa7c466","Type":"ContainerDied","Data":"fef724430f25ce20453d14a3534522b8986d1ca6f0a3d2142b8556f2d9c766c9"} Nov 04 04:47:25.201423 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:47:25.200988 4955 scope.go:122] "RemoveContainer" containerID="8805e7ab11569c8f01b17808f59f19f949e2cfef18ed59a75afbf3274e2de7ca" Nov 04 04:47:25.201423 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:47:25.201352 4955 scope.go:122] "RemoveContainer" containerID="fef724430f25ce20453d14a3534522b8986d1ca6f0a3d2142b8556f2d9c766c9" Nov 04 04:47:25.201589 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:47:25.201552 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"insights-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=insights-operator pod=insights-operator-7c4986d449-crv79_openshift-insights(68796d82-fed3-494a-8239-32c07fa7c466)\"" pod="openshift-insights/insights-operator-7c4986d449-crv79" podUID="68796d82-fed3-494a-8239-32c07fa7c466" Nov 04 04:47:28.188453 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:47:28.188421 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:47:39.650517 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:47:39.650487 4955 scope.go:122] "RemoveContainer" containerID="fef724430f25ce20453d14a3534522b8986d1ca6f0a3d2142b8556f2d9c766c9" Nov 04 04:47:40.261528 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:47:40.261499 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-crv79" event={"ID":"68796d82-fed3-494a-8239-32c07fa7c466","Type":"ContainerStarted","Data":"e27c51b78750b6269765d754e238e1f2142bda70dd7638e73fe358b1b0f0be25"} Nov 04 04:47:58.188675 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:47:58.188639 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:48:28.188139 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:48:28.188102 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:48:58.191749 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:48:58.191706 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:49:19.766508 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.766479 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw"] Nov 04 04:49:19.766967 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.766794 4955 cpu_manager.go:414] "containerMap: removing container" podUID="24e214b2-5e33-4022-8f14-edf1cb11f820" containerName="registry" Nov 04 04:49:19.766967 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.766807 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24e214b2-5e33-4022-8f14-edf1cb11f820" containerName="registry" Nov 04 04:49:19.766967 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.766828 4955 cpu_manager.go:414] "containerMap: removing container" podUID="7074b62a-f130-413b-ae9d-53b113f9f58c" containerName="registry" Nov 04 04:49:19.766967 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.766834 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7074b62a-f130-413b-ae9d-53b113f9f58c" containerName="registry" Nov 04 04:49:19.766967 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.766848 4955 cpu_manager.go:414] "containerMap: removing container" podUID="3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" containerName="insights-gathering" Nov 04 04:49:19.766967 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.766857 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" containerName="insights-gathering" Nov 04 04:49:19.766967 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.766908 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="24e214b2-5e33-4022-8f14-edf1cb11f820" containerName="registry" Nov 04 04:49:19.766967 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.766918 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="7074b62a-f130-413b-ae9d-53b113f9f58c" containerName="registry" Nov 04 04:49:19.766967 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.766925 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e6fc28e-9b9c-46c8-ae55-d100b49a43d7" containerName="insights-gathering" Nov 04 04:49:19.769019 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.769003 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.817374 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.817340 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 04 04:49:19.858212 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.858182 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw"] Nov 04 04:49:19.890112 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.890085 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-rdhv8\"" Nov 04 04:49:19.894441 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.894420 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca29bf28-a780-418a-ba50-9ff80af7d04c-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.894497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.894459 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.894497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.894482 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx584\" (UniqueName: \"kubernetes.io/projected/ca29bf28-a780-418a-ba50-9ff80af7d04c-kube-api-access-gx584\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.894618 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.894598 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca29bf28-a780-418a-ba50-9ff80af7d04c-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.894659 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.894629 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.894659 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.894647 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.894730 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.894717 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.894764 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.894758 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.894798 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.894775 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca29bf28-a780-418a-ba50-9ff80af7d04c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.995634 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.995610 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.995730 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.995639 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx584\" (UniqueName: \"kubernetes.io/projected/ca29bf28-a780-418a-ba50-9ff80af7d04c-kube-api-access-gx584\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.995730 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.995662 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca29bf28-a780-418a-ba50-9ff80af7d04c-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.995938 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.995916 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.995977 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.995964 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.996010 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.995994 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.996010 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.996001 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.996069 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.996060 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.996104 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.996086 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca29bf28-a780-418a-ba50-9ff80af7d04c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.996154 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.996140 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca29bf28-a780-418a-ba50-9ff80af7d04c-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.996257 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.996236 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.996360 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.996336 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.996441 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.996424 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.996750 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.996727 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca29bf28-a780-418a-ba50-9ff80af7d04c-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.998110 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.998089 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca29bf28-a780-418a-ba50-9ff80af7d04c-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:19.998425 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:19.998409 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca29bf28-a780-418a-ba50-9ff80af7d04c-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:20.052080 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:20.052051 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca29bf28-a780-418a-ba50-9ff80af7d04c-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:20.052213 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:20.052192 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx584\" (UniqueName: \"kubernetes.io/projected/ca29bf28-a780-418a-ba50-9ff80af7d04c-kube-api-access-gx584\") pod \"openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw\" (UID: \"ca29bf28-a780-418a-ba50-9ff80af7d04c\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:20.080999 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:20.080979 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:20.502036 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:20.501964 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw"] Nov 04 04:49:20.510333 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:49:20.510301 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca29bf28_a780_418a_ba50_9ff80af7d04c.slice/crio-411f8d646fbc8bbe4e26e4da4980725b6a6e5cede564c1c25ee3778ea3b07762 WatchSource:0}: Error finding container 411f8d646fbc8bbe4e26e4da4980725b6a6e5cede564c1c25ee3778ea3b07762: Status 404 returned error can't find the container with id 411f8d646fbc8bbe4e26e4da4980725b6a6e5cede564c1c25ee3778ea3b07762 Nov 04 04:49:20.662888 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:20.662858 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" event={"ID":"ca29bf28-a780-418a-ba50-9ff80af7d04c","Type":"ContainerStarted","Data":"411f8d646fbc8bbe4e26e4da4980725b6a6e5cede564c1c25ee3778ea3b07762"} Nov 04 04:49:21.666846 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.666815 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p"] Nov 04 04:49:21.669865 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.669847 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:21.692827 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.692805 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb"] Nov 04 04:49:21.695871 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.695844 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:21.720961 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.720941 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-d7kzj\"" Nov 04 04:49:21.738064 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.738040 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 04 04:49:21.739119 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.739099 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd"] Nov 04 04:49:21.741465 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.741450 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:21.766970 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.766946 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 04 04:49:21.768138 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.768118 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p"] Nov 04 04:49:21.769056 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.769037 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq"] Nov 04 04:49:21.771425 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.771405 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb"] Nov 04 04:49:21.771522 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.771499 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:21.808469 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.808440 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd"] Nov 04 04:49:21.809661 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.809641 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb\" (UID: \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:21.809720 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.809675 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb\" (UID: \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:21.809771 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.809752 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjrjs\" (UniqueName: \"kubernetes.io/projected/74f260aa-fea1-46a1-b37f-8e29cff3cca5-kube-api-access-gjrjs\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb\" (UID: \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:21.809812 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.809784 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p\" (UID: \"641034fd-7ead-4c9e-b29c-251654b217dd\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:21.809812 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.809800 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pdnb\" (UniqueName: \"kubernetes.io/projected/641034fd-7ead-4c9e-b29c-251654b217dd-kube-api-access-6pdnb\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p\" (UID: \"641034fd-7ead-4c9e-b29c-251654b217dd\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:21.809872 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.809846 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p\" (UID: \"641034fd-7ead-4c9e-b29c-251654b217dd\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:21.809941 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.809929 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd\" (UID: \"dba16387-cb12-46a5-9269-904e24f0abb5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:21.809983 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.809962 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd\" (UID: \"dba16387-cb12-46a5-9269-904e24f0abb5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:21.810021 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.809980 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxm2r\" (UniqueName: \"kubernetes.io/projected/dba16387-cb12-46a5-9269-904e24f0abb5-kube-api-access-mxm2r\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd\" (UID: \"dba16387-cb12-46a5-9269-904e24f0abb5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:21.820778 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.820754 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq"] Nov 04 04:49:21.821609 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.821591 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-shzzs\"" Nov 04 04:49:21.821699 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.821643 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-lqgxz\"" Nov 04 04:49:21.821699 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.821660 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-gjnpw\"" Nov 04 04:49:21.911159 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911132 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd\" (UID: \"dba16387-cb12-46a5-9269-904e24f0abb5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:21.911331 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911169 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq\" (UID: \"0c5387f0-a0fe-4f69-b01f-710049543ef0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:21.911331 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911198 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd\" (UID: \"dba16387-cb12-46a5-9269-904e24f0abb5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:21.911331 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911214 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxm2r\" (UniqueName: \"kubernetes.io/projected/dba16387-cb12-46a5-9269-904e24f0abb5-kube-api-access-mxm2r\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd\" (UID: \"dba16387-cb12-46a5-9269-904e24f0abb5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:21.911508 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911337 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t5fz\" (UniqueName: \"kubernetes.io/projected/0c5387f0-a0fe-4f69-b01f-710049543ef0-kube-api-access-5t5fz\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq\" (UID: \"0c5387f0-a0fe-4f69-b01f-710049543ef0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:21.911508 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911378 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb\" (UID: \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:21.911508 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911434 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb\" (UID: \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:21.911508 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911481 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjrjs\" (UniqueName: \"kubernetes.io/projected/74f260aa-fea1-46a1-b37f-8e29cff3cca5-kube-api-access-gjrjs\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb\" (UID: \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:21.911702 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911514 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p\" (UID: \"641034fd-7ead-4c9e-b29c-251654b217dd\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:21.911702 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911541 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pdnb\" (UniqueName: \"kubernetes.io/projected/641034fd-7ead-4c9e-b29c-251654b217dd-kube-api-access-6pdnb\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p\" (UID: \"641034fd-7ead-4c9e-b29c-251654b217dd\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:21.911702 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911566 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p\" (UID: \"641034fd-7ead-4c9e-b29c-251654b217dd\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:21.911702 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911590 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd\" (UID: \"dba16387-cb12-46a5-9269-904e24f0abb5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:21.911702 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911616 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq\" (UID: \"0c5387f0-a0fe-4f69-b01f-710049543ef0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:21.911702 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911637 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd\" (UID: \"dba16387-cb12-46a5-9269-904e24f0abb5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:21.911900 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911788 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb\" (UID: \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:21.911900 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911824 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb\" (UID: \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:21.911986 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.911966 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p\" (UID: \"641034fd-7ead-4c9e-b29c-251654b217dd\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:21.912086 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.912072 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p\" (UID: \"641034fd-7ead-4c9e-b29c-251654b217dd\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:21.968364 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.968306 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxm2r\" (UniqueName: \"kubernetes.io/projected/dba16387-cb12-46a5-9269-904e24f0abb5-kube-api-access-mxm2r\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd\" (UID: \"dba16387-cb12-46a5-9269-904e24f0abb5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:21.968364 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.968338 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjrjs\" (UniqueName: \"kubernetes.io/projected/74f260aa-fea1-46a1-b37f-8e29cff3cca5-kube-api-access-gjrjs\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb\" (UID: \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:21.968496 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.968429 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pdnb\" (UniqueName: \"kubernetes.io/projected/641034fd-7ead-4c9e-b29c-251654b217dd-kube-api-access-6pdnb\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p\" (UID: \"641034fd-7ead-4c9e-b29c-251654b217dd\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:21.983119 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:21.983099 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:22.010809 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.010789 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:22.012069 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.012052 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq\" (UID: \"0c5387f0-a0fe-4f69-b01f-710049543ef0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:22.012130 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.012083 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq\" (UID: \"0c5387f0-a0fe-4f69-b01f-710049543ef0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:22.012165 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.012135 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5fz\" (UniqueName: \"kubernetes.io/projected/0c5387f0-a0fe-4f69-b01f-710049543ef0-kube-api-access-5t5fz\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq\" (UID: \"0c5387f0-a0fe-4f69-b01f-710049543ef0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:22.012422 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.012405 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq\" (UID: \"0c5387f0-a0fe-4f69-b01f-710049543ef0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:22.012545 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.012524 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq\" (UID: \"0c5387f0-a0fe-4f69-b01f-710049543ef0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:22.053618 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.053592 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:22.070311 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.070285 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t5fz\" (UniqueName: \"kubernetes.io/projected/0c5387f0-a0fe-4f69-b01f-710049543ef0-kube-api-access-5t5fz\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq\" (UID: \"0c5387f0-a0fe-4f69-b01f-710049543ef0\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:22.084467 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.084433 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:22.391330 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.391298 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p"] Nov 04 04:49:22.398133 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:49:22.398110 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641034fd_7ead_4c9e_b29c_251654b217dd.slice/crio-5ea8932ed8f68fa9ed269574b898ddd47b02e75c841da0b2e669e34cc4af2667 WatchSource:0}: Error finding container 5ea8932ed8f68fa9ed269574b898ddd47b02e75c841da0b2e669e34cc4af2667: Status 404 returned error can't find the container with id 5ea8932ed8f68fa9ed269574b898ddd47b02e75c841da0b2e669e34cc4af2667 Nov 04 04:49:22.402945 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.402926 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb"] Nov 04 04:49:22.444894 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.444873 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd"] Nov 04 04:49:22.452176 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:49:22.452150 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba16387_cb12_46a5_9269_904e24f0abb5.slice/crio-b9e867447420f0863f68d715d8cd7635ce23af0b1a06b79c9e4b5c3eeed03a0e WatchSource:0}: Error finding container b9e867447420f0863f68d715d8cd7635ce23af0b1a06b79c9e4b5c3eeed03a0e: Status 404 returned error can't find the container with id b9e867447420f0863f68d715d8cd7635ce23af0b1a06b79c9e4b5c3eeed03a0e Nov 04 04:49:22.495696 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.495673 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq"] Nov 04 04:49:22.504094 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:49:22.504070 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5387f0_a0fe_4f69_b01f_710049543ef0.slice/crio-e6bb95e7d9d0b43053eabc2d12f5058c831b02c56262ac1138e66b26ea1d55aa WatchSource:0}: Error finding container e6bb95e7d9d0b43053eabc2d12f5058c831b02c56262ac1138e66b26ea1d55aa: Status 404 returned error can't find the container with id e6bb95e7d9d0b43053eabc2d12f5058c831b02c56262ac1138e66b26ea1d55aa Nov 04 04:49:22.671733 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.671650 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" event={"ID":"dba16387-cb12-46a5-9269-904e24f0abb5","Type":"ContainerStarted","Data":"b9e867447420f0863f68d715d8cd7635ce23af0b1a06b79c9e4b5c3eeed03a0e"} Nov 04 04:49:22.672721 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.672700 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" event={"ID":"0c5387f0-a0fe-4f69-b01f-710049543ef0","Type":"ContainerStarted","Data":"e6bb95e7d9d0b43053eabc2d12f5058c831b02c56262ac1138e66b26ea1d55aa"} Nov 04 04:49:22.673770 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.673744 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" event={"ID":"74f260aa-fea1-46a1-b37f-8e29cff3cca5","Type":"ContainerStarted","Data":"fef42becbcf95b50f2a554a5c6913c4afe2b6d61db39989ea70600540893fd29"} Nov 04 04:49:22.674751 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:22.674733 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" event={"ID":"641034fd-7ead-4c9e-b29c-251654b217dd","Type":"ContainerStarted","Data":"5ea8932ed8f68fa9ed269574b898ddd47b02e75c841da0b2e669e34cc4af2667"} Nov 04 04:49:25.880018 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:25.879980 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:49:25.880491 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:25.880067 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:49:25.880491 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:25.880159 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:49:26.702978 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:26.702939 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" event={"ID":"ca29bf28-a780-418a-ba50-9ff80af7d04c","Type":"ContainerStarted","Data":"aeeddc6be2854735f45ab76eb052c2fe56826ff8b79902378650521d40a0c869"} Nov 04 04:49:26.876706 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:26.875730 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" podStartSLOduration=2.508902791 podStartE2EDuration="7.875714975s" totalImagesPullingTime="5.366812184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:49:26.873993486 +0000 UTC m=+217.343819625" watchObservedRunningTime="2026-11-04 04:49:26.875714975 +0000 UTC m=+217.345541113" Nov 04 04:49:27.082166 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:27.082031 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:27.088219 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:27.088185 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:27.711942 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:27.711856 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:27.713347 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:27.713124 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw" Nov 04 04:49:28.211535 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:49:28.211491 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:49:32.746204 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:32.746172 4955 generic.go:356] "Generic (PLEG): container finished" podID="0c5387f0-a0fe-4f69-b01f-710049543ef0" containerID="5cbdca526cd360882ce442d1bccd8da93aca73e5ad9edaadec7578d152332621" exitCode=0 Nov 04 04:49:32.746565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:32.746278 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" event={"ID":"0c5387f0-a0fe-4f69-b01f-710049543ef0","Type":"ContainerDied","Data":"5cbdca526cd360882ce442d1bccd8da93aca73e5ad9edaadec7578d152332621"} Nov 04 04:49:32.748060 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:32.747951 4955 generic.go:356] "Generic (PLEG): container finished" podID="74f260aa-fea1-46a1-b37f-8e29cff3cca5" containerID="7c2552fbfec7ae04199d2776ccd78ce0488da46d254fe96639da630c92749b08" exitCode=0 Nov 04 04:49:32.748060 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:32.748034 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" event={"ID":"74f260aa-fea1-46a1-b37f-8e29cff3cca5","Type":"ContainerDied","Data":"7c2552fbfec7ae04199d2776ccd78ce0488da46d254fe96639da630c92749b08"} Nov 04 04:49:32.749779 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:32.749751 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" event={"ID":"641034fd-7ead-4c9e-b29c-251654b217dd","Type":"ContainerStarted","Data":"00964d1f9d732800af9e25c2d89038af781349e3b0cd83e60f3aba02b6df5aef"} Nov 04 04:49:32.751355 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:32.751333 4955 generic.go:356] "Generic (PLEG): container finished" podID="dba16387-cb12-46a5-9269-904e24f0abb5" containerID="304b59029dc06bfa39e84ef728f6dfffd1db31338564f08197beea3bed347e0a" exitCode=0 Nov 04 04:49:32.751457 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:32.751361 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" event={"ID":"dba16387-cb12-46a5-9269-904e24f0abb5","Type":"ContainerDied","Data":"304b59029dc06bfa39e84ef728f6dfffd1db31338564f08197beea3bed347e0a"} Nov 04 04:49:33.755985 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:33.755953 4955 generic.go:356] "Generic (PLEG): container finished" podID="641034fd-7ead-4c9e-b29c-251654b217dd" containerID="00964d1f9d732800af9e25c2d89038af781349e3b0cd83e60f3aba02b6df5aef" exitCode=0 Nov 04 04:49:33.756465 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:33.756043 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" event={"ID":"641034fd-7ead-4c9e-b29c-251654b217dd","Type":"ContainerDied","Data":"00964d1f9d732800af9e25c2d89038af781349e3b0cd83e60f3aba02b6df5aef"} Nov 04 04:49:34.761254 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:34.761218 4955 generic.go:356] "Generic (PLEG): container finished" podID="0c5387f0-a0fe-4f69-b01f-710049543ef0" containerID="0099106544baeabbfd7cb039a252aba5ecaae9897e33211e0a5ae481cf0d088e" exitCode=0 Nov 04 04:49:34.761710 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:34.761296 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" event={"ID":"0c5387f0-a0fe-4f69-b01f-710049543ef0","Type":"ContainerDied","Data":"0099106544baeabbfd7cb039a252aba5ecaae9897e33211e0a5ae481cf0d088e"} Nov 04 04:49:34.763198 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:34.763144 4955 generic.go:356] "Generic (PLEG): container finished" podID="74f260aa-fea1-46a1-b37f-8e29cff3cca5" containerID="d1681fd108e8b28be04c1ec2b28d45f12190b8d40bfd92639ff17d1fd16c69e8" exitCode=0 Nov 04 04:49:34.763297 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:34.763219 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" event={"ID":"74f260aa-fea1-46a1-b37f-8e29cff3cca5","Type":"ContainerDied","Data":"d1681fd108e8b28be04c1ec2b28d45f12190b8d40bfd92639ff17d1fd16c69e8"} Nov 04 04:49:35.768692 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:35.768608 4955 generic.go:356] "Generic (PLEG): container finished" podID="dba16387-cb12-46a5-9269-904e24f0abb5" containerID="f791eaca67fc87c4e2ff642eef48b3d37166164da82a8d5340c32545807cefb0" exitCode=0 Nov 04 04:49:35.769082 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:35.768696 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" event={"ID":"dba16387-cb12-46a5-9269-904e24f0abb5","Type":"ContainerDied","Data":"f791eaca67fc87c4e2ff642eef48b3d37166164da82a8d5340c32545807cefb0"} Nov 04 04:49:35.770628 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:35.770606 4955 generic.go:356] "Generic (PLEG): container finished" podID="641034fd-7ead-4c9e-b29c-251654b217dd" containerID="db275c06c7c1550500bf1bbc3ee566f60870ec048611f890129090ae4c18cab2" exitCode=0 Nov 04 04:49:35.770725 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:35.770651 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" event={"ID":"641034fd-7ead-4c9e-b29c-251654b217dd","Type":"ContainerDied","Data":"db275c06c7c1550500bf1bbc3ee566f60870ec048611f890129090ae4c18cab2"} Nov 04 04:49:43.823699 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:43.823614 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" event={"ID":"0c5387f0-a0fe-4f69-b01f-710049543ef0","Type":"ContainerStarted","Data":"9cb229562a1c71451adc00d0d0e14fcbfc9a381c793f32649fdac43193ab5f7c"} Nov 04 04:49:43.936764 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:43.935541 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" podStartSLOduration=2.800782272 podStartE2EDuration="22.935521241s" totalImagesPullingTime="20.134738969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:49:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:49:43.933812882 +0000 UTC m=+234.403639033" watchObservedRunningTime="2026-11-04 04:49:43.935521241 +0000 UTC m=+234.405347383" Nov 04 04:49:44.832250 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:44.832081 4955 generic.go:356] "Generic (PLEG): container finished" podID="0c5387f0-a0fe-4f69-b01f-710049543ef0" containerID="9cb229562a1c71451adc00d0d0e14fcbfc9a381c793f32649fdac43193ab5f7c" exitCode=0 Nov 04 04:49:44.832250 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:44.832176 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" event={"ID":"0c5387f0-a0fe-4f69-b01f-710049543ef0","Type":"ContainerDied","Data":"9cb229562a1c71451adc00d0d0e14fcbfc9a381c793f32649fdac43193ab5f7c"} Nov 04 04:49:44.835025 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:44.834989 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" event={"ID":"74f260aa-fea1-46a1-b37f-8e29cff3cca5","Type":"ContainerStarted","Data":"dcaecf249fab9fcebb6d7bf77b8e5f3988b69471cb017ac57c8ab6da9d4eef81"} Nov 04 04:49:45.054182 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:45.054124 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" podStartSLOduration=2.806168773 podStartE2EDuration="24.05410387s" totalImagesPullingTime="21.247935097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:49:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:49:45.053748981 +0000 UTC m=+235.523575121" watchObservedRunningTime="2026-11-04 04:49:45.05410387 +0000 UTC m=+235.523930013" Nov 04 04:49:45.842965 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:45.842930 4955 generic.go:356] "Generic (PLEG): container finished" podID="74f260aa-fea1-46a1-b37f-8e29cff3cca5" containerID="dcaecf249fab9fcebb6d7bf77b8e5f3988b69471cb017ac57c8ab6da9d4eef81" exitCode=0 Nov 04 04:49:45.843850 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:45.843826 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" event={"ID":"74f260aa-fea1-46a1-b37f-8e29cff3cca5","Type":"ContainerDied","Data":"dcaecf249fab9fcebb6d7bf77b8e5f3988b69471cb017ac57c8ab6da9d4eef81"} Nov 04 04:49:46.001605 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.001333 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:46.046481 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.046420 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-bundle\") pod \"0c5387f0-a0fe-4f69-b01f-710049543ef0\" (UID: \"0c5387f0-a0fe-4f69-b01f-710049543ef0\") " Nov 04 04:49:46.046595 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.046531 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c5387f0-a0fe-4f69-b01f-710049543ef0-kube-api-access-5t5fz\" (UniqueName: \"kubernetes.io/projected/0c5387f0-a0fe-4f69-b01f-710049543ef0-kube-api-access-5t5fz\") pod \"0c5387f0-a0fe-4f69-b01f-710049543ef0\" (UID: \"0c5387f0-a0fe-4f69-b01f-710049543ef0\") " Nov 04 04:49:46.046595 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.046584 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-util\" (UniqueName: \"kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-util\") pod \"0c5387f0-a0fe-4f69-b01f-710049543ef0\" (UID: \"0c5387f0-a0fe-4f69-b01f-710049543ef0\") " Nov 04 04:49:46.047525 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.047498 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-bundle" pod "0c5387f0-a0fe-4f69-b01f-710049543ef0" (UID: "0c5387f0-a0fe-4f69-b01f-710049543ef0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:49:46.049780 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.049757 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c5387f0-a0fe-4f69-b01f-710049543ef0-kube-api-access-5t5fz" pod "0c5387f0-a0fe-4f69-b01f-710049543ef0" (UID: "0c5387f0-a0fe-4f69-b01f-710049543ef0"). InnerVolumeSpecName "kube-api-access-5t5fz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:49:46.056216 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.056188 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-util" pod "0c5387f0-a0fe-4f69-b01f-710049543ef0" (UID: "0c5387f0-a0fe-4f69-b01f-710049543ef0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:49:46.147314 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.147226 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t5fz\" (UniqueName: \"kubernetes.io/projected/0c5387f0-a0fe-4f69-b01f-710049543ef0-kube-api-access-5t5fz\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:49:46.147314 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.147251 4955 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-util\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:49:46.147314 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.147276 4955 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c5387f0-a0fe-4f69-b01f-710049543ef0-bundle\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:49:46.849499 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.849474 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" Nov 04 04:49:46.849883 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.849476 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmrbdq" event={"ID":"0c5387f0-a0fe-4f69-b01f-710049543ef0","Type":"ContainerDied","Data":"e6bb95e7d9d0b43053eabc2d12f5058c831b02c56262ac1138e66b26ea1d55aa"} Nov 04 04:49:46.849883 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.849590 4955 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6bb95e7d9d0b43053eabc2d12f5058c831b02c56262ac1138e66b26ea1d55aa" Nov 04 04:49:46.855245 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.855218 4955 generic.go:356] "Generic (PLEG): container finished" podID="641034fd-7ead-4c9e-b29c-251654b217dd" containerID="b7a50623d25d8e51a3b338087332edd1f3d4b23eeb1699533b0cd921886db021" exitCode=0 Nov 04 04:49:46.855398 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.855285 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" event={"ID":"641034fd-7ead-4c9e-b29c-251654b217dd","Type":"ContainerDied","Data":"b7a50623d25d8e51a3b338087332edd1f3d4b23eeb1699533b0cd921886db021"} Nov 04 04:49:46.857537 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.857517 4955 generic.go:356] "Generic (PLEG): container finished" podID="dba16387-cb12-46a5-9269-904e24f0abb5" containerID="a60f095680a963d744ffb21605bccbccb01b8fd9334f85fd25733aa2f2ee95ff" exitCode=0 Nov 04 04:49:46.857650 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.857578 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" event={"ID":"dba16387-cb12-46a5-9269-904e24f0abb5","Type":"ContainerDied","Data":"a60f095680a963d744ffb21605bccbccb01b8fd9334f85fd25733aa2f2ee95ff"} Nov 04 04:49:46.971123 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:46.971097 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:47.054163 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:47.054138 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74f260aa-fea1-46a1-b37f-8e29cff3cca5-kube-api-access-gjrjs\" (UniqueName: \"kubernetes.io/projected/74f260aa-fea1-46a1-b37f-8e29cff3cca5-kube-api-access-gjrjs\") pod \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\" (UID: \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\") " Nov 04 04:49:47.054244 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:47.054205 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-bundle\" (UniqueName: \"kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-bundle\") pod \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\" (UID: \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\") " Nov 04 04:49:47.054387 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:47.054369 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-util\" (UniqueName: \"kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-util\") pod \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\" (UID: \"74f260aa-fea1-46a1-b37f-8e29cff3cca5\") " Nov 04 04:49:47.054900 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:47.054879 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-bundle" pod "74f260aa-fea1-46a1-b37f-8e29cff3cca5" (UID: "74f260aa-fea1-46a1-b37f-8e29cff3cca5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:49:47.056186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:47.056167 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74f260aa-fea1-46a1-b37f-8e29cff3cca5-kube-api-access-gjrjs" pod "74f260aa-fea1-46a1-b37f-8e29cff3cca5" (UID: "74f260aa-fea1-46a1-b37f-8e29cff3cca5"). InnerVolumeSpecName "kube-api-access-gjrjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:49:47.059725 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:47.059706 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-util" pod "74f260aa-fea1-46a1-b37f-8e29cff3cca5" (UID: "74f260aa-fea1-46a1-b37f-8e29cff3cca5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:49:47.155481 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:47.155435 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjrjs\" (UniqueName: \"kubernetes.io/projected/74f260aa-fea1-46a1-b37f-8e29cff3cca5-kube-api-access-gjrjs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:49:47.155481 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:47.155456 4955 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-bundle\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:49:47.155481 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:47.155465 4955 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74f260aa-fea1-46a1-b37f-8e29cff3cca5-util\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:49:47.864395 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:47.864356 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" event={"ID":"74f260aa-fea1-46a1-b37f-8e29cff3cca5","Type":"ContainerDied","Data":"fef42becbcf95b50f2a554a5c6913c4afe2b6d61db39989ea70600540893fd29"} Nov 04 04:49:47.864903 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:47.864417 4955 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fef42becbcf95b50f2a554a5c6913c4afe2b6d61db39989ea70600540893fd29" Nov 04 04:49:47.864903 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:47.864368 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ap7trb" Nov 04 04:49:48.012241 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.012221 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:48.014537 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.014520 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:48.062491 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.062468 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-bundle\" (UniqueName: \"kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-bundle\") pod \"641034fd-7ead-4c9e-b29c-251654b217dd\" (UID: \"641034fd-7ead-4c9e-b29c-251654b217dd\") " Nov 04 04:49:48.062589 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.062499 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/641034fd-7ead-4c9e-b29c-251654b217dd-kube-api-access-6pdnb\" (UniqueName: \"kubernetes.io/projected/641034fd-7ead-4c9e-b29c-251654b217dd-kube-api-access-6pdnb\") pod \"641034fd-7ead-4c9e-b29c-251654b217dd\" (UID: \"641034fd-7ead-4c9e-b29c-251654b217dd\") " Nov 04 04:49:48.062589 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.062526 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-util\" (UniqueName: \"kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-util\") pod \"dba16387-cb12-46a5-9269-904e24f0abb5\" (UID: \"dba16387-cb12-46a5-9269-904e24f0abb5\") " Nov 04 04:49:48.062589 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.062556 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-bundle\" (UniqueName: \"kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-bundle\") pod \"dba16387-cb12-46a5-9269-904e24f0abb5\" (UID: \"dba16387-cb12-46a5-9269-904e24f0abb5\") " Nov 04 04:49:48.062589 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.062580 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-util\" (UniqueName: \"kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-util\") pod \"641034fd-7ead-4c9e-b29c-251654b217dd\" (UID: \"641034fd-7ead-4c9e-b29c-251654b217dd\") " Nov 04 04:49:48.062794 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.062595 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dba16387-cb12-46a5-9269-904e24f0abb5-kube-api-access-mxm2r\" (UniqueName: \"kubernetes.io/projected/dba16387-cb12-46a5-9269-904e24f0abb5-kube-api-access-mxm2r\") pod \"dba16387-cb12-46a5-9269-904e24f0abb5\" (UID: \"dba16387-cb12-46a5-9269-904e24f0abb5\") " Nov 04 04:49:48.063028 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.062998 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-bundle" pod "641034fd-7ead-4c9e-b29c-251654b217dd" (UID: "641034fd-7ead-4c9e-b29c-251654b217dd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:49:48.063130 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.063089 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-bundle" pod "dba16387-cb12-46a5-9269-904e24f0abb5" (UID: "dba16387-cb12-46a5-9269-904e24f0abb5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:49:48.064817 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.064703 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/641034fd-7ead-4c9e-b29c-251654b217dd-kube-api-access-6pdnb" pod "641034fd-7ead-4c9e-b29c-251654b217dd" (UID: "641034fd-7ead-4c9e-b29c-251654b217dd"). InnerVolumeSpecName "kube-api-access-6pdnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:49:48.064817 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.064789 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dba16387-cb12-46a5-9269-904e24f0abb5-kube-api-access-mxm2r" pod "dba16387-cb12-46a5-9269-904e24f0abb5" (UID: "dba16387-cb12-46a5-9269-904e24f0abb5"). InnerVolumeSpecName "kube-api-access-mxm2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:49:48.066941 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.066914 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-util" pod "dba16387-cb12-46a5-9269-904e24f0abb5" (UID: "dba16387-cb12-46a5-9269-904e24f0abb5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:49:48.068053 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.068033 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-util" pod "641034fd-7ead-4c9e-b29c-251654b217dd" (UID: "641034fd-7ead-4c9e-b29c-251654b217dd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:49:48.163668 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.163637 4955 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-bundle\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:49:48.163788 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.163672 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pdnb\" (UniqueName: \"kubernetes.io/projected/641034fd-7ead-4c9e-b29c-251654b217dd-kube-api-access-6pdnb\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:49:48.163788 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.163688 4955 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-util\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:49:48.163788 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.163702 4955 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dba16387-cb12-46a5-9269-904e24f0abb5-bundle\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:49:48.163788 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.163716 4955 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/641034fd-7ead-4c9e-b29c-251654b217dd-util\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:49:48.163788 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.163728 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxm2r\" (UniqueName: \"kubernetes.io/projected/dba16387-cb12-46a5-9269-904e24f0abb5-kube-api-access-mxm2r\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:49:48.871065 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.871035 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" Nov 04 04:49:48.871519 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.871065 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6g559p" event={"ID":"641034fd-7ead-4c9e-b29c-251654b217dd","Type":"ContainerDied","Data":"5ea8932ed8f68fa9ed269574b898ddd47b02e75c841da0b2e669e34cc4af2667"} Nov 04 04:49:48.871519 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.871119 4955 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ea8932ed8f68fa9ed269574b898ddd47b02e75c841da0b2e669e34cc4af2667" Nov 04 04:49:48.873127 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.873101 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" Nov 04 04:49:48.873248 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.873101 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d779xrd" event={"ID":"dba16387-cb12-46a5-9269-904e24f0abb5","Type":"ContainerDied","Data":"b9e867447420f0863f68d715d8cd7635ce23af0b1a06b79c9e4b5c3eeed03a0e"} Nov 04 04:49:48.873248 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:48.873217 4955 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9e867447420f0863f68d715d8cd7635ce23af0b1a06b79c9e4b5c3eeed03a0e" Nov 04 04:49:51.887074 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887041 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l"] Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887372 4955 cpu_manager.go:414] "containerMap: removing container" podUID="641034fd-7ead-4c9e-b29c-251654b217dd" containerName="extract" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887384 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="641034fd-7ead-4c9e-b29c-251654b217dd" containerName="extract" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887395 4955 cpu_manager.go:414] "containerMap: removing container" podUID="dba16387-cb12-46a5-9269-904e24f0abb5" containerName="extract" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887401 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dba16387-cb12-46a5-9269-904e24f0abb5" containerName="extract" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887412 4955 cpu_manager.go:414] "containerMap: removing container" podUID="641034fd-7ead-4c9e-b29c-251654b217dd" containerName="pull" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887418 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="641034fd-7ead-4c9e-b29c-251654b217dd" containerName="pull" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887431 4955 cpu_manager.go:414] "containerMap: removing container" podUID="0c5387f0-a0fe-4f69-b01f-710049543ef0" containerName="pull" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887438 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c5387f0-a0fe-4f69-b01f-710049543ef0" containerName="pull" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887445 4955 cpu_manager.go:414] "containerMap: removing container" podUID="0c5387f0-a0fe-4f69-b01f-710049543ef0" containerName="extract" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887448 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c5387f0-a0fe-4f69-b01f-710049543ef0" containerName="extract" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887454 4955 cpu_manager.go:414] "containerMap: removing container" podUID="74f260aa-fea1-46a1-b37f-8e29cff3cca5" containerName="extract" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887459 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74f260aa-fea1-46a1-b37f-8e29cff3cca5" containerName="extract" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887467 4955 cpu_manager.go:414] "containerMap: removing container" podUID="74f260aa-fea1-46a1-b37f-8e29cff3cca5" containerName="pull" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887471 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74f260aa-fea1-46a1-b37f-8e29cff3cca5" containerName="pull" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887479 4955 cpu_manager.go:414] "containerMap: removing container" podUID="dba16387-cb12-46a5-9269-904e24f0abb5" containerName="util" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887483 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dba16387-cb12-46a5-9269-904e24f0abb5" containerName="util" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887489 4955 cpu_manager.go:414] "containerMap: removing container" podUID="74f260aa-fea1-46a1-b37f-8e29cff3cca5" containerName="util" Nov 04 04:49:51.887497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887493 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74f260aa-fea1-46a1-b37f-8e29cff3cca5" containerName="util" Nov 04 04:49:51.888062 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887514 4955 cpu_manager.go:414] "containerMap: removing container" podUID="dba16387-cb12-46a5-9269-904e24f0abb5" containerName="pull" Nov 04 04:49:51.888062 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887520 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dba16387-cb12-46a5-9269-904e24f0abb5" containerName="pull" Nov 04 04:49:51.888062 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887529 4955 cpu_manager.go:414] "containerMap: removing container" podUID="641034fd-7ead-4c9e-b29c-251654b217dd" containerName="util" Nov 04 04:49:51.888062 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887533 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="641034fd-7ead-4c9e-b29c-251654b217dd" containerName="util" Nov 04 04:49:51.888062 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887539 4955 cpu_manager.go:414] "containerMap: removing container" podUID="0c5387f0-a0fe-4f69-b01f-710049543ef0" containerName="util" Nov 04 04:49:51.888062 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887543 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c5387f0-a0fe-4f69-b01f-710049543ef0" containerName="util" Nov 04 04:49:51.888062 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887596 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="641034fd-7ead-4c9e-b29c-251654b217dd" containerName="extract" Nov 04 04:49:51.888062 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887605 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="dba16387-cb12-46a5-9269-904e24f0abb5" containerName="extract" Nov 04 04:49:51.888062 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887613 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c5387f0-a0fe-4f69-b01f-710049543ef0" containerName="extract" Nov 04 04:49:51.888062 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.887618 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="74f260aa-fea1-46a1-b37f-8e29cff3cca5" containerName="extract" Nov 04 04:49:51.890913 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.890889 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:51.991715 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.991680 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/61904cdd-775f-4f99-b51c-fc1a1736aae6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:51.991835 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.991725 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdv9m\" (UniqueName: \"kubernetes.io/projected/61904cdd-775f-4f99-b51c-fc1a1736aae6-kube-api-access-jdv9m\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:51.991835 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.991821 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/61904cdd-775f-4f99-b51c-fc1a1736aae6-manifests\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:51.991921 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.991852 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61904cdd-775f-4f99-b51c-fc1a1736aae6-tmp\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:51.991921 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.991872 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61904cdd-775f-4f99-b51c-fc1a1736aae6-webhook-cert\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:51.991996 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:51.991927 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/61904cdd-775f-4f99-b51c-fc1a1736aae6-metrics-cert\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.002343 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.002315 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 04 04:49:52.002457 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.002387 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 04 04:49:52.002457 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.002433 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 04 04:49:52.002550 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.002481 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-jhscp\"" Nov 04 04:49:52.023778 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.023755 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l"] Nov 04 04:49:52.033403 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.033381 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 04 04:49:52.033502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.033489 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 04 04:49:52.092798 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.092772 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/61904cdd-775f-4f99-b51c-fc1a1736aae6-manifests\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.092950 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.092814 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61904cdd-775f-4f99-b51c-fc1a1736aae6-tmp\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.092950 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.092933 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61904cdd-775f-4f99-b51c-fc1a1736aae6-webhook-cert\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.093057 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.092972 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/61904cdd-775f-4f99-b51c-fc1a1736aae6-metrics-cert\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.093057 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.093031 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/61904cdd-775f-4f99-b51c-fc1a1736aae6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.093165 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.093058 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdv9m\" (UniqueName: \"kubernetes.io/projected/61904cdd-775f-4f99-b51c-fc1a1736aae6-kube-api-access-jdv9m\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.093218 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.093202 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/61904cdd-775f-4f99-b51c-fc1a1736aae6-manifests\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.095061 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.095034 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61904cdd-775f-4f99-b51c-fc1a1736aae6-tmp\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.095384 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.095367 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61904cdd-775f-4f99-b51c-fc1a1736aae6-webhook-cert\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.095476 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.095454 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/61904cdd-775f-4f99-b51c-fc1a1736aae6-metrics-cert\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.095513 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.095459 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/61904cdd-775f-4f99-b51c-fc1a1736aae6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.150035 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.149974 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdv9m\" (UniqueName: \"kubernetes.io/projected/61904cdd-775f-4f99-b51c-fc1a1736aae6-kube-api-access-jdv9m\") pod \"opendatahub-operator-controller-manager-546b6bbf6-86t8l\" (UID: \"61904cdd-775f-4f99-b51c-fc1a1736aae6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.203614 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.203593 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:49:52.693950 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.693916 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l"] Nov 04 04:49:52.700773 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:49:52.700747 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61904cdd_775f_4f99_b51c_fc1a1736aae6.slice/crio-24a4cae9e43a72006f0df188cb1beb23995e4c15e0bd59610991899a8718ffb8 WatchSource:0}: Error finding container 24a4cae9e43a72006f0df188cb1beb23995e4c15e0bd59610991899a8718ffb8: Status 404 returned error can't find the container with id 24a4cae9e43a72006f0df188cb1beb23995e4c15e0bd59610991899a8718ffb8 Nov 04 04:49:52.890176 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:52.890141 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" event={"ID":"61904cdd-775f-4f99-b51c-fc1a1736aae6","Type":"ContainerStarted","Data":"24a4cae9e43a72006f0df188cb1beb23995e4c15e0bd59610991899a8718ffb8"} Nov 04 04:49:56.908790 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:56.908754 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" event={"ID":"61904cdd-775f-4f99-b51c-fc1a1736aae6","Type":"ContainerStarted","Data":"3e6707875d553dd1a5d983b0267423055c071accc68518c9f7ef1132375f4446"} Nov 04 04:49:57.914079 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:57.914049 4955 generic.go:356] "Generic (PLEG): container finished" podID="61904cdd-775f-4f99-b51c-fc1a1736aae6" containerID="3e6707875d553dd1a5d983b0267423055c071accc68518c9f7ef1132375f4446" exitCode=0 Nov 04 04:49:57.914486 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:57.914140 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" event={"ID":"61904cdd-775f-4f99-b51c-fc1a1736aae6","Type":"ContainerDied","Data":"3e6707875d553dd1a5d983b0267423055c071accc68518c9f7ef1132375f4446"} Nov 04 04:49:58.189030 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:49:58.188939 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:49:59.925465 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:59.925439 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" event={"ID":"61904cdd-775f-4f99-b51c-fc1a1736aae6","Type":"ContainerStarted","Data":"fc1da92221bdd301d1e9c594a2bdf857e2ee0859b0e1a94707d7647450faf003"} Nov 04 04:49:59.925869 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:49:59.925557 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:50:00.193826 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:00.193735 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" podStartSLOduration=3.613549908 podStartE2EDuration="9.193721707s" totalImagesPullingTime="5.011518217s" totalInitContainerRuntime="568.653582ms" isStatefulPod=false podCreationTimestamp="2026-11-04 04:49:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:50:00.192952543 +0000 UTC m=+250.662778682" watchObservedRunningTime="2026-11-04 04:50:00.193721707 +0000 UTC m=+250.663547844" Nov 04 04:50:06.988460 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:06.988426 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5"] Nov 04 04:50:06.991675 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:06.991660 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5" Nov 04 04:50:07.041697 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.041659 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5"] Nov 04 04:50:07.086070 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.085971 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:50:07.086070 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.085986 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Nov 04 04:50:07.088944 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.088919 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-92zqv\"" Nov 04 04:50:07.108773 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.108738 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53d88b7e-44f6-4bf3-a6ca-df97e48440f8-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5\" (UID: \"53d88b7e-44f6-4bf3-a6ca-df97e48440f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5" Nov 04 04:50:07.108895 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.108825 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbdfc\" (UniqueName: \"kubernetes.io/projected/53d88b7e-44f6-4bf3-a6ca-df97e48440f8-kube-api-access-pbdfc\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5\" (UID: \"53d88b7e-44f6-4bf3-a6ca-df97e48440f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5" Nov 04 04:50:07.210026 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.209993 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53d88b7e-44f6-4bf3-a6ca-df97e48440f8-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5\" (UID: \"53d88b7e-44f6-4bf3-a6ca-df97e48440f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5" Nov 04 04:50:07.210197 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.210080 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbdfc\" (UniqueName: \"kubernetes.io/projected/53d88b7e-44f6-4bf3-a6ca-df97e48440f8-kube-api-access-pbdfc\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5\" (UID: \"53d88b7e-44f6-4bf3-a6ca-df97e48440f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5" Nov 04 04:50:07.210446 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.210430 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53d88b7e-44f6-4bf3-a6ca-df97e48440f8-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5\" (UID: \"53d88b7e-44f6-4bf3-a6ca-df97e48440f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5" Nov 04 04:50:07.270669 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.270613 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbdfc\" (UniqueName: \"kubernetes.io/projected/53d88b7e-44f6-4bf3-a6ca-df97e48440f8-kube-api-access-pbdfc\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5\" (UID: \"53d88b7e-44f6-4bf3-a6ca-df97e48440f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5" Nov 04 04:50:07.302589 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.302563 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5" Nov 04 04:50:07.738156 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.738126 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5"] Nov 04 04:50:07.961857 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:07.961829 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5" event={"ID":"53d88b7e-44f6-4bf3-a6ca-df97e48440f8","Type":"ContainerStarted","Data":"283c4b478abe17bc7d7abe303964252522fd7103d6c6729736adc32b47a5ad7c"} Nov 04 04:50:10.932808 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:10.932780 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-546b6bbf6-86t8l" Nov 04 04:50:11.983307 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:11.983209 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5" event={"ID":"53d88b7e-44f6-4bf3-a6ca-df97e48440f8","Type":"ContainerStarted","Data":"b4513227b713c78555d1b716bc8c8e89ac8ef4e9f962085adc263c6b8664ddd1"} Nov 04 04:50:12.097174 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:12.097120 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-7k6l5" podStartSLOduration=2.192768545 podStartE2EDuration="6.09710619s" totalImagesPullingTime="3.904337645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:50:12.095615747 +0000 UTC m=+262.565441886" watchObservedRunningTime="2026-11-04 04:50:12.09710619 +0000 UTC m=+262.566932329" Nov 04 04:50:13.279721 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.279682 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh"] Nov 04 04:50:13.283841 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.283819 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" Nov 04 04:50:13.360540 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.360510 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 04 04:50:13.363000 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.362970 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55sjm\" (UniqueName: \"kubernetes.io/projected/89129242-266c-4915-a204-361e2061eb0d-kube-api-access-55sjm\") pod \"kuadrant-operator-controller-manager-cf8469d7b-xlrqh\" (UID: \"89129242-266c-4915-a204-361e2061eb0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" Nov 04 04:50:13.363108 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.363076 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89129242-266c-4915-a204-361e2061eb0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-xlrqh\" (UID: \"89129242-266c-4915-a204-361e2061eb0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" Nov 04 04:50:13.397195 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.397172 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 04 04:50:13.397318 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.397290 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4gq99\"" Nov 04 04:50:13.398909 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.398893 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh"] Nov 04 04:50:13.463660 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.463633 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55sjm\" (UniqueName: \"kubernetes.io/projected/89129242-266c-4915-a204-361e2061eb0d-kube-api-access-55sjm\") pod \"kuadrant-operator-controller-manager-cf8469d7b-xlrqh\" (UID: \"89129242-266c-4915-a204-361e2061eb0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" Nov 04 04:50:13.463772 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.463681 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89129242-266c-4915-a204-361e2061eb0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-xlrqh\" (UID: \"89129242-266c-4915-a204-361e2061eb0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" Nov 04 04:50:13.468284 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.464561 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89129242-266c-4915-a204-361e2061eb0d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-xlrqh\" (UID: \"89129242-266c-4915-a204-361e2061eb0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" Nov 04 04:50:13.524113 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.524079 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55sjm\" (UniqueName: \"kubernetes.io/projected/89129242-266c-4915-a204-361e2061eb0d-kube-api-access-55sjm\") pod \"kuadrant-operator-controller-manager-cf8469d7b-xlrqh\" (UID: \"89129242-266c-4915-a204-361e2061eb0d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" Nov 04 04:50:13.597074 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:13.597039 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" Nov 04 04:50:14.092295 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:14.092247 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh"] Nov 04 04:50:14.099410 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:50:14.099381 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89129242_266c_4915_a204_361e2061eb0d.slice/crio-c1effe4d938a582405f31880f96376078bbe1bd1e800bff699e7ebc00d0266a9 WatchSource:0}: Error finding container c1effe4d938a582405f31880f96376078bbe1bd1e800bff699e7ebc00d0266a9: Status 404 returned error can't find the container with id c1effe4d938a582405f31880f96376078bbe1bd1e800bff699e7ebc00d0266a9 Nov 04 04:50:14.997837 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:14.997803 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" event={"ID":"89129242-266c-4915-a204-361e2061eb0d","Type":"ContainerStarted","Data":"c1effe4d938a582405f31880f96376078bbe1bd1e800bff699e7ebc00d0266a9"} Nov 04 04:50:18.577009 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:18.576972 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l"] Nov 04 04:50:18.579921 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:18.579886 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l" Nov 04 04:50:18.680009 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:18.679977 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-srx7z\"" Nov 04 04:50:18.681727 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:18.681701 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l"] Nov 04 04:50:18.717124 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:18.717086 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87hwb\" (UniqueName: \"kubernetes.io/projected/33799f24-67f2-4fdc-b095-849edfb41a91-kube-api-access-87hwb\") pod \"limitador-operator-controller-manager-5778bb4449-fmp4l\" (UID: \"33799f24-67f2-4fdc-b095-849edfb41a91\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l" Nov 04 04:50:18.818324 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:18.818286 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87hwb\" (UniqueName: \"kubernetes.io/projected/33799f24-67f2-4fdc-b095-849edfb41a91-kube-api-access-87hwb\") pod \"limitador-operator-controller-manager-5778bb4449-fmp4l\" (UID: \"33799f24-67f2-4fdc-b095-849edfb41a91\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l" Nov 04 04:50:18.882855 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:18.882790 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87hwb\" (UniqueName: \"kubernetes.io/projected/33799f24-67f2-4fdc-b095-849edfb41a91-kube-api-access-87hwb\") pod \"limitador-operator-controller-manager-5778bb4449-fmp4l\" (UID: \"33799f24-67f2-4fdc-b095-849edfb41a91\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l" Nov 04 04:50:18.893471 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:18.893450 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l" Nov 04 04:50:19.266600 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:19.266531 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l"] Nov 04 04:50:19.274467 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:50:19.274437 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33799f24_67f2_4fdc_b095_849edfb41a91.slice/crio-e9704cab9cc5a6085382111691d9a909753944f1e47045992bffa7f5e419b137 WatchSource:0}: Error finding container e9704cab9cc5a6085382111691d9a909753944f1e47045992bffa7f5e419b137: Status 404 returned error can't find the container with id e9704cab9cc5a6085382111691d9a909753944f1e47045992bffa7f5e419b137 Nov 04 04:50:20.027978 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:20.027945 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l" event={"ID":"33799f24-67f2-4fdc-b095-849edfb41a91","Type":"ContainerStarted","Data":"e9704cab9cc5a6085382111691d9a909753944f1e47045992bffa7f5e419b137"} Nov 04 04:50:21.033378 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:21.033346 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" event={"ID":"89129242-266c-4915-a204-361e2061eb0d","Type":"ContainerStarted","Data":"fec8266b506e2097a4053df6fe2978201e03ab45cfea8a0e9bc87dcdb7947284"} Nov 04 04:50:21.033767 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:21.033584 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" Nov 04 04:50:21.240555 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:21.240509 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" podStartSLOduration=2.25738196 podStartE2EDuration="8.240497045s" totalImagesPullingTime="5.983115085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:50:21.194478886 +0000 UTC m=+271.664305023" watchObservedRunningTime="2026-11-04 04:50:21.240497045 +0000 UTC m=+271.710323184" Nov 04 04:50:22.682257 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:22.682221 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd"] Nov 04 04:50:22.685405 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:22.685380 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd" Nov 04 04:50:22.750001 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:22.749970 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngd5l\" (UniqueName: \"kubernetes.io/projected/1645650e-6b70-4490-afc7-c0a5a01cb0a2-kube-api-access-ngd5l\") pod \"authorino-operator-7b7bb4bc77-tsjpd\" (UID: \"1645650e-6b70-4490-afc7-c0a5a01cb0a2\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd" Nov 04 04:50:22.780112 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:22.780087 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ngtx7\"" Nov 04 04:50:22.782190 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:22.782168 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd"] Nov 04 04:50:22.850698 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:22.850675 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngd5l\" (UniqueName: \"kubernetes.io/projected/1645650e-6b70-4490-afc7-c0a5a01cb0a2-kube-api-access-ngd5l\") pod \"authorino-operator-7b7bb4bc77-tsjpd\" (UID: \"1645650e-6b70-4490-afc7-c0a5a01cb0a2\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd" Nov 04 04:50:22.910549 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:22.910523 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngd5l\" (UniqueName: \"kubernetes.io/projected/1645650e-6b70-4490-afc7-c0a5a01cb0a2-kube-api-access-ngd5l\") pod \"authorino-operator-7b7bb4bc77-tsjpd\" (UID: \"1645650e-6b70-4490-afc7-c0a5a01cb0a2\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd" Nov 04 04:50:23.001033 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:23.000972 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd" Nov 04 04:50:23.044091 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:23.044050 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l" event={"ID":"33799f24-67f2-4fdc-b095-849edfb41a91","Type":"ContainerStarted","Data":"ab92c3e63ae70e161b6509351a012e14afce2e48a1286cd36de62040f1b9dbd6"} Nov 04 04:50:23.044278 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:23.044165 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l" Nov 04 04:50:23.152847 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:23.152801 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l" podStartSLOduration=1.685446956 podStartE2EDuration="5.152787352s" totalImagesPullingTime="3.467340396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:50:23.151979551 +0000 UTC m=+273.621805688" watchObservedRunningTime="2026-11-04 04:50:23.152787352 +0000 UTC m=+273.622613489" Nov 04 04:50:23.377588 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:23.377556 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd"] Nov 04 04:50:23.384145 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:50:23.384120 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1645650e_6b70_4490_afc7_c0a5a01cb0a2.slice/crio-893b2cab1489747f3848383846080284f99671c7213a8ab3221553a01cff276a WatchSource:0}: Error finding container 893b2cab1489747f3848383846080284f99671c7213a8ab3221553a01cff276a: Status 404 returned error can't find the container with id 893b2cab1489747f3848383846080284f99671c7213a8ab3221553a01cff276a Nov 04 04:50:24.053020 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:24.052984 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd" event={"ID":"1645650e-6b70-4490-afc7-c0a5a01cb0a2","Type":"ContainerStarted","Data":"893b2cab1489747f3848383846080284f99671c7213a8ab3221553a01cff276a"} Nov 04 04:50:26.122480 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.122444 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7"] Nov 04 04:50:26.125251 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.125225 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.184160 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.184129 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7"] Nov 04 04:50:26.244881 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.244846 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tsw7c\"" Nov 04 04:50:26.278277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.278231 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.278457 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.278288 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.278457 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.278357 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.278457 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.278437 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.278611 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.278519 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.278611 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.278555 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gk2r\" (UniqueName: \"kubernetes.io/projected/28edcd93-5c3d-4846-947c-77e9f61e5bf6-kube-api-access-7gk2r\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.278611 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.278589 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.278752 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.278626 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.278795 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.278739 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.379497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.379409 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.379497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.379457 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.379497 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.379494 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.379725 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.379510 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.379725 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.379543 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.379725 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.379577 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.379725 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.379598 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.379725 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.379618 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gk2r\" (UniqueName: \"kubernetes.io/projected/28edcd93-5c3d-4846-947c-77e9f61e5bf6-kube-api-access-7gk2r\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.379725 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.379644 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.379901 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.379808 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.379989 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.379965 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.380329 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.380284 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.380705 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.380683 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.380941 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.380918 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.382486 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.382463 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.382730 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.382710 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.438690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.438653 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28edcd93-5c3d-4846-947c-77e9f61e5bf6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.438845 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.438823 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gk2r\" (UniqueName: \"kubernetes.io/projected/28edcd93-5c3d-4846-947c-77e9f61e5bf6-kube-api-access-7gk2r\") pod \"data-science-gateway-data-science-gateway-class-669569fcd5t6vk7\" (UID: \"28edcd93-5c3d-4846-947c-77e9f61e5bf6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:26.737560 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:26.737471 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:27.070118 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:27.070087 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd" event={"ID":"1645650e-6b70-4490-afc7-c0a5a01cb0a2","Type":"ContainerStarted","Data":"c413166b78b2887c36210b759f5bd0aebf0f08cea3b7304b5e80ca1987c51314"} Nov 04 04:50:27.070304 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:27.070172 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd" Nov 04 04:50:27.184041 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:27.184005 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7"] Nov 04 04:50:27.189734 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:50:27.189705 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28edcd93_5c3d_4846_947c_77e9f61e5bf6.slice/crio-1671972b751c3c540af30334ad8ac57398b0f15408f1a73d09a1d24059e6894c WatchSource:0}: Error finding container 1671972b751c3c540af30334ad8ac57398b0f15408f1a73d09a1d24059e6894c: Status 404 returned error can't find the container with id 1671972b751c3c540af30334ad8ac57398b0f15408f1a73d09a1d24059e6894c Nov 04 04:50:27.191866 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:27.191811 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:50:27.191978 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:27.191895 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:50:27.191978 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:27.191940 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:50:27.229519 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:27.229471 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd" podStartSLOduration=2.12421973 podStartE2EDuration="5.229457398s" totalImagesPullingTime="3.105237668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:50:27.199812495 +0000 UTC m=+277.669638643" watchObservedRunningTime="2026-11-04 04:50:27.229457398 +0000 UTC m=+277.699283535" Nov 04 04:50:27.937347 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:27.937317 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7"] Nov 04 04:50:27.977174 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:27.977147 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" Nov 04 04:50:27.993619 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:27.993597 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7"] Nov 04 04:50:28.025901 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.025873 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-snt8z\"" Nov 04 04:50:28.026021 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.025912 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Nov 04 04:50:28.026021 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.025934 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Nov 04 04:50:28.078983 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.078942 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" event={"ID":"28edcd93-5c3d-4846-947c-77e9f61e5bf6","Type":"ContainerStarted","Data":"6d06901e7bc27112abb18b8b69be24bcec9c461293e76a019ffb0910e00ad636"} Nov 04 04:50:28.079126 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.079002 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" event={"ID":"28edcd93-5c3d-4846-947c-77e9f61e5bf6","Type":"ContainerStarted","Data":"1671972b751c3c540af30334ad8ac57398b0f15408f1a73d09a1d24059e6894c"} Nov 04 04:50:28.095000 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.094975 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0f6fb1ad-822f-4305-8321-fc6c580014bf-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-4bcz7\" (UID: \"0f6fb1ad-822f-4305-8321-fc6c580014bf\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" Nov 04 04:50:28.095123 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.095021 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqg76\" (UniqueName: \"kubernetes.io/projected/0f6fb1ad-822f-4305-8321-fc6c580014bf-kube-api-access-fqg76\") pod \"kuadrant-console-plugin-66c4fb575d-4bcz7\" (UID: \"0f6fb1ad-822f-4305-8321-fc6c580014bf\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" Nov 04 04:50:28.095123 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.095049 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f6fb1ad-822f-4305-8321-fc6c580014bf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-4bcz7\" (UID: \"0f6fb1ad-822f-4305-8321-fc6c580014bf\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" Nov 04 04:50:28.189377 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:50:28.189292 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:50:28.195831 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.195805 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqg76\" (UniqueName: \"kubernetes.io/projected/0f6fb1ad-822f-4305-8321-fc6c580014bf-kube-api-access-fqg76\") pod \"kuadrant-console-plugin-66c4fb575d-4bcz7\" (UID: \"0f6fb1ad-822f-4305-8321-fc6c580014bf\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" Nov 04 04:50:28.195961 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.195865 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f6fb1ad-822f-4305-8321-fc6c580014bf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-4bcz7\" (UID: \"0f6fb1ad-822f-4305-8321-fc6c580014bf\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" Nov 04 04:50:28.196968 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.196142 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0f6fb1ad-822f-4305-8321-fc6c580014bf-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-4bcz7\" (UID: \"0f6fb1ad-822f-4305-8321-fc6c580014bf\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" Nov 04 04:50:28.197098 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.197080 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0f6fb1ad-822f-4305-8321-fc6c580014bf-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-4bcz7\" (UID: \"0f6fb1ad-822f-4305-8321-fc6c580014bf\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" Nov 04 04:50:28.197484 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.197446 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" podStartSLOduration=2.197434063 podStartE2EDuration="2.197434063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:50:28.196944224 +0000 UTC m=+278.666770362" watchObservedRunningTime="2026-11-04 04:50:28.197434063 +0000 UTC m=+278.667260200" Nov 04 04:50:28.198518 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.198496 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f6fb1ad-822f-4305-8321-fc6c580014bf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-4bcz7\" (UID: \"0f6fb1ad-822f-4305-8321-fc6c580014bf\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" Nov 04 04:50:28.252574 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.252552 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqg76\" (UniqueName: \"kubernetes.io/projected/0f6fb1ad-822f-4305-8321-fc6c580014bf-kube-api-access-fqg76\") pod \"kuadrant-console-plugin-66c4fb575d-4bcz7\" (UID: \"0f6fb1ad-822f-4305-8321-fc6c580014bf\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" Nov 04 04:50:28.322771 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.322744 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" Nov 04 04:50:28.687971 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.687939 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7"] Nov 04 04:50:28.695064 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:50:28.695036 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f6fb1ad_822f_4305_8321_fc6c580014bf.slice/crio-4aea3c85c7e6ae5928aabccbbd98c8ccd3e2be141526cf63c4b0e6c7ccabacb7 WatchSource:0}: Error finding container 4aea3c85c7e6ae5928aabccbbd98c8ccd3e2be141526cf63c4b0e6c7ccabacb7: Status 404 returned error can't find the container with id 4aea3c85c7e6ae5928aabccbbd98c8ccd3e2be141526cf63c4b0e6c7ccabacb7 Nov 04 04:50:28.738470 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.738444 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:28.743372 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:28.743348 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:29.085128 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:29.085092 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" event={"ID":"0f6fb1ad-822f-4305-8321-fc6c580014bf","Type":"ContainerStarted","Data":"4aea3c85c7e6ae5928aabccbbd98c8ccd3e2be141526cf63c4b0e6c7ccabacb7"} Nov 04 04:50:29.085413 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:29.085294 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:29.086199 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:29.086183 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-669569fcd5t6vk7" Nov 04 04:50:32.039977 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:32.039951 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" Nov 04 04:50:34.055752 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:34.055721 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-fmp4l" Nov 04 04:50:37.130470 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:37.130379 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" event={"ID":"0f6fb1ad-822f-4305-8321-fc6c580014bf","Type":"ContainerStarted","Data":"5ec6d92cda617218336cf0d89a7cc283c0328752035938b0506ac0363b888912"} Nov 04 04:50:37.238278 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:37.238214 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-4bcz7" podStartSLOduration=2.076567931 podStartE2EDuration="10.238198914s" totalImagesPullingTime="8.161630983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:50:37.23657814 +0000 UTC m=+287.706404277" watchObservedRunningTime="2026-11-04 04:50:37.238198914 +0000 UTC m=+287.708025051" Nov 04 04:50:38.081699 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:38.081669 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-tsjpd" Nov 04 04:50:43.710235 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:43.710201 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-frbgv"] Nov 04 04:50:43.719634 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:43.719615 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" Nov 04 04:50:43.768022 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:43.767997 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Nov 04 04:50:43.777074 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:43.777051 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-frbgv"] Nov 04 04:50:43.829183 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:43.829156 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5wsb\" (UniqueName: \"kubernetes.io/projected/973fe6d2-5f7d-4748-a782-414969d00807-kube-api-access-d5wsb\") pod \"limitador-limitador-74dfcfb894-frbgv\" (UID: \"973fe6d2-5f7d-4748-a782-414969d00807\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" Nov 04 04:50:43.829322 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:43.829257 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/973fe6d2-5f7d-4748-a782-414969d00807-config-file\") pod \"limitador-limitador-74dfcfb894-frbgv\" (UID: \"973fe6d2-5f7d-4748-a782-414969d00807\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" Nov 04 04:50:43.930253 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:43.930226 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wsb\" (UniqueName: \"kubernetes.io/projected/973fe6d2-5f7d-4748-a782-414969d00807-kube-api-access-d5wsb\") pod \"limitador-limitador-74dfcfb894-frbgv\" (UID: \"973fe6d2-5f7d-4748-a782-414969d00807\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" Nov 04 04:50:43.930368 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:43.930343 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/973fe6d2-5f7d-4748-a782-414969d00807-config-file\") pod \"limitador-limitador-74dfcfb894-frbgv\" (UID: \"973fe6d2-5f7d-4748-a782-414969d00807\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" Nov 04 04:50:43.930903 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:43.930886 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/973fe6d2-5f7d-4748-a782-414969d00807-config-file\") pod \"limitador-limitador-74dfcfb894-frbgv\" (UID: \"973fe6d2-5f7d-4748-a782-414969d00807\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" Nov 04 04:50:43.960326 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:43.960255 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-frbgv"] Nov 04 04:50:43.987280 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:43.987234 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5wsb\" (UniqueName: \"kubernetes.io/projected/973fe6d2-5f7d-4748-a782-414969d00807-kube-api-access-d5wsb\") pod \"limitador-limitador-74dfcfb894-frbgv\" (UID: \"973fe6d2-5f7d-4748-a782-414969d00807\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" Nov 04 04:50:44.046951 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:44.046919 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" Nov 04 04:50:44.411742 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:44.411712 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-frbgv"] Nov 04 04:50:44.418859 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:50:44.418836 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973fe6d2_5f7d_4748_a782_414969d00807.slice/crio-365b4446745ae0b0fb4d2897ea6c5da01d64d90bc8a03adfb1a511bf86515e47 WatchSource:0}: Error finding container 365b4446745ae0b0fb4d2897ea6c5da01d64d90bc8a03adfb1a511bf86515e47: Status 404 returned error can't find the container with id 365b4446745ae0b0fb4d2897ea6c5da01d64d90bc8a03adfb1a511bf86515e47 Nov 04 04:50:45.168869 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:45.168832 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" event={"ID":"973fe6d2-5f7d-4748-a782-414969d00807","Type":"ContainerStarted","Data":"365b4446745ae0b0fb4d2897ea6c5da01d64d90bc8a03adfb1a511bf86515e47"} Nov 04 04:50:47.179522 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:47.179484 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" event={"ID":"973fe6d2-5f7d-4748-a782-414969d00807","Type":"ContainerStarted","Data":"822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d"} Nov 04 04:50:47.179946 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:47.179567 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" Nov 04 04:50:47.295047 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:47.294988 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" podStartSLOduration=2.028636849 podStartE2EDuration="4.294973294s" totalImagesPullingTime="2.266336445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:50:47.293887639 +0000 UTC m=+297.763713779" watchObservedRunningTime="2026-11-04 04:50:47.294973294 +0000 UTC m=+297.764799434" Nov 04 04:50:49.671625 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:49.671599 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/2.log" Nov 04 04:50:49.672878 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:49.672850 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/2.log" Nov 04 04:50:52.072927 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:52.072894 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-54b89"] Nov 04 04:50:52.078394 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:52.078371 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-54b89" Nov 04 04:50:52.091565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:52.091543 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ldb7\" (UniqueName: \"kubernetes.io/projected/0aa8361b-d811-4280-a8cf-4005fecb74da-kube-api-access-8ldb7\") pod \"authorino-56c6c9ddd5-54b89\" (UID: \"0aa8361b-d811-4280-a8cf-4005fecb74da\") " pod="kuadrant-system/authorino-56c6c9ddd5-54b89" Nov 04 04:50:52.129131 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:52.129095 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-54b89"] Nov 04 04:50:52.129489 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:52.129466 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6gwpp\"" Nov 04 04:50:52.192803 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:52.192781 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ldb7\" (UniqueName: \"kubernetes.io/projected/0aa8361b-d811-4280-a8cf-4005fecb74da-kube-api-access-8ldb7\") pod \"authorino-56c6c9ddd5-54b89\" (UID: \"0aa8361b-d811-4280-a8cf-4005fecb74da\") " pod="kuadrant-system/authorino-56c6c9ddd5-54b89" Nov 04 04:50:52.252726 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:52.252698 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ldb7\" (UniqueName: \"kubernetes.io/projected/0aa8361b-d811-4280-a8cf-4005fecb74da-kube-api-access-8ldb7\") pod \"authorino-56c6c9ddd5-54b89\" (UID: \"0aa8361b-d811-4280-a8cf-4005fecb74da\") " pod="kuadrant-system/authorino-56c6c9ddd5-54b89" Nov 04 04:50:52.387896 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:52.387829 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-54b89" Nov 04 04:50:52.754215 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:52.754139 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-54b89"] Nov 04 04:50:52.761120 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:50:52.761093 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0aa8361b_d811_4280_a8cf_4005fecb74da.slice/crio-6e0645b24e77fb06f63a0fb1d7ed4968ffebbd0261ba2259171f74ed26df833a WatchSource:0}: Error finding container 6e0645b24e77fb06f63a0fb1d7ed4968ffebbd0261ba2259171f74ed26df833a: Status 404 returned error can't find the container with id 6e0645b24e77fb06f63a0fb1d7ed4968ffebbd0261ba2259171f74ed26df833a Nov 04 04:50:52.762831 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:52.762813 4955 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 04:50:53.207653 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:53.207623 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-54b89" event={"ID":"0aa8361b-d811-4280-a8cf-4005fecb74da","Type":"ContainerStarted","Data":"6e0645b24e77fb06f63a0fb1d7ed4968ffebbd0261ba2259171f74ed26df833a"} Nov 04 04:50:54.997641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:54.997607 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh"] Nov 04 04:50:54.998074 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:54.997885 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" podUID="89129242-266c-4915-a204-361e2061eb0d" containerName="manager" containerID="cri-o://fec8266b506e2097a4053df6fe2978201e03ab45cfea8a0e9bc87dcdb7947284" gracePeriod=10 Nov 04 04:50:55.218022 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:55.217993 4955 generic.go:356] "Generic (PLEG): container finished" podID="89129242-266c-4915-a204-361e2061eb0d" containerID="fec8266b506e2097a4053df6fe2978201e03ab45cfea8a0e9bc87dcdb7947284" exitCode=0 Nov 04 04:50:55.218176 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:55.218075 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" event={"ID":"89129242-266c-4915-a204-361e2061eb0d","Type":"ContainerDied","Data":"fec8266b506e2097a4053df6fe2978201e03ab45cfea8a0e9bc87dcdb7947284"} Nov 04 04:50:55.246498 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:55.246474 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" Nov 04 04:50:55.317581 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:55.317551 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89129242-266c-4915-a204-361e2061eb0d-kube-api-access-55sjm\" (UniqueName: \"kubernetes.io/projected/89129242-266c-4915-a204-361e2061eb0d-kube-api-access-55sjm\") pod \"89129242-266c-4915-a204-361e2061eb0d\" (UID: \"89129242-266c-4915-a204-361e2061eb0d\") " Nov 04 04:50:55.317708 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:55.317659 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89129242-266c-4915-a204-361e2061eb0d-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89129242-266c-4915-a204-361e2061eb0d-extensions-socket-volume\") pod \"89129242-266c-4915-a204-361e2061eb0d\" (UID: \"89129242-266c-4915-a204-361e2061eb0d\") " Nov 04 04:50:55.318006 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:55.317985 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89129242-266c-4915-a204-361e2061eb0d-extensions-socket-volume" pod "89129242-266c-4915-a204-361e2061eb0d" (UID: "89129242-266c-4915-a204-361e2061eb0d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:50:55.320030 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:55.319995 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89129242-266c-4915-a204-361e2061eb0d-kube-api-access-55sjm" pod "89129242-266c-4915-a204-361e2061eb0d" (UID: "89129242-266c-4915-a204-361e2061eb0d"). InnerVolumeSpecName "kube-api-access-55sjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:50:55.418858 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:55.418819 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55sjm\" (UniqueName: \"kubernetes.io/projected/89129242-266c-4915-a204-361e2061eb0d-kube-api-access-55sjm\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:50:55.418858 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:55.418857 4955 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89129242-266c-4915-a204-361e2061eb0d-extensions-socket-volume\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:50:56.224186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:56.224150 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-54b89" event={"ID":"0aa8361b-d811-4280-a8cf-4005fecb74da","Type":"ContainerStarted","Data":"a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791"} Nov 04 04:50:56.225674 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:56.225655 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" Nov 04 04:50:56.225787 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:56.225649 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh" event={"ID":"89129242-266c-4915-a204-361e2061eb0d","Type":"ContainerDied","Data":"c1effe4d938a582405f31880f96376078bbe1bd1e800bff699e7ebc00d0266a9"} Nov 04 04:50:56.225830 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:56.225787 4955 scope.go:122] "RemoveContainer" containerID="fec8266b506e2097a4053df6fe2978201e03ab45cfea8a0e9bc87dcdb7947284" Nov 04 04:50:56.335985 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:56.335937 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-54b89" podStartSLOduration=1.254922099 podStartE2EDuration="4.335919321s" totalImagesPullingTime="3.080997222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:50:56.335101515 +0000 UTC m=+306.804927652" watchObservedRunningTime="2026-11-04 04:50:56.335919321 +0000 UTC m=+306.805745457" Nov 04 04:50:56.445623 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:56.445589 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh"] Nov 04 04:50:56.491823 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:56.491755 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-xlrqh"] Nov 04 04:50:57.654405 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:57.654375 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="89129242-266c-4915-a204-361e2061eb0d" path="/var/lib/kubelet/pods/89129242-266c-4915-a204-361e2061eb0d/volumes" Nov 04 04:50:58.185841 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:50:58.185811 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" Nov 04 04:50:58.188564 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:50:58.188534 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:51:02.689845 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:02.689776 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-frbgv"] Nov 04 04:51:02.690333 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:02.689976 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" podUID="973fe6d2-5f7d-4748-a782-414969d00807" containerName="limitador" containerID="cri-o://822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d" gracePeriod=30 Nov 04 04:51:03.234801 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.234779 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" Nov 04 04:51:03.259694 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.259626 4955 generic.go:356] "Generic (PLEG): container finished" podID="973fe6d2-5f7d-4748-a782-414969d00807" containerID="822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d" exitCode=0 Nov 04 04:51:03.259694 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.259670 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" Nov 04 04:51:03.259878 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.259709 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" event={"ID":"973fe6d2-5f7d-4748-a782-414969d00807","Type":"ContainerDied","Data":"822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d"} Nov 04 04:51:03.259878 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.259775 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-frbgv" event={"ID":"973fe6d2-5f7d-4748-a782-414969d00807","Type":"ContainerDied","Data":"365b4446745ae0b0fb4d2897ea6c5da01d64d90bc8a03adfb1a511bf86515e47"} Nov 04 04:51:03.259878 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.259803 4955 scope.go:122] "RemoveContainer" containerID="822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d" Nov 04 04:51:03.267896 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.267877 4955 scope.go:122] "RemoveContainer" containerID="822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d" Nov 04 04:51:03.268159 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:51:03.268143 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d\": container with ID starting with 822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d not found: ID does not exist" containerID="822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d" Nov 04 04:51:03.268210 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.268167 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d"} err="failed to get container status \"822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d\": rpc error: code = NotFound desc = could not find container \"822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d\": container with ID starting with 822aa0304c5b9b14b982874b1715bf24a5b7ca1676bfad3eb3e520f995e3065d not found: ID does not exist" Nov 04 04:51:03.286538 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.286512 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/973fe6d2-5f7d-4748-a782-414969d00807-kube-api-access-d5wsb\" (UniqueName: \"kubernetes.io/projected/973fe6d2-5f7d-4748-a782-414969d00807-kube-api-access-d5wsb\") pod \"973fe6d2-5f7d-4748-a782-414969d00807\" (UID: \"973fe6d2-5f7d-4748-a782-414969d00807\") " Nov 04 04:51:03.286647 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.286554 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/973fe6d2-5f7d-4748-a782-414969d00807-config-file\" (UniqueName: \"kubernetes.io/configmap/973fe6d2-5f7d-4748-a782-414969d00807-config-file\") pod \"973fe6d2-5f7d-4748-a782-414969d00807\" (UID: \"973fe6d2-5f7d-4748-a782-414969d00807\") " Nov 04 04:51:03.286915 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.286894 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/973fe6d2-5f7d-4748-a782-414969d00807-config-file" pod "973fe6d2-5f7d-4748-a782-414969d00807" (UID: "973fe6d2-5f7d-4748-a782-414969d00807"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:51:03.288722 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.288694 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/973fe6d2-5f7d-4748-a782-414969d00807-kube-api-access-d5wsb" pod "973fe6d2-5f7d-4748-a782-414969d00807" (UID: "973fe6d2-5f7d-4748-a782-414969d00807"). InnerVolumeSpecName "kube-api-access-d5wsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:51:03.387769 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.387741 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5wsb\" (UniqueName: \"kubernetes.io/projected/973fe6d2-5f7d-4748-a782-414969d00807-kube-api-access-d5wsb\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:51:03.387769 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.387765 4955 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/973fe6d2-5f7d-4748-a782-414969d00807-config-file\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:51:03.670777 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.670745 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-frbgv"] Nov 04 04:51:03.674428 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:03.674404 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-frbgv"] Nov 04 04:51:05.653889 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:05.653855 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="973fe6d2-5f7d-4748-a782-414969d00807" path="/var/lib/kubelet/pods/973fe6d2-5f7d-4748-a782-414969d00807/volumes" Nov 04 04:51:17.512828 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.512797 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv"] Nov 04 04:51:17.513279 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.513149 4955 cpu_manager.go:414] "containerMap: removing container" podUID="973fe6d2-5f7d-4748-a782-414969d00807" containerName="limitador" Nov 04 04:51:17.513279 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.513160 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="973fe6d2-5f7d-4748-a782-414969d00807" containerName="limitador" Nov 04 04:51:17.513279 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.513173 4955 cpu_manager.go:414] "containerMap: removing container" podUID="89129242-266c-4915-a204-361e2061eb0d" containerName="manager" Nov 04 04:51:17.513279 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.513179 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="89129242-266c-4915-a204-361e2061eb0d" containerName="manager" Nov 04 04:51:17.513279 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.513228 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="973fe6d2-5f7d-4748-a782-414969d00807" containerName="limitador" Nov 04 04:51:17.513279 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.513238 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="89129242-266c-4915-a204-361e2061eb0d" containerName="manager" Nov 04 04:51:17.536506 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.536483 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" Nov 04 04:51:17.569340 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.569309 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv"] Nov 04 04:51:17.599510 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.599485 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqz42\" (UniqueName: \"kubernetes.io/projected/c6aada15-f762-42f6-bb97-f32044633262-kube-api-access-sqz42\") pod \"postgres-7cdbf6dc44-9zppv\" (UID: \"c6aada15-f762-42f6-bb97-f32044633262\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" Nov 04 04:51:17.599641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.599563 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6aada15-f762-42f6-bb97-f32044633262-data\") pod \"postgres-7cdbf6dc44-9zppv\" (UID: \"c6aada15-f762-42f6-bb97-f32044633262\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" Nov 04 04:51:17.613401 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.613381 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 04 04:51:17.613534 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.613423 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Nov 04 04:51:17.613584 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.613575 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 04 04:51:17.636017 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.635997 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-mhc4p\"" Nov 04 04:51:17.700505 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.700480 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6aada15-f762-42f6-bb97-f32044633262-data\") pod \"postgres-7cdbf6dc44-9zppv\" (UID: \"c6aada15-f762-42f6-bb97-f32044633262\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" Nov 04 04:51:17.700635 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.700530 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqz42\" (UniqueName: \"kubernetes.io/projected/c6aada15-f762-42f6-bb97-f32044633262-kube-api-access-sqz42\") pod \"postgres-7cdbf6dc44-9zppv\" (UID: \"c6aada15-f762-42f6-bb97-f32044633262\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" Nov 04 04:51:17.700860 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.700826 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c6aada15-f762-42f6-bb97-f32044633262-data\") pod \"postgres-7cdbf6dc44-9zppv\" (UID: \"c6aada15-f762-42f6-bb97-f32044633262\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" Nov 04 04:51:17.757746 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.757720 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqz42\" (UniqueName: \"kubernetes.io/projected/c6aada15-f762-42f6-bb97-f32044633262-kube-api-access-sqz42\") pod \"postgres-7cdbf6dc44-9zppv\" (UID: \"c6aada15-f762-42f6-bb97-f32044633262\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" Nov 04 04:51:17.849827 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:17.849804 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" Nov 04 04:51:18.214086 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:18.214006 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv"] Nov 04 04:51:18.221335 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:51:18.221306 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6aada15_f762_42f6_bb97_f32044633262.slice/crio-ee1890f15837f597efadd80dcdd8e9394db7f56babc572a21ab4431383f92fda WatchSource:0}: Error finding container ee1890f15837f597efadd80dcdd8e9394db7f56babc572a21ab4431383f92fda: Status 404 returned error can't find the container with id ee1890f15837f597efadd80dcdd8e9394db7f56babc572a21ab4431383f92fda Nov 04 04:51:18.331308 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:18.331283 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" event={"ID":"c6aada15-f762-42f6-bb97-f32044633262","Type":"ContainerStarted","Data":"ee1890f15837f597efadd80dcdd8e9394db7f56babc572a21ab4431383f92fda"} Nov 04 04:51:25.366089 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:25.366055 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" event={"ID":"c6aada15-f762-42f6-bb97-f32044633262","Type":"ContainerStarted","Data":"f6165498294b58453bd4dc68c735be082853837958743bbbc73414e063e331bd"} Nov 04 04:51:25.366506 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:25.366144 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" Nov 04 04:51:25.474117 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:25.474021 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" podStartSLOduration=1.56777452 podStartE2EDuration="8.474007664s" totalImagesPullingTime="6.906233144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:25.472721413 +0000 UTC m=+335.942547551" watchObservedRunningTime="2026-11-04 04:51:25.474007664 +0000 UTC m=+335.943833802" Nov 04 04:51:28.190886 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:51:28.190847 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:51:31.400393 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:31.400366 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-9zppv" Nov 04 04:51:38.468218 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.468182 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8b95c9c66-fzccr"] Nov 04 04:51:38.472840 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.472819 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:38.521570 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.521544 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 04 04:51:38.521700 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.521615 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 04 04:51:38.567543 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.567519 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Nov 04 04:51:38.567683 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.567603 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Nov 04 04:51:38.567683 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.567605 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Nov 04 04:51:38.567683 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.567658 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8lbvc\"" Nov 04 04:51:38.569908 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.569887 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-fzccr"] Nov 04 04:51:38.587779 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.587744 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-webhook-cert\") pod \"maas-controller-8b95c9c66-fzccr\" (UID: \"f036ad08-79d6-4efc-a287-ee88fe35d56a\") " pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:38.587912 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.587875 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-metrics-certs\") pod \"maas-controller-8b95c9c66-fzccr\" (UID: \"f036ad08-79d6-4efc-a287-ee88fe35d56a\") " pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:38.587979 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.587931 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sz99\" (UniqueName: \"kubernetes.io/projected/f036ad08-79d6-4efc-a287-ee88fe35d56a-kube-api-access-8sz99\") pod \"maas-controller-8b95c9c66-fzccr\" (UID: \"f036ad08-79d6-4efc-a287-ee88fe35d56a\") " pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:38.688878 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.688840 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-metrics-certs\") pod \"maas-controller-8b95c9c66-fzccr\" (UID: \"f036ad08-79d6-4efc-a287-ee88fe35d56a\") " pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:38.689043 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.688926 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sz99\" (UniqueName: \"kubernetes.io/projected/f036ad08-79d6-4efc-a287-ee88fe35d56a-kube-api-access-8sz99\") pod \"maas-controller-8b95c9c66-fzccr\" (UID: \"f036ad08-79d6-4efc-a287-ee88fe35d56a\") " pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:38.689043 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.688987 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-webhook-cert\") pod \"maas-controller-8b95c9c66-fzccr\" (UID: \"f036ad08-79d6-4efc-a287-ee88fe35d56a\") " pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:38.691375 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.691351 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-webhook-cert\") pod \"maas-controller-8b95c9c66-fzccr\" (UID: \"f036ad08-79d6-4efc-a287-ee88fe35d56a\") " pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:38.691491 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.691407 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-metrics-certs\") pod \"maas-controller-8b95c9c66-fzccr\" (UID: \"f036ad08-79d6-4efc-a287-ee88fe35d56a\") " pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:38.745908 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.745844 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sz99\" (UniqueName: \"kubernetes.io/projected/f036ad08-79d6-4efc-a287-ee88fe35d56a-kube-api-access-8sz99\") pod \"maas-controller-8b95c9c66-fzccr\" (UID: \"f036ad08-79d6-4efc-a287-ee88fe35d56a\") " pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:38.785404 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:38.785377 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:39.159727 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:39.159695 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-fzccr"] Nov 04 04:51:39.166322 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:51:39.166284 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf036ad08_79d6_4efc_a287_ee88fe35d56a.slice/crio-8d91bcda596f1fb6834902c3495ee39c328f1c8c79b0cc6703bed912edce5c9d WatchSource:0}: Error finding container 8d91bcda596f1fb6834902c3495ee39c328f1c8c79b0cc6703bed912edce5c9d: Status 404 returned error can't find the container with id 8d91bcda596f1fb6834902c3495ee39c328f1c8c79b0cc6703bed912edce5c9d Nov 04 04:51:39.435725 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:39.435637 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-fzccr" event={"ID":"f036ad08-79d6-4efc-a287-ee88fe35d56a","Type":"ContainerStarted","Data":"8d91bcda596f1fb6834902c3495ee39c328f1c8c79b0cc6703bed912edce5c9d"} Nov 04 04:51:44.465396 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:44.465356 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-fzccr" event={"ID":"f036ad08-79d6-4efc-a287-ee88fe35d56a","Type":"ContainerStarted","Data":"f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415"} Nov 04 04:51:44.465785 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:44.465506 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:44.589212 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:44.589159 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-8b95c9c66-fzccr" podStartSLOduration=2.101255423 podStartE2EDuration="6.589142314s" totalImagesPullingTime="4.487886891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:44.588287659 +0000 UTC m=+355.058113789" watchObservedRunningTime="2026-11-04 04:51:44.589142314 +0000 UTC m=+355.058968453" Nov 04 04:51:45.402372 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.402336 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-b9psb"] Nov 04 04:51:45.405933 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.405913 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" Nov 04 04:51:45.450780 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.450746 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktwfr\" (UniqueName: \"kubernetes.io/projected/cb3daeaf-3618-4b33-ba7e-4d5a0d06456c-kube-api-access-ktwfr\") pod \"kserve-controller-manager-776cc66d47-b9psb\" (UID: \"cb3daeaf-3618-4b33-ba7e-4d5a0d06456c\") " pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" Nov 04 04:51:45.450917 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.450841 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb3daeaf-3618-4b33-ba7e-4d5a0d06456c-cert\") pod \"kserve-controller-manager-776cc66d47-b9psb\" (UID: \"cb3daeaf-3618-4b33-ba7e-4d5a0d06456c\") " pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" Nov 04 04:51:45.454328 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.454309 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-v86x5\"" Nov 04 04:51:45.454328 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.454316 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Nov 04 04:51:45.460056 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.460034 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-b9psb"] Nov 04 04:51:45.551434 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.551402 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwfr\" (UniqueName: \"kubernetes.io/projected/cb3daeaf-3618-4b33-ba7e-4d5a0d06456c-kube-api-access-ktwfr\") pod \"kserve-controller-manager-776cc66d47-b9psb\" (UID: \"cb3daeaf-3618-4b33-ba7e-4d5a0d06456c\") " pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" Nov 04 04:51:45.551902 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.551476 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb3daeaf-3618-4b33-ba7e-4d5a0d06456c-cert\") pod \"kserve-controller-manager-776cc66d47-b9psb\" (UID: \"cb3daeaf-3618-4b33-ba7e-4d5a0d06456c\") " pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" Nov 04 04:51:45.553949 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.553928 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb3daeaf-3618-4b33-ba7e-4d5a0d06456c-cert\") pod \"kserve-controller-manager-776cc66d47-b9psb\" (UID: \"cb3daeaf-3618-4b33-ba7e-4d5a0d06456c\") " pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" Nov 04 04:51:45.608230 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.608197 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktwfr\" (UniqueName: \"kubernetes.io/projected/cb3daeaf-3618-4b33-ba7e-4d5a0d06456c-kube-api-access-ktwfr\") pod \"kserve-controller-manager-776cc66d47-b9psb\" (UID: \"cb3daeaf-3618-4b33-ba7e-4d5a0d06456c\") " pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" Nov 04 04:51:45.615100 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.615074 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-b6zvb"] Nov 04 04:51:45.619466 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.619450 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" Nov 04 04:51:45.652210 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.652189 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d4b611-b50f-41d1-887d-dd21f272681d-tls-certs\") pod \"model-serving-api-75bd89fdfc-b6zvb\" (UID: \"d8d4b611-b50f-41d1-887d-dd21f272681d\") " pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" Nov 04 04:51:45.652338 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.652223 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4j77\" (UniqueName: \"kubernetes.io/projected/d8d4b611-b50f-41d1-887d-dd21f272681d-kube-api-access-m4j77\") pod \"model-serving-api-75bd89fdfc-b6zvb\" (UID: \"d8d4b611-b50f-41d1-887d-dd21f272681d\") " pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" Nov 04 04:51:45.669950 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.669876 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Nov 04 04:51:45.670048 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.669961 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-2dqnv\"" Nov 04 04:51:45.672641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.672618 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-b6zvb"] Nov 04 04:51:45.721306 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.721255 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" Nov 04 04:51:45.752728 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.752695 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d4b611-b50f-41d1-887d-dd21f272681d-tls-certs\") pod \"model-serving-api-75bd89fdfc-b6zvb\" (UID: \"d8d4b611-b50f-41d1-887d-dd21f272681d\") " pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" Nov 04 04:51:45.752903 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.752740 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4j77\" (UniqueName: \"kubernetes.io/projected/d8d4b611-b50f-41d1-887d-dd21f272681d-kube-api-access-m4j77\") pod \"model-serving-api-75bd89fdfc-b6zvb\" (UID: \"d8d4b611-b50f-41d1-887d-dd21f272681d\") " pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" Nov 04 04:51:45.755131 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.755104 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8d4b611-b50f-41d1-887d-dd21f272681d-tls-certs\") pod \"model-serving-api-75bd89fdfc-b6zvb\" (UID: \"d8d4b611-b50f-41d1-887d-dd21f272681d\") " pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" Nov 04 04:51:45.809948 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.809915 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4j77\" (UniqueName: \"kubernetes.io/projected/d8d4b611-b50f-41d1-887d-dd21f272681d-kube-api-access-m4j77\") pod \"model-serving-api-75bd89fdfc-b6zvb\" (UID: \"d8d4b611-b50f-41d1-887d-dd21f272681d\") " pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" Nov 04 04:51:45.932104 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:45.932021 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" Nov 04 04:51:46.091569 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:46.091534 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-b9psb"] Nov 04 04:51:46.098674 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:51:46.098648 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3daeaf_3618_4b33_ba7e_4d5a0d06456c.slice/crio-e510e01d4018d245073c8ff1b3122933e23f2d73fcc211445c58d20c71ec803e WatchSource:0}: Error finding container e510e01d4018d245073c8ff1b3122933e23f2d73fcc211445c58d20c71ec803e: Status 404 returned error can't find the container with id e510e01d4018d245073c8ff1b3122933e23f2d73fcc211445c58d20c71ec803e Nov 04 04:51:46.301956 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:46.301924 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-b6zvb"] Nov 04 04:51:46.309076 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:51:46.309046 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d4b611_b50f_41d1_887d_dd21f272681d.slice/crio-9cdcb6b577c56032d6d3fbc9527fc0bd935b43be503829a05e9f3874f4845563 WatchSource:0}: Error finding container 9cdcb6b577c56032d6d3fbc9527fc0bd935b43be503829a05e9f3874f4845563: Status 404 returned error can't find the container with id 9cdcb6b577c56032d6d3fbc9527fc0bd935b43be503829a05e9f3874f4845563 Nov 04 04:51:46.476582 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:46.476549 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" event={"ID":"d8d4b611-b50f-41d1-887d-dd21f272681d","Type":"ContainerStarted","Data":"9cdcb6b577c56032d6d3fbc9527fc0bd935b43be503829a05e9f3874f4845563"} Nov 04 04:51:46.477775 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:46.477749 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" event={"ID":"cb3daeaf-3618-4b33-ba7e-4d5a0d06456c","Type":"ContainerStarted","Data":"e510e01d4018d245073c8ff1b3122933e23f2d73fcc211445c58d20c71ec803e"} Nov 04 04:51:47.096154 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.096117 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq"] Nov 04 04:51:47.101306 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.101285 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.151685 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.151665 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\"" Nov 04 04:51:47.161101 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.161079 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.161229 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.161115 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.161229 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.161170 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l92l\" (UniqueName: \"kubernetes.io/projected/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-kube-api-access-8l92l\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.161412 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.161390 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.197596 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.197570 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\"" Nov 04 04:51:47.197713 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.197674 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\"" Nov 04 04:51:47.197819 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.197796 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-gvkgz\"" Nov 04 04:51:47.200000 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.199978 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq"] Nov 04 04:51:47.261812 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.261782 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.261925 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.261818 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.261925 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.261838 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.261925 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:51:47.261915 4955 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found Nov 04 04:51:47.262046 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:51:47.261929 4955 secret.go:189] Couldn't get secret opendatahub/usage-logs-tenancy-proxy-tls: secret "usage-logs-tenancy-proxy-tls" not found Nov 04 04:51:47.262046 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.261958 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l92l\" (UniqueName: \"kubernetes.io/projected/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-kube-api-access-8l92l\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.262046 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:51:47.261981 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-proxy-source podName:bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a nodeName:}" failed. No retries permitted until 2026-11-04 04:51:47.7619654 +0000 UTC m=+358.231791517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-kphlq" (UID: "bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a") : configmap "usage-tenancy-proxy-source" not found Nov 04 04:51:47.262200 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:51:47.262048 4955 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-tls-cert podName:bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a nodeName:}" failed. No retries permitted until 2026-11-04 04:51:47.762029953 +0000 UTC m=+358.231856089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-tls-cert") pod "usage-logs-tenancy-proxy-9c5d49bcd-kphlq" (UID: "bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a") : secret "usage-logs-tenancy-proxy-tls" not found Nov 04 04:51:47.262586 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.262569 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.322429 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.322402 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l92l\" (UniqueName: \"kubernetes.io/projected/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-kube-api-access-8l92l\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.766045 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.766007 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.766221 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.766174 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.767363 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.767330 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:47.769300 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:47.769257 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-kphlq\" (UID: \"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:48.014450 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:48.014411 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:51:48.405546 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:48.405514 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq"] Nov 04 04:51:48.412621 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:51:48.412588 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbba4dfb_6125_4764_9f9d_d31ce6fb4e2a.slice/crio-319317615a2ad1112f099bb88a40166614d2755d0efd59cf031c34bfa2a1ff89 WatchSource:0}: Error finding container 319317615a2ad1112f099bb88a40166614d2755d0efd59cf031c34bfa2a1ff89: Status 404 returned error can't find the container with id 319317615a2ad1112f099bb88a40166614d2755d0efd59cf031c34bfa2a1ff89 Nov 04 04:51:48.493152 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:48.493119 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" event={"ID":"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a","Type":"ContainerStarted","Data":"319317615a2ad1112f099bb88a40166614d2755d0efd59cf031c34bfa2a1ff89"} Nov 04 04:51:49.500176 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:49.500090 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" event={"ID":"d8d4b611-b50f-41d1-887d-dd21f272681d","Type":"ContainerStarted","Data":"fcaa336ca3248f6ba1760fad383bf16522b2e16cc98d1fe8597861c46017d5ac"} Nov 04 04:51:49.500647 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:49.500230 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" Nov 04 04:51:49.610130 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:49.610073 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" podStartSLOduration=1.763067678 podStartE2EDuration="4.61005836s" totalImagesPullingTime="2.846990682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:49.609294668 +0000 UTC m=+360.079120805" watchObservedRunningTime="2026-11-04 04:51:49.61005836 +0000 UTC m=+360.079884496" Nov 04 04:51:51.513724 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:51.513631 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" event={"ID":"cb3daeaf-3618-4b33-ba7e-4d5a0d06456c","Type":"ContainerStarted","Data":"30408cfa674cc6a8eeb8d96d69b73c5300f74923432173459f445b2a2ca1f2c5"} Nov 04 04:51:51.514137 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:51.513732 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" Nov 04 04:51:51.622571 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:51.622519 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" podStartSLOduration=1.543142899 podStartE2EDuration="6.622503782s" totalImagesPullingTime="5.079360883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:51.621158325 +0000 UTC m=+362.090984463" watchObservedRunningTime="2026-11-04 04:51:51.622503782 +0000 UTC m=+362.092329920" Nov 04 04:51:55.201143 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.201104 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-fzccr"] Nov 04 04:51:55.201630 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.201366 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-8b95c9c66-fzccr" podUID="f036ad08-79d6-4efc-a287-ee88fe35d56a" containerName="manager" containerID="cri-o://f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415" gracePeriod=30 Nov 04 04:51:55.203765 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.203458 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:55.478032 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.478003 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:55.542531 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.542500 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f036ad08-79d6-4efc-a287-ee88fe35d56a-kube-api-access-8sz99\" (UniqueName: \"kubernetes.io/projected/f036ad08-79d6-4efc-a287-ee88fe35d56a-kube-api-access-8sz99\") pod \"f036ad08-79d6-4efc-a287-ee88fe35d56a\" (UID: \"f036ad08-79d6-4efc-a287-ee88fe35d56a\") " Nov 04 04:51:55.542691 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.542576 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-metrics-certs\") pod \"f036ad08-79d6-4efc-a287-ee88fe35d56a\" (UID: \"f036ad08-79d6-4efc-a287-ee88fe35d56a\") " Nov 04 04:51:55.542691 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.542667 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-webhook-cert\" (UniqueName: \"kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-webhook-cert\") pod \"f036ad08-79d6-4efc-a287-ee88fe35d56a\" (UID: \"f036ad08-79d6-4efc-a287-ee88fe35d56a\") " Nov 04 04:51:55.544972 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.544927 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-webhook-cert" pod "f036ad08-79d6-4efc-a287-ee88fe35d56a" (UID: "f036ad08-79d6-4efc-a287-ee88fe35d56a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:51:55.545239 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.545091 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f036ad08-79d6-4efc-a287-ee88fe35d56a-kube-api-access-8sz99" pod "f036ad08-79d6-4efc-a287-ee88fe35d56a" (UID: "f036ad08-79d6-4efc-a287-ee88fe35d56a"). InnerVolumeSpecName "kube-api-access-8sz99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:51:55.545239 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.545108 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-metrics-certs" pod "f036ad08-79d6-4efc-a287-ee88fe35d56a" (UID: "f036ad08-79d6-4efc-a287-ee88fe35d56a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:51:55.545418 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.545393 4955 generic.go:356] "Generic (PLEG): container finished" podID="f036ad08-79d6-4efc-a287-ee88fe35d56a" containerID="f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415" exitCode=0 Nov 04 04:51:55.545464 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.545451 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-fzccr" Nov 04 04:51:55.545512 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.545481 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-fzccr" event={"ID":"f036ad08-79d6-4efc-a287-ee88fe35d56a","Type":"ContainerDied","Data":"f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415"} Nov 04 04:51:55.545583 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.545565 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-fzccr" event={"ID":"f036ad08-79d6-4efc-a287-ee88fe35d56a","Type":"ContainerDied","Data":"8d91bcda596f1fb6834902c3495ee39c328f1c8c79b0cc6703bed912edce5c9d"} Nov 04 04:51:55.545639 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.545618 4955 scope.go:122] "RemoveContainer" containerID="f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415" Nov 04 04:51:55.567050 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.567025 4955 scope.go:122] "RemoveContainer" containerID="f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415" Nov 04 04:51:55.567409 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:51:55.567386 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415\": container with ID starting with f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415 not found: ID does not exist" containerID="f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415" Nov 04 04:51:55.567525 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.567421 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415"} err="failed to get container status \"f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415\": rpc error: code = NotFound desc = could not find container \"f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415\": container with ID starting with f93dbf21fbd3f361b3362b19db60d26192ed0866b0e0f0b859640b2c1410c415 not found: ID does not exist" Nov 04 04:51:55.643570 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.643537 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sz99\" (UniqueName: \"kubernetes.io/projected/f036ad08-79d6-4efc-a287-ee88fe35d56a-kube-api-access-8sz99\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:51:55.643570 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.643568 4955 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-metrics-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:51:55.643570 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.643579 4955 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f036ad08-79d6-4efc-a287-ee88fe35d56a-webhook-cert\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:51:55.694908 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.694587 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-fzccr"] Nov 04 04:51:55.700971 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:55.700942 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-fzccr"] Nov 04 04:51:57.655541 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:51:57.655508 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f036ad08-79d6-4efc-a287-ee88fe35d56a" path="/var/lib/kubelet/pods/f036ad08-79d6-4efc-a287-ee88fe35d56a/volumes" Nov 04 04:51:58.194097 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:51:58.194056 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:52:00.510758 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:00.510728 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-b6zvb" Nov 04 04:52:04.603254 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:04.603218 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" event={"ID":"bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a","Type":"ContainerStarted","Data":"a1a3849bd2484c4ba9931e27ba67d278dcaaaab717b7ce665b3562b0e3d39d79"} Nov 04 04:52:04.603667 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:04.603327 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:52:04.712898 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:04.712834 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" podStartSLOduration=1.944756071 podStartE2EDuration="17.712819467s" totalImagesPullingTime="15.768063396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:52:04.711425797 +0000 UTC m=+375.181251933" watchObservedRunningTime="2026-11-04 04:52:04.712819467 +0000 UTC m=+375.182645605" Nov 04 04:52:15.614010 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:15.613980 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-kphlq" Nov 04 04:52:22.531340 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:22.531309 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-b9psb" Nov 04 04:52:28.188381 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:52:28.188335 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:52:34.736115 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:34.736020 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-z5bm5"] Nov 04 04:52:34.736732 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:34.736646 4955 cpu_manager.go:414] "containerMap: removing container" podUID="f036ad08-79d6-4efc-a287-ee88fe35d56a" containerName="manager" Nov 04 04:52:34.736732 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:34.736668 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f036ad08-79d6-4efc-a287-ee88fe35d56a" containerName="manager" Nov 04 04:52:34.736852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:34.736797 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="f036ad08-79d6-4efc-a287-ee88fe35d56a" containerName="manager" Nov 04 04:52:34.865009 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:34.864975 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-z5bm5"] Nov 04 04:52:34.865197 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:34.865088 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" Nov 04 04:52:34.892785 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:34.892751 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6knlt\" (UniqueName: \"kubernetes.io/projected/f92c2683-3ead-442a-b4f0-84b771907132-kube-api-access-6knlt\") pod \"authorino-6f6944bcdd-z5bm5\" (UID: \"f92c2683-3ead-442a-b4f0-84b771907132\") " pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" Nov 04 04:52:34.993914 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:34.993825 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6knlt\" (UniqueName: \"kubernetes.io/projected/f92c2683-3ead-442a-b4f0-84b771907132-kube-api-access-6knlt\") pod \"authorino-6f6944bcdd-z5bm5\" (UID: \"f92c2683-3ead-442a-b4f0-84b771907132\") " pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" Nov 04 04:52:35.051187 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.051152 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6knlt\" (UniqueName: \"kubernetes.io/projected/f92c2683-3ead-442a-b4f0-84b771907132-kube-api-access-6knlt\") pod \"authorino-6f6944bcdd-z5bm5\" (UID: \"f92c2683-3ead-442a-b4f0-84b771907132\") " pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" Nov 04 04:52:35.108986 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.108952 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-z5bm5"] Nov 04 04:52:35.109176 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.109163 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" Nov 04 04:52:35.137690 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.137663 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c54fc699b-bxgrt"] Nov 04 04:52:35.161250 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.161219 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c54fc699b-bxgrt" Nov 04 04:52:35.197578 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.197520 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c54fc699b-bxgrt"] Nov 04 04:52:35.296524 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.296450 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flvc8\" (UniqueName: \"kubernetes.io/projected/98eac2be-481b-4120-a6af-753d61dc9572-kube-api-access-flvc8\") pod \"authorino-5c54fc699b-bxgrt\" (UID: \"98eac2be-481b-4120-a6af-753d61dc9572\") " pod="kuadrant-system/authorino-5c54fc699b-bxgrt" Nov 04 04:52:35.396961 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.396920 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flvc8\" (UniqueName: \"kubernetes.io/projected/98eac2be-481b-4120-a6af-753d61dc9572-kube-api-access-flvc8\") pod \"authorino-5c54fc699b-bxgrt\" (UID: \"98eac2be-481b-4120-a6af-753d61dc9572\") " pod="kuadrant-system/authorino-5c54fc699b-bxgrt" Nov 04 04:52:35.454199 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.454162 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flvc8\" (UniqueName: \"kubernetes.io/projected/98eac2be-481b-4120-a6af-753d61dc9572-kube-api-access-flvc8\") pod \"authorino-5c54fc699b-bxgrt\" (UID: \"98eac2be-481b-4120-a6af-753d61dc9572\") " pod="kuadrant-system/authorino-5c54fc699b-bxgrt" Nov 04 04:52:35.496709 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.496673 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c54fc699b-bxgrt" Nov 04 04:52:35.501095 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.501061 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-z5bm5"] Nov 04 04:52:35.503884 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.503857 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c54fc699b-bxgrt"] Nov 04 04:52:35.508206 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:52:35.508167 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf92c2683_3ead_442a_b4f0_84b771907132.slice/crio-731b6f817e2edb0f1cbbb68c34ebb49eaf4d894994196d0a32d547b062d461ee WatchSource:0}: Error finding container 731b6f817e2edb0f1cbbb68c34ebb49eaf4d894994196d0a32d547b062d461ee: Status 404 returned error can't find the container with id 731b6f817e2edb0f1cbbb68c34ebb49eaf4d894994196d0a32d547b062d461ee Nov 04 04:52:35.532736 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.532695 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f8c67cf4-7m2lm"] Nov 04 04:52:35.562781 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.562744 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" Nov 04 04:52:35.598505 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.598472 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sdf9\" (UniqueName: \"kubernetes.io/projected/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-kube-api-access-8sdf9\") pod \"authorino-5f8c67cf4-7m2lm\" (UID: \"0ac0aa34-9c82-49e0-9073-83b95fa8cef8\") " pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" Nov 04 04:52:35.598646 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.598539 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-tls-cert\") pod \"authorino-5f8c67cf4-7m2lm\" (UID: \"0ac0aa34-9c82-49e0-9073-83b95fa8cef8\") " pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" Nov 04 04:52:35.600519 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.600492 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f8c67cf4-7m2lm"] Nov 04 04:52:35.611478 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.611451 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Nov 04 04:52:35.699052 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.699008 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sdf9\" (UniqueName: \"kubernetes.io/projected/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-kube-api-access-8sdf9\") pod \"authorino-5f8c67cf4-7m2lm\" (UID: \"0ac0aa34-9c82-49e0-9073-83b95fa8cef8\") " pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" Nov 04 04:52:35.699246 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.699075 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-tls-cert\") pod \"authorino-5f8c67cf4-7m2lm\" (UID: \"0ac0aa34-9c82-49e0-9073-83b95fa8cef8\") " pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" Nov 04 04:52:35.701723 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.701689 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-tls-cert\") pod \"authorino-5f8c67cf4-7m2lm\" (UID: \"0ac0aa34-9c82-49e0-9073-83b95fa8cef8\") " pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" Nov 04 04:52:35.750185 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.750152 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" event={"ID":"f92c2683-3ead-442a-b4f0-84b771907132","Type":"ContainerStarted","Data":"731b6f817e2edb0f1cbbb68c34ebb49eaf4d894994196d0a32d547b062d461ee"} Nov 04 04:52:35.758573 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.758547 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sdf9\" (UniqueName: \"kubernetes.io/projected/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-kube-api-access-8sdf9\") pod \"authorino-5f8c67cf4-7m2lm\" (UID: \"0ac0aa34-9c82-49e0-9073-83b95fa8cef8\") " pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" Nov 04 04:52:35.901185 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.901146 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" Nov 04 04:52:35.906723 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:35.906695 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c54fc699b-bxgrt"] Nov 04 04:52:35.914483 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:52:35.914454 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98eac2be_481b_4120_a6af_753d61dc9572.slice/crio-1e1e634957ec730b84580df3b777086b0b539de04474e2c01b71d23e0345ee62 WatchSource:0}: Error finding container 1e1e634957ec730b84580df3b777086b0b539de04474e2c01b71d23e0345ee62: Status 404 returned error can't find the container with id 1e1e634957ec730b84580df3b777086b0b539de04474e2c01b71d23e0345ee62 Nov 04 04:52:36.310482 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:36.310450 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f8c67cf4-7m2lm"] Nov 04 04:52:36.317418 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:52:36.317388 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ac0aa34_9c82_49e0_9073_83b95fa8cef8.slice/crio-e1b86fdb4b5013dc2b09430f210ed85d941bd721f052bdf6fdcf52fa22b1d982 WatchSource:0}: Error finding container e1b86fdb4b5013dc2b09430f210ed85d941bd721f052bdf6fdcf52fa22b1d982: Status 404 returned error can't find the container with id e1b86fdb4b5013dc2b09430f210ed85d941bd721f052bdf6fdcf52fa22b1d982 Nov 04 04:52:36.757049 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:36.756961 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c54fc699b-bxgrt" event={"ID":"98eac2be-481b-4120-a6af-753d61dc9572","Type":"ContainerStarted","Data":"1e1e634957ec730b84580df3b777086b0b539de04474e2c01b71d23e0345ee62"} Nov 04 04:52:36.758240 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:36.758214 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" event={"ID":"0ac0aa34-9c82-49e0-9073-83b95fa8cef8","Type":"ContainerStarted","Data":"e1b86fdb4b5013dc2b09430f210ed85d941bd721f052bdf6fdcf52fa22b1d982"} Nov 04 04:52:37.764404 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:37.764365 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c54fc699b-bxgrt" event={"ID":"98eac2be-481b-4120-a6af-753d61dc9572","Type":"ContainerStarted","Data":"b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e"} Nov 04 04:52:37.764404 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:37.764381 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-5c54fc699b-bxgrt" podUID="98eac2be-481b-4120-a6af-753d61dc9572" containerName="authorino" containerID="cri-o://b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e" gracePeriod=30 Nov 04 04:52:37.765922 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:37.765898 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" event={"ID":"f92c2683-3ead-442a-b4f0-84b771907132","Type":"ContainerStarted","Data":"e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432"} Nov 04 04:52:37.766038 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:37.765988 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" podUID="f92c2683-3ead-442a-b4f0-84b771907132" containerName="authorino" containerID="cri-o://e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432" gracePeriod=30 Nov 04 04:52:37.871601 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:37.871548 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-5c54fc699b-bxgrt" podStartSLOduration=1.15962095 podStartE2EDuration="2.871535322s" totalImagesPullingTime="1.711914372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:52:37.869800169 +0000 UTC m=+408.339626310" watchObservedRunningTime="2026-11-04 04:52:37.871535322 +0000 UTC m=+408.341361458" Nov 04 04:52:37.976918 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:37.976789 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" podStartSLOduration=1.881531646 podStartE2EDuration="3.976771864s" totalImagesPullingTime="2.095240218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:52:37.976119421 +0000 UTC m=+408.445945559" watchObservedRunningTime="2026-11-04 04:52:37.976771864 +0000 UTC m=+408.446598003" Nov 04 04:52:38.155661 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.155635 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c54fc699b-bxgrt" Nov 04 04:52:38.167618 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.167599 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" Nov 04 04:52:38.218138 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.218113 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f92c2683-3ead-442a-b4f0-84b771907132-kube-api-access-6knlt\" (UniqueName: \"kubernetes.io/projected/f92c2683-3ead-442a-b4f0-84b771907132-kube-api-access-6knlt\") pod \"f92c2683-3ead-442a-b4f0-84b771907132\" (UID: \"f92c2683-3ead-442a-b4f0-84b771907132\") " Nov 04 04:52:38.218254 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.218146 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98eac2be-481b-4120-a6af-753d61dc9572-kube-api-access-flvc8\" (UniqueName: \"kubernetes.io/projected/98eac2be-481b-4120-a6af-753d61dc9572-kube-api-access-flvc8\") pod \"98eac2be-481b-4120-a6af-753d61dc9572\" (UID: \"98eac2be-481b-4120-a6af-753d61dc9572\") " Nov 04 04:52:38.220170 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.220146 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98eac2be-481b-4120-a6af-753d61dc9572-kube-api-access-flvc8" pod "98eac2be-481b-4120-a6af-753d61dc9572" (UID: "98eac2be-481b-4120-a6af-753d61dc9572"). InnerVolumeSpecName "kube-api-access-flvc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:52:38.220243 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.220154 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92c2683-3ead-442a-b4f0-84b771907132-kube-api-access-6knlt" pod "f92c2683-3ead-442a-b4f0-84b771907132" (UID: "f92c2683-3ead-442a-b4f0-84b771907132"). InnerVolumeSpecName "kube-api-access-6knlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:52:38.319587 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.319557 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6knlt\" (UniqueName: \"kubernetes.io/projected/f92c2683-3ead-442a-b4f0-84b771907132-kube-api-access-6knlt\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:52:38.319587 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.319584 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flvc8\" (UniqueName: \"kubernetes.io/projected/98eac2be-481b-4120-a6af-753d61dc9572-kube-api-access-flvc8\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:52:38.775086 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.774366 4955 generic.go:356] "Generic (PLEG): container finished" podID="f92c2683-3ead-442a-b4f0-84b771907132" containerID="e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432" exitCode=0 Nov 04 04:52:38.775086 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.774423 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" Nov 04 04:52:38.775086 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.774552 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" event={"ID":"f92c2683-3ead-442a-b4f0-84b771907132","Type":"ContainerDied","Data":"e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432"} Nov 04 04:52:38.775086 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.774586 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-z5bm5" event={"ID":"f92c2683-3ead-442a-b4f0-84b771907132","Type":"ContainerDied","Data":"731b6f817e2edb0f1cbbb68c34ebb49eaf4d894994196d0a32d547b062d461ee"} Nov 04 04:52:38.775086 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.774608 4955 scope.go:122] "RemoveContainer" containerID="e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432" Nov 04 04:52:38.778361 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.778329 4955 generic.go:356] "Generic (PLEG): container finished" podID="98eac2be-481b-4120-a6af-753d61dc9572" containerID="b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e" exitCode=0 Nov 04 04:52:38.778514 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.778416 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c54fc699b-bxgrt" Nov 04 04:52:38.778514 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.778432 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c54fc699b-bxgrt" event={"ID":"98eac2be-481b-4120-a6af-753d61dc9572","Type":"ContainerDied","Data":"b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e"} Nov 04 04:52:38.778514 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.778467 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c54fc699b-bxgrt" event={"ID":"98eac2be-481b-4120-a6af-753d61dc9572","Type":"ContainerDied","Data":"1e1e634957ec730b84580df3b777086b0b539de04474e2c01b71d23e0345ee62"} Nov 04 04:52:38.780065 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.780038 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" event={"ID":"0ac0aa34-9c82-49e0-9073-83b95fa8cef8","Type":"ContainerStarted","Data":"d597f429dde0f42ba36537324de630e0efaf29c95462228e6a6719fece08412c"} Nov 04 04:52:38.787711 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.787692 4955 scope.go:122] "RemoveContainer" containerID="e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432" Nov 04 04:52:38.788042 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:52:38.788022 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432\": container with ID starting with e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432 not found: ID does not exist" containerID="e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432" Nov 04 04:52:38.788110 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.788050 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432"} err="failed to get container status \"e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432\": rpc error: code = NotFound desc = could not find container \"e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432\": container with ID starting with e518669d27fa2373529b4621af2cdb28047da49870d35aba26e38c9fc13b0432 not found: ID does not exist" Nov 04 04:52:38.788110 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.788067 4955 scope.go:122] "RemoveContainer" containerID="b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e" Nov 04 04:52:38.799466 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.799435 4955 scope.go:122] "RemoveContainer" containerID="b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e" Nov 04 04:52:38.799784 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:52:38.799765 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e\": container with ID starting with b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e not found: ID does not exist" containerID="b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e" Nov 04 04:52:38.799846 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.799793 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e"} err="failed to get container status \"b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e\": rpc error: code = NotFound desc = could not find container \"b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e\": container with ID starting with b2fa196d72466d25f9f7d29061a8d64c34665e93d0a8cf81be20376b8d8bbf1e not found: ID does not exist" Nov 04 04:52:38.935642 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.935567 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-z5bm5"] Nov 04 04:52:38.981532 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:38.981487 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-z5bm5"] Nov 04 04:52:39.044012 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.043967 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" podStartSLOduration=2.540453292 podStartE2EDuration="4.043953697s" totalImagesPullingTime="1.503500405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:52:39.043171807 +0000 UTC m=+409.512997928" watchObservedRunningTime="2026-11-04 04:52:39.043953697 +0000 UTC m=+409.513779836" Nov 04 04:52:39.076004 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.075967 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-54b89"] Nov 04 04:52:39.077364 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.077323 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-54b89" podUID="0aa8361b-d811-4280-a8cf-4005fecb74da" containerName="authorino" containerID="cri-o://a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791" gracePeriod=30 Nov 04 04:52:39.150635 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.150610 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c54fc699b-bxgrt"] Nov 04 04:52:39.154384 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.154359 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c54fc699b-bxgrt"] Nov 04 04:52:39.322531 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.322510 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-54b89" Nov 04 04:52:39.328528 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.328506 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0aa8361b-d811-4280-a8cf-4005fecb74da-kube-api-access-8ldb7\" (UniqueName: \"kubernetes.io/projected/0aa8361b-d811-4280-a8cf-4005fecb74da-kube-api-access-8ldb7\") pod \"0aa8361b-d811-4280-a8cf-4005fecb74da\" (UID: \"0aa8361b-d811-4280-a8cf-4005fecb74da\") " Nov 04 04:52:39.330296 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.330244 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aa8361b-d811-4280-a8cf-4005fecb74da-kube-api-access-8ldb7" pod "0aa8361b-d811-4280-a8cf-4005fecb74da" (UID: "0aa8361b-d811-4280-a8cf-4005fecb74da"). InnerVolumeSpecName "kube-api-access-8ldb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:52:39.429766 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.429732 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ldb7\" (UniqueName: \"kubernetes.io/projected/0aa8361b-d811-4280-a8cf-4005fecb74da-kube-api-access-8ldb7\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:52:39.654126 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.654093 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="98eac2be-481b-4120-a6af-753d61dc9572" path="/var/lib/kubelet/pods/98eac2be-481b-4120-a6af-753d61dc9572/volumes" Nov 04 04:52:39.654500 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.654486 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f92c2683-3ead-442a-b4f0-84b771907132" path="/var/lib/kubelet/pods/f92c2683-3ead-442a-b4f0-84b771907132/volumes" Nov 04 04:52:39.787031 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.786996 4955 generic.go:356] "Generic (PLEG): container finished" podID="0aa8361b-d811-4280-a8cf-4005fecb74da" containerID="a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791" exitCode=0 Nov 04 04:52:39.787481 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.787043 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-54b89" Nov 04 04:52:39.787481 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.787085 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-54b89" event={"ID":"0aa8361b-d811-4280-a8cf-4005fecb74da","Type":"ContainerDied","Data":"a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791"} Nov 04 04:52:39.787481 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.787125 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-54b89" event={"ID":"0aa8361b-d811-4280-a8cf-4005fecb74da","Type":"ContainerDied","Data":"6e0645b24e77fb06f63a0fb1d7ed4968ffebbd0261ba2259171f74ed26df833a"} Nov 04 04:52:39.787481 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.787146 4955 scope.go:122] "RemoveContainer" containerID="a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791" Nov 04 04:52:39.795768 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.795749 4955 scope.go:122] "RemoveContainer" containerID="a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791" Nov 04 04:52:39.796010 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:52:39.795991 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791\": container with ID starting with a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791 not found: ID does not exist" containerID="a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791" Nov 04 04:52:39.796053 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.796019 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791"} err="failed to get container status \"a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791\": rpc error: code = NotFound desc = could not find container \"a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791\": container with ID starting with a3d6ebebb54febd4531ae7c11c903f6d42674911e5493f0165049d0438a04791 not found: ID does not exist" Nov 04 04:52:39.938689 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.938611 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-54b89"] Nov 04 04:52:39.944437 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:39.944411 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-54b89"] Nov 04 04:52:41.655352 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:52:41.655314 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0aa8361b-d811-4280-a8cf-4005fecb74da" path="/var/lib/kubelet/pods/0aa8361b-d811-4280-a8cf-4005fecb74da/volumes" Nov 04 04:52:58.189054 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:52:58.189019 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:53:00.134389 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.134352 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5"] Nov 04 04:53:00.134815 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.134800 4955 cpu_manager.go:414] "containerMap: removing container" podUID="98eac2be-481b-4120-a6af-753d61dc9572" containerName="authorino" Nov 04 04:53:00.134885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.134816 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98eac2be-481b-4120-a6af-753d61dc9572" containerName="authorino" Nov 04 04:53:00.134885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.134827 4955 cpu_manager.go:414] "containerMap: removing container" podUID="f92c2683-3ead-442a-b4f0-84b771907132" containerName="authorino" Nov 04 04:53:00.134885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.134832 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f92c2683-3ead-442a-b4f0-84b771907132" containerName="authorino" Nov 04 04:53:00.134885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.134844 4955 cpu_manager.go:414] "containerMap: removing container" podUID="0aa8361b-d811-4280-a8cf-4005fecb74da" containerName="authorino" Nov 04 04:53:00.134885 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.134849 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0aa8361b-d811-4280-a8cf-4005fecb74da" containerName="authorino" Nov 04 04:53:00.135089 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.134919 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="0aa8361b-d811-4280-a8cf-4005fecb74da" containerName="authorino" Nov 04 04:53:00.135089 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.134936 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="98eac2be-481b-4120-a6af-753d61dc9572" containerName="authorino" Nov 04 04:53:00.135089 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.134946 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="f92c2683-3ead-442a-b4f0-84b771907132" containerName="authorino" Nov 04 04:53:00.137649 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.137629 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" Nov 04 04:53:00.229386 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.229348 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f99l5\" (UniqueName: \"kubernetes.io/projected/476fd3e7-e09b-41ff-91a7-803eed68bc42-kube-api-access-f99l5\") pod \"llmisvc-controller-manager-6466c554d8-8xwq5\" (UID: \"476fd3e7-e09b-41ff-91a7-803eed68bc42\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" Nov 04 04:53:00.229553 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.229416 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/476fd3e7-e09b-41ff-91a7-803eed68bc42-cert\") pod \"llmisvc-controller-manager-6466c554d8-8xwq5\" (UID: \"476fd3e7-e09b-41ff-91a7-803eed68bc42\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" Nov 04 04:53:00.232308 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.232285 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-w57kc\"" Nov 04 04:53:00.232396 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.232285 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Nov 04 04:53:00.234395 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.234374 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5"] Nov 04 04:53:00.330518 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.330482 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f99l5\" (UniqueName: \"kubernetes.io/projected/476fd3e7-e09b-41ff-91a7-803eed68bc42-kube-api-access-f99l5\") pod \"llmisvc-controller-manager-6466c554d8-8xwq5\" (UID: \"476fd3e7-e09b-41ff-91a7-803eed68bc42\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" Nov 04 04:53:00.330691 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.330559 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/476fd3e7-e09b-41ff-91a7-803eed68bc42-cert\") pod \"llmisvc-controller-manager-6466c554d8-8xwq5\" (UID: \"476fd3e7-e09b-41ff-91a7-803eed68bc42\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" Nov 04 04:53:00.333002 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.332983 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/476fd3e7-e09b-41ff-91a7-803eed68bc42-cert\") pod \"llmisvc-controller-manager-6466c554d8-8xwq5\" (UID: \"476fd3e7-e09b-41ff-91a7-803eed68bc42\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" Nov 04 04:53:00.387730 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.387665 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f99l5\" (UniqueName: \"kubernetes.io/projected/476fd3e7-e09b-41ff-91a7-803eed68bc42-kube-api-access-f99l5\") pod \"llmisvc-controller-manager-6466c554d8-8xwq5\" (UID: \"476fd3e7-e09b-41ff-91a7-803eed68bc42\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" Nov 04 04:53:00.449632 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.449599 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" Nov 04 04:53:00.817436 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.817400 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5"] Nov 04 04:53:00.824552 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:53:00.824523 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476fd3e7_e09b_41ff_91a7_803eed68bc42.slice/crio-882e41a5f32e44705a8286457cbced32130402c0a9b9df608a6a35a4bb71fa59 WatchSource:0}: Error finding container 882e41a5f32e44705a8286457cbced32130402c0a9b9df608a6a35a4bb71fa59: Status 404 returned error can't find the container with id 882e41a5f32e44705a8286457cbced32130402c0a9b9df608a6a35a4bb71fa59 Nov 04 04:53:00.898300 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:00.898238 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" event={"ID":"476fd3e7-e09b-41ff-91a7-803eed68bc42","Type":"ContainerStarted","Data":"882e41a5f32e44705a8286457cbced32130402c0a9b9df608a6a35a4bb71fa59"} Nov 04 04:53:03.915581 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:03.915544 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" event={"ID":"476fd3e7-e09b-41ff-91a7-803eed68bc42","Type":"ContainerStarted","Data":"eb59ea8512ff814d9e0acdd9d2583476c983be435342f002ebb5d7177a31fc6f"} Nov 04 04:53:03.915997 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:03.915614 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" Nov 04 04:53:04.025758 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:04.025703 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" podStartSLOduration=1.441515382 podStartE2EDuration="4.025689347s" totalImagesPullingTime="2.584173965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:53:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:53:04.02373473 +0000 UTC m=+434.493560868" watchObservedRunningTime="2026-11-04 04:53:04.025689347 +0000 UTC m=+434.495515486" Nov 04 04:53:28.188869 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:53:28.188832 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:53:34.922695 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:53:34.922665 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-8xwq5" Nov 04 04:53:58.188877 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:53:58.188836 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:54:21.041034 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.041001 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj"] Nov 04 04:54:21.045042 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.045012 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.094270 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.094243 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7dlcv\"" Nov 04 04:54:21.119320 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.119284 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-podinfo\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.119440 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.119335 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-envoy\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.119440 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.119369 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-data\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.119520 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.119480 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-socket\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.119520 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.119501 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-certs\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.119594 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.119526 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-token\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.119594 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.119543 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfd6n\" (UniqueName: \"kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-kube-api-access-vfd6n\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.119672 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.119655 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-credential-socket\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.119714 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.119680 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82072ea-d34d-4485-bccf-dd82d8dc1768-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.142492 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.142466 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj"] Nov 04 04:54:21.220583 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.220554 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-podinfo\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.220583 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.220584 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-envoy\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.220767 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.220616 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-data\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.220767 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.220692 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-socket\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.220767 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.220719 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-certs\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.220767 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.220757 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-token\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.220957 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.220778 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfd6n\" (UniqueName: \"kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-kube-api-access-vfd6n\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.220957 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.220812 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-credential-socket\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.220957 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.220836 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82072ea-d34d-4485-bccf-dd82d8dc1768-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.221315 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.221292 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-data\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.221471 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.221446 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-socket\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.221554 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.221531 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-certs\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.221613 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.221574 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-credential-socket\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.221670 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.221650 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82072ea-d34d-4485-bccf-dd82d8dc1768-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.222917 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.222897 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-envoy\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.223214 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.223195 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-podinfo\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.277735 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.277716 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-token\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.278155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.278132 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfd6n\" (UniqueName: \"kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-kube-api-access-vfd6n\") pod \"maas-default-gateway-openshift-default-57f78bcd55-vzbwj\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.364867 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.364847 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:21.791837 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.791761 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj"] Nov 04 04:54:21.798800 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:54:21.798768 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82072ea_d34d_4485_bccf_dd82d8dc1768.slice/crio-0d93c8a37d27208474a543d8f0108a0fd1efbf7a74b1c82efbb95ac4d1408a62 WatchSource:0}: Error finding container 0d93c8a37d27208474a543d8f0108a0fd1efbf7a74b1c82efbb95ac4d1408a62: Status 404 returned error can't find the container with id 0d93c8a37d27208474a543d8f0108a0fd1efbf7a74b1c82efbb95ac4d1408a62 Nov 04 04:54:21.801146 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.801118 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:54:21.801204 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.801181 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:54:21.801245 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:21.801210 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:54:22.306221 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:22.306186 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" event={"ID":"a82072ea-d34d-4485-bccf-dd82d8dc1768","Type":"ContainerStarted","Data":"0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9"} Nov 04 04:54:22.306809 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:22.306234 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" event={"ID":"a82072ea-d34d-4485-bccf-dd82d8dc1768","Type":"ContainerStarted","Data":"0d93c8a37d27208474a543d8f0108a0fd1efbf7a74b1c82efbb95ac4d1408a62"} Nov 04 04:54:22.379388 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:22.374758 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:22.379388 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:22.374886 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-vzbwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 04:54:22.379388 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:22.374926 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 04:54:22.422507 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:22.422451 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" podStartSLOduration=2.422438107 podStartE2EDuration="2.422438107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:54:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:54:22.421434039 +0000 UTC m=+512.891260211" watchObservedRunningTime="2026-11-04 04:54:22.422438107 +0000 UTC m=+512.892264245" Nov 04 04:54:23.375951 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:23.375915 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-vzbwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 04:54:23.376573 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:23.376531 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 04:54:24.368287 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:24.366650 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-vzbwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 04:54:24.368287 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:24.366709 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 04:54:25.366287 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:25.365439 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-vzbwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 04:54:25.366287 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:25.365527 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 04:54:26.366285 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:26.365661 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-vzbwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 04:54:26.366285 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:26.365726 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 04:54:27.366643 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:27.366609 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-vzbwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 04:54:27.367247 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:27.367215 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 04:54:28.189218 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:54:28.189179 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:54:28.365767 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:28.365733 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-vzbwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Nov 04 04:54:28.365931 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:28.365788 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Nov 04 04:54:29.788122 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:29.788086 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:29.788586 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:29.788508 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:29.789468 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:29.789444 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 04:54:46.234511 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:46.234480 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f8c67cf4-7m2lm"] Nov 04 04:54:46.234905 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:46.234671 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" podUID="0ac0aa34-9c82-49e0-9073-83b95fa8cef8" containerName="authorino" containerID="cri-o://d597f429dde0f42ba36537324de630e0efaf29c95462228e6a6719fece08412c" gracePeriod=30 Nov 04 04:54:46.443332 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:46.443296 4955 generic.go:356] "Generic (PLEG): container finished" podID="0ac0aa34-9c82-49e0-9073-83b95fa8cef8" containerID="d597f429dde0f42ba36537324de630e0efaf29c95462228e6a6719fece08412c" exitCode=0 Nov 04 04:54:46.443498 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:46.443333 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" event={"ID":"0ac0aa34-9c82-49e0-9073-83b95fa8cef8","Type":"ContainerDied","Data":"d597f429dde0f42ba36537324de630e0efaf29c95462228e6a6719fece08412c"} Nov 04 04:54:46.487928 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:46.487874 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" Nov 04 04:54:46.553952 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:46.553924 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-tls-cert\" (UniqueName: \"kubernetes.io/secret/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-tls-cert\") pod \"0ac0aa34-9c82-49e0-9073-83b95fa8cef8\" (UID: \"0ac0aa34-9c82-49e0-9073-83b95fa8cef8\") " Nov 04 04:54:46.554103 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:46.553974 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-kube-api-access-8sdf9\" (UniqueName: \"kubernetes.io/projected/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-kube-api-access-8sdf9\") pod \"0ac0aa34-9c82-49e0-9073-83b95fa8cef8\" (UID: \"0ac0aa34-9c82-49e0-9073-83b95fa8cef8\") " Nov 04 04:54:46.555951 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:46.555924 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-kube-api-access-8sdf9" pod "0ac0aa34-9c82-49e0-9073-83b95fa8cef8" (UID: "0ac0aa34-9c82-49e0-9073-83b95fa8cef8"). InnerVolumeSpecName "kube-api-access-8sdf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:54:46.566729 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:46.566701 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-tls-cert" pod "0ac0aa34-9c82-49e0-9073-83b95fa8cef8" (UID: "0ac0aa34-9c82-49e0-9073-83b95fa8cef8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:54:46.654793 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:46.654742 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sdf9\" (UniqueName: \"kubernetes.io/projected/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-kube-api-access-8sdf9\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:54:46.654793 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:46.654767 4955 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0ac0aa34-9c82-49e0-9073-83b95fa8cef8-tls-cert\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 04:54:47.450176 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:47.450145 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" Nov 04 04:54:47.450611 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:47.450182 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f8c67cf4-7m2lm" event={"ID":"0ac0aa34-9c82-49e0-9073-83b95fa8cef8","Type":"ContainerDied","Data":"e1b86fdb4b5013dc2b09430f210ed85d941bd721f052bdf6fdcf52fa22b1d982"} Nov 04 04:54:47.450611 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:47.450228 4955 scope.go:122] "RemoveContainer" containerID="d597f429dde0f42ba36537324de630e0efaf29c95462228e6a6719fece08412c" Nov 04 04:54:47.601904 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:47.601875 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f8c67cf4-7m2lm"] Nov 04 04:54:47.647642 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:47.647617 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f8c67cf4-7m2lm"] Nov 04 04:54:47.653620 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:54:47.653598 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ac0aa34-9c82-49e0-9073-83b95fa8cef8" path="/var/lib/kubelet/pods/0ac0aa34-9c82-49e0-9073-83b95fa8cef8/volumes" Nov 04 04:54:58.189993 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:54:58.189958 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:55:21.524277 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.524239 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt"] Nov 04 04:55:21.526632 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.524661 4955 cpu_manager.go:414] "containerMap: removing container" podUID="0ac0aa34-9c82-49e0-9073-83b95fa8cef8" containerName="authorino" Nov 04 04:55:21.526632 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.524673 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ac0aa34-9c82-49e0-9073-83b95fa8cef8" containerName="authorino" Nov 04 04:55:21.526632 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.524774 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ac0aa34-9c82-49e0-9073-83b95fa8cef8" containerName="authorino" Nov 04 04:55:21.527549 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.527530 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.577095 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.577062 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/187a1fae-5842-45b7-ba66-10fa4ec6a515-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.577095 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.577099 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd84l\" (UniqueName: \"kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-kube-api-access-bd84l\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.577330 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.577123 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-data\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.577330 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.577256 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-token\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.577330 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.577306 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-certs\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.577330 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.577325 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-podinfo\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.577454 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.577421 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-envoy\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.577487 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.577468 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-credential-socket\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.577527 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.577491 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-socket\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.624738 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.624701 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt"] Nov 04 04:55:21.678412 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.678381 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-envoy\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.678624 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.678427 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-credential-socket\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.678624 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.678544 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-socket\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.678624 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.678584 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/187a1fae-5842-45b7-ba66-10fa4ec6a515-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.678624 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.678610 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd84l\" (UniqueName: \"kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-kube-api-access-bd84l\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.678845 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.678638 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-data\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.678845 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.678701 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-token\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.678845 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.678727 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-certs\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.678845 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.678759 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-podinfo\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.679053 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.678875 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-credential-socket\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.679053 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.678933 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-socket\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.679170 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.679118 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-data\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.679226 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.679174 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-certs\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.679419 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.679394 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/187a1fae-5842-45b7-ba66-10fa4ec6a515-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.680787 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.680764 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-envoy\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.681109 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.681090 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-podinfo\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.735666 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.735627 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-token\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.735812 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.735740 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd84l\" (UniqueName: \"kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-kube-api-access-bd84l\") pod \"maas-default-gateway-openshift-default-57f78bcd55-v7kjt\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:21.840075 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:21.840038 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:22.267433 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:22.267350 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt"] Nov 04 04:55:22.274863 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:55:22.274838 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187a1fae_5842_45b7_ba66_10fa4ec6a515.slice/crio-ef98b77c01ed7f971f38e9bd1570a04c9581a33b80d6d85be4c4f3efd5786ee3 WatchSource:0}: Error finding container ef98b77c01ed7f971f38e9bd1570a04c9581a33b80d6d85be4c4f3efd5786ee3: Status 404 returned error can't find the container with id ef98b77c01ed7f971f38e9bd1570a04c9581a33b80d6d85be4c4f3efd5786ee3 Nov 04 04:55:22.276894 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:22.276866 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:55:22.276954 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:22.276935 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:55:22.276988 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:22.276963 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:55:22.625189 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:22.625143 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" event={"ID":"187a1fae-5842-45b7-ba66-10fa4ec6a515","Type":"ContainerStarted","Data":"b4081bb25bace893c1cbf661ca66c7803265866dcf062d143614ddab4df263e7"} Nov 04 04:55:22.625600 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:22.625215 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" event={"ID":"187a1fae-5842-45b7-ba66-10fa4ec6a515","Type":"ContainerStarted","Data":"ef98b77c01ed7f971f38e9bd1570a04c9581a33b80d6d85be4c4f3efd5786ee3"} Nov 04 04:55:22.744395 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:22.743216 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" podStartSLOduration=1.743196736 podStartE2EDuration="1.743196736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:55:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:55:22.73743982 +0000 UTC m=+573.207265958" watchObservedRunningTime="2026-11-04 04:55:22.743196736 +0000 UTC m=+573.213022876" Nov 04 04:55:22.841155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:22.841121 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:23.842088 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:23.842055 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-v7kjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 04 04:55:23.842515 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:23.842112 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" podUID="187a1fae-5842-45b7-ba66-10fa4ec6a515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 04 04:55:24.841401 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:24.841361 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-v7kjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 04 04:55:24.841568 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:24.841448 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" podUID="187a1fae-5842-45b7-ba66-10fa4ec6a515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 04 04:55:25.841332 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:25.841293 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-v7kjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 04 04:55:25.841721 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:25.841348 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" podUID="187a1fae-5842-45b7-ba66-10fa4ec6a515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 04 04:55:26.841003 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:26.840967 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-v7kjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 04 04:55:26.841186 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:26.841030 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" podUID="187a1fae-5842-45b7-ba66-10fa4ec6a515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 04 04:55:27.840621 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:27.840585 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-v7kjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 04 04:55:27.841023 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:27.840649 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" podUID="187a1fae-5842-45b7-ba66-10fa4ec6a515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 04 04:55:28.190170 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:55:28.190082 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:55:28.841052 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:28.841010 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-v7kjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 04 04:55:28.841508 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:28.841082 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" podUID="187a1fae-5842-45b7-ba66-10fa4ec6a515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 04 04:55:29.841210 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:29.841168 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-v7kjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 04 04:55:29.841705 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:29.841239 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" podUID="187a1fae-5842-45b7-ba66-10fa4ec6a515" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 04 04:55:30.846937 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:30.846900 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:30.847382 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:30.847296 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:30.848033 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:30.848014 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 04:55:49.710051 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:49.710023 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/2.log" Nov 04 04:55:49.712225 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:55:49.712202 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/2.log" Nov 04 04:55:58.190244 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:55:58.190205 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:56:02.371195 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.370274 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg"] Nov 04 04:56:02.373957 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.373936 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" Nov 04 04:56:02.422706 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.422668 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-a48f7e\"" Nov 04 04:56:02.468976 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.468944 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-a48f7e-dockercfg-9574q\"" Nov 04 04:56:02.480567 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.480534 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg"] Nov 04 04:56:02.550827 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.550789 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb14d4d7-9502-4c94-90fc-0f324135c227-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg\" (UID: \"cb14d4d7-9502-4c94-90fc-0f324135c227\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" Nov 04 04:56:02.551008 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.550843 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjnnl\" (UniqueName: \"kubernetes.io/projected/cb14d4d7-9502-4c94-90fc-0f324135c227-kube-api-access-jjnnl\") pod \"payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg\" (UID: \"cb14d4d7-9502-4c94-90fc-0f324135c227\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" Nov 04 04:56:02.568720 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.568680 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6"] Nov 04 04:56:02.572490 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.572465 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" Nov 04 04:56:02.629344 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.629246 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6"] Nov 04 04:56:02.651685 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.651646 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb14d4d7-9502-4c94-90fc-0f324135c227-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg\" (UID: \"cb14d4d7-9502-4c94-90fc-0f324135c227\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" Nov 04 04:56:02.651883 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.651706 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjnnl\" (UniqueName: \"kubernetes.io/projected/cb14d4d7-9502-4c94-90fc-0f324135c227-kube-api-access-jjnnl\") pod \"payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg\" (UID: \"cb14d4d7-9502-4c94-90fc-0f324135c227\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" Nov 04 04:56:02.652687 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.652665 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb14d4d7-9502-4c94-90fc-0f324135c227-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg\" (UID: \"cb14d4d7-9502-4c94-90fc-0f324135c227\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" Nov 04 04:56:02.713396 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.713363 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjnnl\" (UniqueName: \"kubernetes.io/projected/cb14d4d7-9502-4c94-90fc-0f324135c227-kube-api-access-jjnnl\") pod \"payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg\" (UID: \"cb14d4d7-9502-4c94-90fc-0f324135c227\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" Nov 04 04:56:02.752378 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.752336 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6\" (UID: \"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" Nov 04 04:56:02.752582 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.752568 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzbjg\" (UniqueName: \"kubernetes.io/projected/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-kube-api-access-xzbjg\") pod \"payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6\" (UID: \"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" Nov 04 04:56:02.853286 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.853227 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6\" (UID: \"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" Nov 04 04:56:02.853494 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.853330 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzbjg\" (UniqueName: \"kubernetes.io/projected/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-kube-api-access-xzbjg\") pod \"payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6\" (UID: \"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" Nov 04 04:56:02.854102 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.854073 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6\" (UID: \"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" Nov 04 04:56:02.911684 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.911606 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzbjg\" (UniqueName: \"kubernetes.io/projected/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-kube-api-access-xzbjg\") pod \"payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6\" (UID: \"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" Nov 04 04:56:02.987917 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:02.987874 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" Nov 04 04:56:03.185860 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:03.185773 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" Nov 04 04:56:03.366751 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:03.366713 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg"] Nov 04 04:56:03.373699 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:56:03.373672 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb14d4d7_9502_4c94_90fc_0f324135c227.slice/crio-5ced38de268bed1a320852a8d88c76ae66d114ccccca8b357a5eec47dd440978 WatchSource:0}: Error finding container 5ced38de268bed1a320852a8d88c76ae66d114ccccca8b357a5eec47dd440978: Status 404 returned error can't find the container with id 5ced38de268bed1a320852a8d88c76ae66d114ccccca8b357a5eec47dd440978 Nov 04 04:56:03.375492 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:03.375473 4955 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 04:56:03.555905 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:03.555874 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6"] Nov 04 04:56:03.562571 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:56:03.562543 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d68c8f_6a26_4947_a8e4_90c7f8fcd744.slice/crio-d9a13549bc28d56b7d8403451f910f9e0ea14afcf5e797d87d32e0af66aad6c5 WatchSource:0}: Error finding container d9a13549bc28d56b7d8403451f910f9e0ea14afcf5e797d87d32e0af66aad6c5: Status 404 returned error can't find the container with id d9a13549bc28d56b7d8403451f910f9e0ea14afcf5e797d87d32e0af66aad6c5 Nov 04 04:56:03.841094 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:03.841017 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" event={"ID":"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744","Type":"ContainerStarted","Data":"d9a13549bc28d56b7d8403451f910f9e0ea14afcf5e797d87d32e0af66aad6c5"} Nov 04 04:56:03.842157 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:03.842136 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" event={"ID":"cb14d4d7-9502-4c94-90fc-0f324135c227","Type":"ContainerStarted","Data":"5ced38de268bed1a320852a8d88c76ae66d114ccccca8b357a5eec47dd440978"} Nov 04 04:56:06.865590 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:06.865555 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" event={"ID":"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744","Type":"ContainerStarted","Data":"106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2"} Nov 04 04:56:06.866073 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:06.865777 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" Nov 04 04:56:06.867275 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:06.867243 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" event={"ID":"cb14d4d7-9502-4c94-90fc-0f324135c227","Type":"ContainerStarted","Data":"75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3"} Nov 04 04:56:06.867383 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:06.867323 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" Nov 04 04:56:06.973874 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:06.973819 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" podStartSLOduration=2.0244728849999998 podStartE2EDuration="4.973807051s" totalImagesPullingTime="2.949334166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:56:06.973519274 +0000 UTC m=+617.443345416" watchObservedRunningTime="2026-11-04 04:56:06.973807051 +0000 UTC m=+617.443633190" Nov 04 04:56:07.109568 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:07.109511 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" podStartSLOduration=1.91253566 podStartE2EDuration="5.109494487s" totalImagesPullingTime="3.196958827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:56:07.109471184 +0000 UTC m=+617.579297322" watchObservedRunningTime="2026-11-04 04:56:07.109494487 +0000 UTC m=+617.579320626" Nov 04 04:56:07.776858 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:07.776818 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l"] Nov 04 04:56:07.780577 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:07.780557 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" Nov 04 04:56:07.831772 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:07.831744 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-c5bb6d-dockercfg-5vvfp\"" Nov 04 04:56:07.834383 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:07.834354 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l"] Nov 04 04:56:07.877501 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:07.877473 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-c5bb6d\"" Nov 04 04:56:07.901938 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:07.901903 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14682013-c33e-4cf8-9e36-6c34caa800c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l\" (UID: \"14682013-c33e-4cf8-9e36-6c34caa800c1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" Nov 04 04:56:07.902120 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:07.901955 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj8s9\" (UniqueName: \"kubernetes.io/projected/14682013-c33e-4cf8-9e36-6c34caa800c1-kube-api-access-kj8s9\") pod \"payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l\" (UID: \"14682013-c33e-4cf8-9e36-6c34caa800c1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" Nov 04 04:56:07.908787 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:07.908758 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6"] Nov 04 04:56:07.912739 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:07.912717 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" Nov 04 04:56:07.966126 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:07.966094 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6"] Nov 04 04:56:08.003633 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.003600 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14682013-c33e-4cf8-9e36-6c34caa800c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l\" (UID: \"14682013-c33e-4cf8-9e36-6c34caa800c1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" Nov 04 04:56:08.003818 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.003668 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj8s9\" (UniqueName: \"kubernetes.io/projected/14682013-c33e-4cf8-9e36-6c34caa800c1-kube-api-access-kj8s9\") pod \"payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l\" (UID: \"14682013-c33e-4cf8-9e36-6c34caa800c1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" Nov 04 04:56:08.004334 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.004312 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14682013-c33e-4cf8-9e36-6c34caa800c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l\" (UID: \"14682013-c33e-4cf8-9e36-6c34caa800c1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" Nov 04 04:56:08.060640 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.060606 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj8s9\" (UniqueName: \"kubernetes.io/projected/14682013-c33e-4cf8-9e36-6c34caa800c1-kube-api-access-kj8s9\") pod \"payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l\" (UID: \"14682013-c33e-4cf8-9e36-6c34caa800c1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" Nov 04 04:56:08.093146 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.093116 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" Nov 04 04:56:08.104973 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.104944 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gscnh\" (UniqueName: \"kubernetes.io/projected/05dd3ce4-b0c6-421e-973d-8c2016346904-kube-api-access-gscnh\") pod \"payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6\" (UID: \"05dd3ce4-b0c6-421e-973d-8c2016346904\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" Nov 04 04:56:08.105078 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.104995 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05dd3ce4-b0c6-421e-973d-8c2016346904-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6\" (UID: \"05dd3ce4-b0c6-421e-973d-8c2016346904\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" Nov 04 04:56:08.205886 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.205849 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gscnh\" (UniqueName: \"kubernetes.io/projected/05dd3ce4-b0c6-421e-973d-8c2016346904-kube-api-access-gscnh\") pod \"payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6\" (UID: \"05dd3ce4-b0c6-421e-973d-8c2016346904\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" Nov 04 04:56:08.206046 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.205901 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05dd3ce4-b0c6-421e-973d-8c2016346904-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6\" (UID: \"05dd3ce4-b0c6-421e-973d-8c2016346904\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" Nov 04 04:56:08.206670 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.206647 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05dd3ce4-b0c6-421e-973d-8c2016346904-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6\" (UID: \"05dd3ce4-b0c6-421e-973d-8c2016346904\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" Nov 04 04:56:08.263006 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.262974 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gscnh\" (UniqueName: \"kubernetes.io/projected/05dd3ce4-b0c6-421e-973d-8c2016346904-kube-api-access-gscnh\") pod \"payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6\" (UID: \"05dd3ce4-b0c6-421e-973d-8c2016346904\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" Nov 04 04:56:08.467763 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.467680 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l"] Nov 04 04:56:08.475324 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:56:08.475285 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14682013_c33e_4cf8_9e36_6c34caa800c1.slice/crio-135ebd0d07ca4cad76b43e05a7af9a6cfc164664f43f71d987886f76dbc387c1 WatchSource:0}: Error finding container 135ebd0d07ca4cad76b43e05a7af9a6cfc164664f43f71d987886f76dbc387c1: Status 404 returned error can't find the container with id 135ebd0d07ca4cad76b43e05a7af9a6cfc164664f43f71d987886f76dbc387c1 Nov 04 04:56:08.525309 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.525284 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" Nov 04 04:56:08.879732 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.879689 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" event={"ID":"14682013-c33e-4cf8-9e36-6c34caa800c1","Type":"ContainerStarted","Data":"113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee"} Nov 04 04:56:08.880149 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.879756 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" event={"ID":"14682013-c33e-4cf8-9e36-6c34caa800c1","Type":"ContainerStarted","Data":"135ebd0d07ca4cad76b43e05a7af9a6cfc164664f43f71d987886f76dbc387c1"} Nov 04 04:56:08.880149 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.879783 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" Nov 04 04:56:08.901296 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.901246 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6"] Nov 04 04:56:08.908143 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:56:08.908113 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05dd3ce4_b0c6_421e_973d_8c2016346904.slice/crio-74dfe1705aab7aff04bed521a2ac36fdcf362e686a4ce59f47f6eae30ec3dc83 WatchSource:0}: Error finding container 74dfe1705aab7aff04bed521a2ac36fdcf362e686a4ce59f47f6eae30ec3dc83: Status 404 returned error can't find the container with id 74dfe1705aab7aff04bed521a2ac36fdcf362e686a4ce59f47f6eae30ec3dc83 Nov 04 04:56:08.991194 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:08.991142 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" podStartSLOduration=1.9911273280000001 podStartE2EDuration="1.991127328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:56:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:56:08.989405502 +0000 UTC m=+619.459231628" watchObservedRunningTime="2026-11-04 04:56:08.991127328 +0000 UTC m=+619.460953466" Nov 04 04:56:09.886507 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:09.886470 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" event={"ID":"05dd3ce4-b0c6-421e-973d-8c2016346904","Type":"ContainerStarted","Data":"c62476b18963b89442013632921b7c8ec60cbab8dccca29322a90662e1dc89e1"} Nov 04 04:56:09.887005 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:09.886528 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" event={"ID":"05dd3ce4-b0c6-421e-973d-8c2016346904","Type":"ContainerStarted","Data":"74dfe1705aab7aff04bed521a2ac36fdcf362e686a4ce59f47f6eae30ec3dc83"} Nov 04 04:56:09.887005 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:09.886636 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" Nov 04 04:56:09.996806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:09.996747 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" podStartSLOduration=2.996729036 podStartE2EDuration="2.996729036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:56:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:56:09.994020653 +0000 UTC m=+620.463846792" watchObservedRunningTime="2026-11-04 04:56:09.996729036 +0000 UTC m=+620.466555180" Nov 04 04:56:10.486980 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:10.486945 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj"] Nov 04 04:56:10.490714 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:10.490692 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" Nov 04 04:56:10.527147 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:10.527091 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tbbk\" (UniqueName: \"kubernetes.io/projected/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-kube-api-access-7tbbk\") pod \"payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj\" (UID: \"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" Nov 04 04:56:10.527361 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:10.527157 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj\" (UID: \"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" Nov 04 04:56:10.541831 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:10.541808 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-204e38\"" Nov 04 04:56:10.544763 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:10.544735 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj"] Nov 04 04:56:10.628784 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:10.628742 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tbbk\" (UniqueName: \"kubernetes.io/projected/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-kube-api-access-7tbbk\") pod \"payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj\" (UID: \"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" Nov 04 04:56:10.628986 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:10.628824 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj\" (UID: \"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" Nov 04 04:56:10.629806 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:10.629765 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj\" (UID: \"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" Nov 04 04:56:10.686927 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:10.686896 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tbbk\" (UniqueName: \"kubernetes.io/projected/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-kube-api-access-7tbbk\") pod \"payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj\" (UID: \"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" Nov 04 04:56:10.803910 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:10.803882 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" Nov 04 04:56:11.175654 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:11.175575 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj"] Nov 04 04:56:11.182052 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:56:11.182022 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a0ad64_4dd9_4f9f_b8ab_fb647be8fec6.slice/crio-e7b2b5b970b7419ccbd58c0864fa5b79de7e0ce56e114254f47929459ae1518c WatchSource:0}: Error finding container e7b2b5b970b7419ccbd58c0864fa5b79de7e0ce56e114254f47929459ae1518c: Status 404 returned error can't find the container with id e7b2b5b970b7419ccbd58c0864fa5b79de7e0ce56e114254f47929459ae1518c Nov 04 04:56:11.899226 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:11.899186 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" event={"ID":"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6","Type":"ContainerStarted","Data":"ee423e468e16c520bfd0b05ce65f63ae1a07bb739883451daa8945f8334a6465"} Nov 04 04:56:11.899431 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:11.899249 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" event={"ID":"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6","Type":"ContainerStarted","Data":"e7b2b5b970b7419ccbd58c0864fa5b79de7e0ce56e114254f47929459ae1518c"} Nov 04 04:56:11.899431 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:11.899303 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" Nov 04 04:56:12.008566 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:12.008512 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" podStartSLOduration=2.008488517 podStartE2EDuration="2.008488517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:56:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:56:12.007432614 +0000 UTC m=+622.477258754" watchObservedRunningTime="2026-11-04 04:56:12.008488517 +0000 UTC m=+622.478314655" Nov 04 04:56:15.810526 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:15.810493 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w"] Nov 04 04:56:15.814486 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:15.814467 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" Nov 04 04:56:15.868227 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:15.868195 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w"] Nov 04 04:56:15.878058 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:15.878035 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40ef3408-9353-4074-a199-3e996a324d6e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w\" (UID: \"40ef3408-9353-4074-a199-3e996a324d6e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" Nov 04 04:56:15.878158 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:15.878081 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m6pj\" (UniqueName: \"kubernetes.io/projected/40ef3408-9353-4074-a199-3e996a324d6e-kube-api-access-6m6pj\") pod \"payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w\" (UID: \"40ef3408-9353-4074-a199-3e996a324d6e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" Nov 04 04:56:15.911389 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:15.911365 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-e62689-dockercfg-77cfp\"" Nov 04 04:56:15.911389 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:15.911370 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-e62689\"" Nov 04 04:56:15.960039 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:15.960010 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm"] Nov 04 04:56:15.963827 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:15.963812 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" Nov 04 04:56:15.979471 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:15.979446 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40ef3408-9353-4074-a199-3e996a324d6e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w\" (UID: \"40ef3408-9353-4074-a199-3e996a324d6e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" Nov 04 04:56:15.979608 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:15.979493 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m6pj\" (UniqueName: \"kubernetes.io/projected/40ef3408-9353-4074-a199-3e996a324d6e-kube-api-access-6m6pj\") pod \"payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w\" (UID: \"40ef3408-9353-4074-a199-3e996a324d6e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" Nov 04 04:56:15.980098 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:15.980075 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40ef3408-9353-4074-a199-3e996a324d6e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w\" (UID: \"40ef3408-9353-4074-a199-3e996a324d6e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" Nov 04 04:56:16.000091 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.000068 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm"] Nov 04 04:56:16.036396 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.036366 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m6pj\" (UniqueName: \"kubernetes.io/projected/40ef3408-9353-4074-a199-3e996a324d6e-kube-api-access-6m6pj\") pod \"payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w\" (UID: \"40ef3408-9353-4074-a199-3e996a324d6e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" Nov 04 04:56:16.080602 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.080540 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76df42a9-a151-4532-97aa-0a4c29314243-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm\" (UID: \"76df42a9-a151-4532-97aa-0a4c29314243\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" Nov 04 04:56:16.080602 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.080576 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjjbf\" (UniqueName: \"kubernetes.io/projected/76df42a9-a151-4532-97aa-0a4c29314243-kube-api-access-pjjbf\") pod \"payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm\" (UID: \"76df42a9-a151-4532-97aa-0a4c29314243\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" Nov 04 04:56:16.127711 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.127680 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" Nov 04 04:56:16.182053 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.182019 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76df42a9-a151-4532-97aa-0a4c29314243-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm\" (UID: \"76df42a9-a151-4532-97aa-0a4c29314243\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" Nov 04 04:56:16.182243 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.182085 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjjbf\" (UniqueName: \"kubernetes.io/projected/76df42a9-a151-4532-97aa-0a4c29314243-kube-api-access-pjjbf\") pod \"payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm\" (UID: \"76df42a9-a151-4532-97aa-0a4c29314243\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" Nov 04 04:56:16.183067 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.183033 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76df42a9-a151-4532-97aa-0a4c29314243-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm\" (UID: \"76df42a9-a151-4532-97aa-0a4c29314243\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" Nov 04 04:56:16.240016 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.239985 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjjbf\" (UniqueName: \"kubernetes.io/projected/76df42a9-a151-4532-97aa-0a4c29314243-kube-api-access-pjjbf\") pod \"payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm\" (UID: \"76df42a9-a151-4532-97aa-0a4c29314243\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" Nov 04 04:56:16.276998 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.276974 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" Nov 04 04:56:16.498542 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.498505 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w"] Nov 04 04:56:16.506050 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:56:16.506022 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ef3408_9353_4074_a199_3e996a324d6e.slice/crio-5528ea19ad7a77b159eb9f12755f7a08cd5e6788b8814a2dbdd239bbbbfd37cb WatchSource:0}: Error finding container 5528ea19ad7a77b159eb9f12755f7a08cd5e6788b8814a2dbdd239bbbbfd37cb: Status 404 returned error can't find the container with id 5528ea19ad7a77b159eb9f12755f7a08cd5e6788b8814a2dbdd239bbbbfd37cb Nov 04 04:56:16.649356 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.649300 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm"] Nov 04 04:56:16.655753 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:56:16.655723 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76df42a9_a151_4532_97aa_0a4c29314243.slice/crio-20eadbcf5700f0fad5d578ce2b09c542f4002270663816506576a64e98423b67 WatchSource:0}: Error finding container 20eadbcf5700f0fad5d578ce2b09c542f4002270663816506576a64e98423b67: Status 404 returned error can't find the container with id 20eadbcf5700f0fad5d578ce2b09c542f4002270663816506576a64e98423b67 Nov 04 04:56:16.926155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.926071 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" event={"ID":"76df42a9-a151-4532-97aa-0a4c29314243","Type":"ContainerStarted","Data":"5bbf38efd573790b453b5d18bed5e663f6abe7c2e7baa4242d20324c126662e0"} Nov 04 04:56:16.926155 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.926134 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" event={"ID":"76df42a9-a151-4532-97aa-0a4c29314243","Type":"ContainerStarted","Data":"20eadbcf5700f0fad5d578ce2b09c542f4002270663816506576a64e98423b67"} Nov 04 04:56:16.926565 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.926164 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" Nov 04 04:56:16.927801 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.927776 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" event={"ID":"40ef3408-9353-4074-a199-3e996a324d6e","Type":"ContainerStarted","Data":"6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145"} Nov 04 04:56:16.927875 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.927824 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" event={"ID":"40ef3408-9353-4074-a199-3e996a324d6e","Type":"ContainerStarted","Data":"5528ea19ad7a77b159eb9f12755f7a08cd5e6788b8814a2dbdd239bbbbfd37cb"} Nov 04 04:56:16.927875 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:16.927867 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" Nov 04 04:56:17.036855 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:17.036798 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" podStartSLOduration=2.036780283 podStartE2EDuration="2.036780283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:56:17.033998861 +0000 UTC m=+627.503825000" watchObservedRunningTime="2026-11-04 04:56:17.036780283 +0000 UTC m=+627.506606423" Nov 04 04:56:17.143044 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:17.142995 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" podStartSLOduration=2.142981102 podStartE2EDuration="2.142981102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:56:17.141832472 +0000 UTC m=+627.611658611" watchObservedRunningTime="2026-11-04 04:56:17.142981102 +0000 UTC m=+627.612807241" Nov 04 04:56:17.875463 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:17.875435 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" Nov 04 04:56:17.875634 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:17.875502 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" Nov 04 04:56:18.618218 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:18.618190 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc"] Nov 04 04:56:18.622054 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:18.622036 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" Nov 04 04:56:18.680955 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:18.680932 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-19bf5b\"" Nov 04 04:56:18.697235 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:18.697210 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-19bf5b-dockercfg-28b92\"" Nov 04 04:56:18.704094 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:18.704071 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc\" (UID: \"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" Nov 04 04:56:18.704199 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:18.704107 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k6wb\" (UniqueName: \"kubernetes.io/projected/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-kube-api-access-4k6wb\") pod \"payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc\" (UID: \"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" Nov 04 04:56:18.731094 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:18.731053 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc"] Nov 04 04:56:18.805157 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:18.805123 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc\" (UID: \"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" Nov 04 04:56:18.805157 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:18.805162 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k6wb\" (UniqueName: \"kubernetes.io/projected/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-kube-api-access-4k6wb\") pod \"payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc\" (UID: \"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" Nov 04 04:56:18.805816 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:18.805797 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc\" (UID: \"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" Nov 04 04:56:18.863818 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:18.863791 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k6wb\" (UniqueName: \"kubernetes.io/projected/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-kube-api-access-4k6wb\") pod \"payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc\" (UID: \"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" Nov 04 04:56:18.934867 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:18.934798 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" Nov 04 04:56:19.304532 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:19.304505 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc"] Nov 04 04:56:19.311297 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:56:19.311256 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e8d9137_183b_4fd3_a138_bc3e1be7f0a6.slice/crio-8cc5a3d2a1852fa68303baea311259906145a0b3b9f315b51ae3d59c30c01923 WatchSource:0}: Error finding container 8cc5a3d2a1852fa68303baea311259906145a0b3b9f315b51ae3d59c30c01923: Status 404 returned error can't find the container with id 8cc5a3d2a1852fa68303baea311259906145a0b3b9f315b51ae3d59c30c01923 Nov 04 04:56:19.889967 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:19.889940 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" Nov 04 04:56:19.944526 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:19.944489 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" event={"ID":"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6","Type":"ContainerStarted","Data":"2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174"} Nov 04 04:56:19.944702 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:19.944569 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" event={"ID":"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6","Type":"ContainerStarted","Data":"8cc5a3d2a1852fa68303baea311259906145a0b3b9f315b51ae3d59c30c01923"} Nov 04 04:56:19.944702 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:19.944592 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" Nov 04 04:56:20.108505 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:20.108227 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" podStartSLOduration=2.10821006 podStartE2EDuration="2.10821006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:56:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:56:20.107655462 +0000 UTC m=+630.577481602" watchObservedRunningTime="2026-11-04 04:56:20.10821006 +0000 UTC m=+630.578036202" Nov 04 04:56:20.896068 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:20.896037 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" Nov 04 04:56:22.907782 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:22.907756 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" Nov 04 04:56:23.973035 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:23.973004 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9"] Nov 04 04:56:23.976796 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:23.976778 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" Nov 04 04:56:24.028518 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.028487 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-204fa0\"" Nov 04 04:56:24.054633 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.054604 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/929914ca-f11b-48ad-9e00-0c33b3e649d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9\" (UID: \"929914ca-f11b-48ad-9e00-0c33b3e649d1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" Nov 04 04:56:24.054795 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.054698 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9ckx\" (UniqueName: \"kubernetes.io/projected/929914ca-f11b-48ad-9e00-0c33b3e649d1-kube-api-access-k9ckx\") pod \"payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9\" (UID: \"929914ca-f11b-48ad-9e00-0c33b3e649d1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" Nov 04 04:56:24.071240 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.071218 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-204fa0-dockercfg-vkglj\"" Nov 04 04:56:24.073695 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.073676 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9"] Nov 04 04:56:24.127704 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.127673 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4"] Nov 04 04:56:24.131529 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.131505 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" Nov 04 04:56:24.155488 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.155459 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/929914ca-f11b-48ad-9e00-0c33b3e649d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9\" (UID: \"929914ca-f11b-48ad-9e00-0c33b3e649d1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" Nov 04 04:56:24.155612 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.155514 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9ckx\" (UniqueName: \"kubernetes.io/projected/929914ca-f11b-48ad-9e00-0c33b3e649d1-kube-api-access-k9ckx\") pod \"payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9\" (UID: \"929914ca-f11b-48ad-9e00-0c33b3e649d1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" Nov 04 04:56:24.156128 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.156105 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/929914ca-f11b-48ad-9e00-0c33b3e649d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9\" (UID: \"929914ca-f11b-48ad-9e00-0c33b3e649d1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" Nov 04 04:56:24.186721 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.186696 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4"] Nov 04 04:56:24.214042 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.214012 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9ckx\" (UniqueName: \"kubernetes.io/projected/929914ca-f11b-48ad-9e00-0c33b3e649d1-kube-api-access-k9ckx\") pod \"payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9\" (UID: \"929914ca-f11b-48ad-9e00-0c33b3e649d1\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" Nov 04 04:56:24.256237 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.256161 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4\" (UID: \"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" Nov 04 04:56:24.256237 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.256214 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgsx4\" (UniqueName: \"kubernetes.io/projected/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-kube-api-access-jgsx4\") pod \"payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4\" (UID: \"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" Nov 04 04:56:24.290023 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.289993 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" Nov 04 04:56:24.357968 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.357939 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4\" (UID: \"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" Nov 04 04:56:24.358104 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.357984 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgsx4\" (UniqueName: \"kubernetes.io/projected/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-kube-api-access-jgsx4\") pod \"payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4\" (UID: \"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" Nov 04 04:56:24.359123 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.359074 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4\" (UID: \"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" Nov 04 04:56:24.415169 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.415142 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgsx4\" (UniqueName: \"kubernetes.io/projected/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-kube-api-access-jgsx4\") pod \"payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4\" (UID: \"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" Nov 04 04:56:24.444588 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.444559 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" Nov 04 04:56:24.659909 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.659877 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9"] Nov 04 04:56:24.666672 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:56:24.666636 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod929914ca_f11b_48ad_9e00_0c33b3e649d1.slice/crio-3a9ab6a8a33d99d70da22a8910a79e0e1aa7b6d94bf5ce3a0576f0a1b3d9e7e5 WatchSource:0}: Error finding container 3a9ab6a8a33d99d70da22a8910a79e0e1aa7b6d94bf5ce3a0576f0a1b3d9e7e5: Status 404 returned error can't find the container with id 3a9ab6a8a33d99d70da22a8910a79e0e1aa7b6d94bf5ce3a0576f0a1b3d9e7e5 Nov 04 04:56:24.817175 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.817142 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4"] Nov 04 04:56:24.823146 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:56:24.823117 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedcb05a0_70d6_4abe_b1c5_85bb3f871c5c.slice/crio-0d1a72cedd8e4feedba9961425d96c08505926eb2be9e8c43755cb7050e7afe4 WatchSource:0}: Error finding container 0d1a72cedd8e4feedba9961425d96c08505926eb2be9e8c43755cb7050e7afe4: Status 404 returned error can't find the container with id 0d1a72cedd8e4feedba9961425d96c08505926eb2be9e8c43755cb7050e7afe4 Nov 04 04:56:24.971333 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.971232 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" event={"ID":"929914ca-f11b-48ad-9e00-0c33b3e649d1","Type":"ContainerStarted","Data":"40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6"} Nov 04 04:56:24.971333 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.971306 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" event={"ID":"929914ca-f11b-48ad-9e00-0c33b3e649d1","Type":"ContainerStarted","Data":"3a9ab6a8a33d99d70da22a8910a79e0e1aa7b6d94bf5ce3a0576f0a1b3d9e7e5"} Nov 04 04:56:24.971532 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.971384 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" Nov 04 04:56:24.972878 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.972855 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" event={"ID":"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c","Type":"ContainerStarted","Data":"e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1"} Nov 04 04:56:24.972988 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.972895 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" event={"ID":"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c","Type":"ContainerStarted","Data":"0d1a72cedd8e4feedba9961425d96c08505926eb2be9e8c43755cb7050e7afe4"} Nov 04 04:56:24.972988 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:24.972916 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" Nov 04 04:56:25.080783 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:25.080732 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" podStartSLOduration=2.080717886 podStartE2EDuration="2.080717886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:56:25.079286052 +0000 UTC m=+635.549112185" watchObservedRunningTime="2026-11-04 04:56:25.080717886 +0000 UTC m=+635.550544025" Nov 04 04:56:25.187607 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:25.187556 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" podStartSLOduration=1.187542572 podStartE2EDuration="1.187542572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:56:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:56:25.186626689 +0000 UTC m=+635.656452829" watchObservedRunningTime="2026-11-04 04:56:25.187542572 +0000 UTC m=+635.657368713" Nov 04 04:56:26.754105 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:26.754070 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk"] Nov 04 04:56:26.758225 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:26.758206 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" Nov 04 04:56:26.852386 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:26.852357 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w6-db8fae-dockercfg-nsvbz\"" Nov 04 04:56:26.852386 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:26.852385 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-db8fae\"" Nov 04 04:56:26.855868 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:26.855829 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk"] Nov 04 04:56:26.880044 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:26.880004 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk\" (UID: \"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" Nov 04 04:56:26.880215 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:26.880084 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2sgl\" (UniqueName: \"kubernetes.io/projected/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-kube-api-access-z2sgl\") pod \"payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk\" (UID: \"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" Nov 04 04:56:26.981115 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:26.981079 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk\" (UID: \"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" Nov 04 04:56:26.982072 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:26.982044 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2sgl\" (UniqueName: \"kubernetes.io/projected/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-kube-api-access-z2sgl\") pod \"payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk\" (UID: \"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" Nov 04 04:56:26.982291 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:26.981943 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk\" (UID: \"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" Nov 04 04:56:27.039602 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:27.039539 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2sgl\" (UniqueName: \"kubernetes.io/projected/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-kube-api-access-z2sgl\") pod \"payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk\" (UID: \"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" Nov 04 04:56:27.072449 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:27.072419 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" Nov 04 04:56:27.441991 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:27.441957 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk"] Nov 04 04:56:27.448125 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:56:27.448100 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1733b7c2_b85c_4ee9_859c_a6f6f617bbc7.slice/crio-ba0ab813d68a043e2058c28f08c7390a9484c6cf9c014946f867d30e652d9e9d WatchSource:0}: Error finding container ba0ab813d68a043e2058c28f08c7390a9484c6cf9c014946f867d30e652d9e9d: Status 404 returned error can't find the container with id ba0ab813d68a043e2058c28f08c7390a9484c6cf9c014946f867d30e652d9e9d Nov 04 04:56:27.935394 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:27.935363 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" Nov 04 04:56:27.935829 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:27.935543 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" Nov 04 04:56:28.005248 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:28.005213 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" event={"ID":"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7","Type":"ContainerStarted","Data":"593821518bf6c2cadab86da26a5adc052521df374fe2bef8863ee98d2ca68632"} Nov 04 04:56:28.005456 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:28.005291 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" event={"ID":"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7","Type":"ContainerStarted","Data":"ba0ab813d68a043e2058c28f08c7390a9484c6cf9c014946f867d30e652d9e9d"} Nov 04 04:56:28.005456 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:28.005328 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" Nov 04 04:56:28.191041 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:56:28.190953 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:56:28.261737 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:28.261688 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" podStartSLOduration=2.261674978 podStartE2EDuration="2.261674978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:56:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:56:28.258954988 +0000 UTC m=+638.728781116" watchObservedRunningTime="2026-11-04 04:56:28.261674978 +0000 UTC m=+638.731501113" Nov 04 04:56:30.954891 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:30.954863 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" Nov 04 04:56:35.981603 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:35.981574 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" Nov 04 04:56:35.982227 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:35.981651 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" Nov 04 04:56:39.014194 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:39.014169 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" Nov 04 04:56:41.995935 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:41.995900 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq"] Nov 04 04:56:42.000173 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.000148 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.079188 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.079154 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-c5bb6d\"/\"openshift-service-ca.crt\"" Nov 04 04:56:42.095240 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.095215 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-c5bb6d\"/\"kube-root-ca.crt\"" Nov 04 04:56:42.095414 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.095322 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-c5bb6d\"/\"default-dockercfg-kcsrz\"" Nov 04 04:56:42.095414 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.095400 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-c5bb6d\"/\"simulator-w2-c5bb6d-kserve-self-signed-certs\"" Nov 04 04:56:42.097980 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.097957 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq"] Nov 04 04:56:42.136238 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.136213 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-model-cache\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.136412 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.136252 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-dshm\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.136412 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.136292 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-tmp-dir\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.136412 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.136379 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-home\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.136525 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.136433 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50106aec-7c7a-4c81-beb4-9f015c566a75-tls-certs\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.136525 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.136484 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhsfw\" (UniqueName: \"kubernetes.io/projected/50106aec-7c7a-4c81-beb4-9f015c566a75-kube-api-access-jhsfw\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.237749 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.237715 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-dshm\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.237749 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.237752 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-tmp-dir\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.237953 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.237779 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-home\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.237953 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.237827 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50106aec-7c7a-4c81-beb4-9f015c566a75-tls-certs\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.237953 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.237856 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhsfw\" (UniqueName: \"kubernetes.io/projected/50106aec-7c7a-4c81-beb4-9f015c566a75-kube-api-access-jhsfw\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.238101 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.237981 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-model-cache\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.238281 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.238240 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-tmp-dir\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.238392 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.238295 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-home\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.238392 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.238318 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-model-cache\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.240087 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.240068 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-dshm\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.240443 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.240423 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50106aec-7c7a-4c81-beb4-9f015c566a75-tls-certs\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.295175 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.295107 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhsfw\" (UniqueName: \"kubernetes.io/projected/50106aec-7c7a-4c81-beb4-9f015c566a75-kube-api-access-jhsfw\") pod \"simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.311378 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.311348 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:42.693517 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:42.693483 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq"] Nov 04 04:56:42.699324 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:56:42.699298 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50106aec_7c7a_4c81_beb4_9f015c566a75.slice/crio-f80bb4659d0dbfa85cbc960383899761407b68e5f4bcffb8ceb038e10d72990e WatchSource:0}: Error finding container f80bb4659d0dbfa85cbc960383899761407b68e5f4bcffb8ceb038e10d72990e: Status 404 returned error can't find the container with id f80bb4659d0dbfa85cbc960383899761407b68e5f4bcffb8ceb038e10d72990e Nov 04 04:56:43.089146 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:43.089108 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" event={"ID":"50106aec-7c7a-4c81-beb4-9f015c566a75","Type":"ContainerStarted","Data":"f80bb4659d0dbfa85cbc960383899761407b68e5f4bcffb8ceb038e10d72990e"} Nov 04 04:56:45.103150 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:45.103108 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" event={"ID":"50106aec-7c7a-4c81-beb4-9f015c566a75","Type":"ContainerStarted","Data":"de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564"} Nov 04 04:56:45.211134 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:45.211079 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" podStartSLOduration=2.30722758 podStartE2EDuration="4.211066064s" totalImagesPullingTime="1.903838484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:56:45.210976033 +0000 UTC m=+655.680802173" watchObservedRunningTime="2026-11-04 04:56:45.211066064 +0000 UTC m=+655.680892203" Nov 04 04:56:45.311657 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:45.311626 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:52.312522 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:52.312487 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:52.325071 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:52.325046 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:53.165637 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:56:53.165606 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 04:56:58.190149 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:56:58.190109 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:57:07.093536 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.093457 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh"] Nov 04 04:57:07.097394 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.097372 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.163606 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.163572 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-model-cache\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.163606 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.163619 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tls-certs\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.163850 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.163786 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-home\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.163850 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.163841 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2ksh\" (UniqueName: \"kubernetes.io/projected/cb7c4acd-be17-472b-b28a-ca273c6fccc4-kube-api-access-m2ksh\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.163970 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.163944 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-dshm\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.164101 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.164053 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tmp-dir\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.195705 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.195679 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-204e38\"/\"kube-root-ca.crt\"" Nov 04 04:57:07.195840 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.195678 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-204e38\"/\"simulator-w3-204e38-kserve-self-signed-certs\"" Nov 04 04:57:07.195840 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.195678 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-204e38\"/\"openshift-service-ca.crt\"" Nov 04 04:57:07.195840 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.195777 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-204e38\"/\"default-dockercfg-wlp5v\"" Nov 04 04:57:07.198092 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.198073 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh"] Nov 04 04:57:07.265251 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.265217 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2ksh\" (UniqueName: \"kubernetes.io/projected/cb7c4acd-be17-472b-b28a-ca273c6fccc4-kube-api-access-m2ksh\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.265470 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.265287 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-dshm\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.265470 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.265349 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tmp-dir\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.265470 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.265399 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-model-cache\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.265470 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.265436 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tls-certs\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.265650 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.265507 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-home\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.265862 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.265833 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tmp-dir\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.265862 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.265856 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-model-cache\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.266046 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.265888 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-home\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.267531 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.267509 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-dshm\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.268004 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.267984 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tls-certs\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.322276 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.322240 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2ksh\" (UniqueName: \"kubernetes.io/projected/cb7c4acd-be17-472b-b28a-ca273c6fccc4-kube-api-access-m2ksh\") pod \"simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.409561 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.409480 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:07.788675 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:07.788596 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh"] Nov 04 04:57:07.794836 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:57:07.794805 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb7c4acd_be17_472b_b28a_ca273c6fccc4.slice/crio-4c6a57818f779e4fa549a43f4cfae0caeac3aeb87f44d3370bdd3685cc66dda8 WatchSource:0}: Error finding container 4c6a57818f779e4fa549a43f4cfae0caeac3aeb87f44d3370bdd3685cc66dda8: Status 404 returned error can't find the container with id 4c6a57818f779e4fa549a43f4cfae0caeac3aeb87f44d3370bdd3685cc66dda8 Nov 04 04:57:08.237935 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:08.237893 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" event={"ID":"cb7c4acd-be17-472b-b28a-ca273c6fccc4","Type":"ContainerStarted","Data":"525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c"} Nov 04 04:57:08.237935 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:08.237938 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" event={"ID":"cb7c4acd-be17-472b-b28a-ca273c6fccc4","Type":"ContainerStarted","Data":"4c6a57818f779e4fa549a43f4cfae0caeac3aeb87f44d3370bdd3685cc66dda8"} Nov 04 04:57:08.350576 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:08.350532 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" podStartSLOduration=1.350516949 podStartE2EDuration="1.350516949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:57:08.348635402 +0000 UTC m=+678.818461541" watchObservedRunningTime="2026-11-04 04:57:08.350516949 +0000 UTC m=+678.820343087" Nov 04 04:57:08.409852 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:08.409822 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:17.410555 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:17.410521 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:17.423370 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:17.423345 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:18.303080 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:18.303051 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 04:57:28.188686 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:57:28.188651 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:57:30.662800 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.662770 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c"] Nov 04 04:57:30.668707 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.668687 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.764638 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.764610 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-c5bb6d\"/\"premium-w2-c5bb6d-kserve-self-signed-certs\"" Nov 04 04:57:30.767142 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.767117 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c"] Nov 04 04:57:30.776882 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.776855 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lvxs\" (UniqueName: \"kubernetes.io/projected/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-kube-api-access-4lvxs\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.777038 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.777013 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tmp-dir\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.777174 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.777150 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-model-cache\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.777374 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.777358 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-dshm\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.777453 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.777415 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-home\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.777608 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.777589 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tls-certs\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.878807 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.878776 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tls-certs\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.878989 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.878839 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lvxs\" (UniqueName: \"kubernetes.io/projected/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-kube-api-access-4lvxs\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.878989 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.878874 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tmp-dir\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.878989 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.878897 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-model-cache\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.878989 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.878935 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-dshm\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.878989 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.878980 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-home\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.879319 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.879298 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-model-cache\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.879389 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.879347 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tmp-dir\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.879449 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.879391 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-home\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.881213 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.881180 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-dshm\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.881581 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.881560 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tls-certs\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.938754 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.938675 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lvxs\" (UniqueName: \"kubernetes.io/projected/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-kube-api-access-4lvxs\") pod \"premium-w2-c5bb6d-kserve-866f4897b6-xfv4c\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:30.982450 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:30.982416 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:31.374720 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:31.374688 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c"] Nov 04 04:57:31.381523 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:57:31.381495 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef55c5ea_46c5_422f_851f_f85fadc9bbf1.slice/crio-c163aac8eba58bf22f0f3c4a44c23ec7dc630e24b86e8adc3433892e01f330e0 WatchSource:0}: Error finding container c163aac8eba58bf22f0f3c4a44c23ec7dc630e24b86e8adc3433892e01f330e0: Status 404 returned error can't find the container with id c163aac8eba58bf22f0f3c4a44c23ec7dc630e24b86e8adc3433892e01f330e0 Nov 04 04:57:32.374876 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:32.374839 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" event={"ID":"ef55c5ea-46c5-422f-851f-f85fadc9bbf1","Type":"ContainerStarted","Data":"37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0"} Nov 04 04:57:32.375291 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:32.374889 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" event={"ID":"ef55c5ea-46c5-422f-851f-f85fadc9bbf1","Type":"ContainerStarted","Data":"c163aac8eba58bf22f0f3c4a44c23ec7dc630e24b86e8adc3433892e01f330e0"} Nov 04 04:57:32.486275 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:32.486207 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" podStartSLOduration=2.486193141 podStartE2EDuration="2.486193141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:57:32.484111406 +0000 UTC m=+702.953937553" watchObservedRunningTime="2026-11-04 04:57:32.486193141 +0000 UTC m=+702.956019313" Nov 04 04:57:32.983091 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:32.983058 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:35.013641 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.013609 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9"] Nov 04 04:57:35.017380 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.017362 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.068735 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.068711 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-a48f7e\"/\"openshift-service-ca.crt\"" Nov 04 04:57:35.114761 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.114716 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-a48f7e\"/\"kube-root-ca.crt\"" Nov 04 04:57:35.114923 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.114784 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a48f7e\"/\"default-dockercfg-fs466\"" Nov 04 04:57:35.114923 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.114812 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a48f7e\"/\"simulator-w4-a48f7e-kserve-self-signed-certs\"" Nov 04 04:57:35.117391 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.117374 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9"] Nov 04 04:57:35.122362 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.122344 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-model-cache\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.122428 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.122409 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26762e2a-611d-4269-8014-aa397641e47c-tls-certs\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.122499 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.122480 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-tmp-dir\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.122537 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.122530 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-home\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.122569 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.122552 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-dshm\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.122661 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.122642 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dshlt\" (UniqueName: \"kubernetes.io/projected/26762e2a-611d-4269-8014-aa397641e47c-kube-api-access-dshlt\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.223451 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.223418 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26762e2a-611d-4269-8014-aa397641e47c-tls-certs\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.223451 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.223457 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-tmp-dir\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.223668 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.223493 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-home\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.223668 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.223516 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-dshm\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.223668 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.223545 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dshlt\" (UniqueName: \"kubernetes.io/projected/26762e2a-611d-4269-8014-aa397641e47c-kube-api-access-dshlt\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.223668 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.223603 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-model-cache\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.223973 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.223925 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-home\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.224117 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.224041 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-tmp-dir\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.224117 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.224104 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-model-cache\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.225813 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.225786 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-dshm\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.226108 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.226090 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26762e2a-611d-4269-8014-aa397641e47c-tls-certs\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.282966 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.282900 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dshlt\" (UniqueName: \"kubernetes.io/projected/26762e2a-611d-4269-8014-aa397641e47c-kube-api-access-dshlt\") pod \"simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.330075 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.330049 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:35.706335 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:35.706303 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9"] Nov 04 04:57:35.712538 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:57:35.712511 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26762e2a_611d_4269_8014_aa397641e47c.slice/crio-dc2bc204bd4e081e8ab423b3f5a2c062b3435d988b7442220852438afeb1aac3 WatchSource:0}: Error finding container dc2bc204bd4e081e8ab423b3f5a2c062b3435d988b7442220852438afeb1aac3: Status 404 returned error can't find the container with id dc2bc204bd4e081e8ab423b3f5a2c062b3435d988b7442220852438afeb1aac3 Nov 04 04:57:36.403090 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:36.403053 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" event={"ID":"26762e2a-611d-4269-8014-aa397641e47c","Type":"ContainerStarted","Data":"460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91"} Nov 04 04:57:36.403090 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:36.403090 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" event={"ID":"26762e2a-611d-4269-8014-aa397641e47c","Type":"ContainerStarted","Data":"dc2bc204bd4e081e8ab423b3f5a2c062b3435d988b7442220852438afeb1aac3"} Nov 04 04:57:36.517276 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:36.517221 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" podStartSLOduration=2.517208078 podStartE2EDuration="2.517208078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:57:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:57:36.514919455 +0000 UTC m=+706.984745598" watchObservedRunningTime="2026-11-04 04:57:36.517208078 +0000 UTC m=+706.987034217" Nov 04 04:57:37.330769 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:37.330739 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:40.983142 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:40.983103 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:40.995941 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:40.995920 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:41.457048 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:41.457016 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 04:57:45.330515 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:45.330485 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:45.342993 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:45.342958 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:45.473524 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:45.473500 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 04:57:54.895831 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:54.895799 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p"] Nov 04 04:57:54.901354 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:54.901328 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:54.975748 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:54.975716 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p"] Nov 04 04:57:54.996739 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:54.996618 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-e62689\"/\"openshift-service-ca.crt\"" Nov 04 04:57:54.996739 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:54.996664 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-e62689\"/\"kube-root-ca.crt\"" Nov 04 04:57:54.996739 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:54.996691 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-e62689\"/\"simulator-w1-e62689-kserve-self-signed-certs\"" Nov 04 04:57:54.996959 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:54.996747 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-e62689\"/\"default-dockercfg-mnjpr\"" Nov 04 04:57:55.002311 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.002285 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-model-cache\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.002444 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.002331 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-home\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.002444 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.002412 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tls-certs\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.002444 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.002429 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tmp-dir\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.002544 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.002528 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84gk5\" (UniqueName: \"kubernetes.io/projected/08dff920-431b-4fc1-bfb3-5f01a5a171fb-kube-api-access-84gk5\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.002578 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.002547 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-dshm\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.103906 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.103877 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-home\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.104071 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.103930 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tls-certs\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.104071 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.103959 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tmp-dir\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.104230 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.104198 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84gk5\" (UniqueName: \"kubernetes.io/projected/08dff920-431b-4fc1-bfb3-5f01a5a171fb-kube-api-access-84gk5\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.104401 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.104330 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-dshm\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.104401 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.104388 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-model-cache\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.104533 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.104449 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tmp-dir\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.104533 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.104494 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-home\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.104726 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.104704 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-model-cache\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.107172 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.107150 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-dshm\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.107293 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.107195 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tls-certs\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.160937 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.160874 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84gk5\" (UniqueName: \"kubernetes.io/projected/08dff920-431b-4fc1-bfb3-5f01a5a171fb-kube-api-access-84gk5\") pod \"simulator-w1-e62689-kserve-78b7468864-8hh5p\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.213061 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.213029 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:55.591685 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:55.591654 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p"] Nov 04 04:57:55.598098 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:57:55.598073 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08dff920_431b_4fc1_bfb3_5f01a5a171fb.slice/crio-43de5fd510306ce25eeb0eb28211558063f4a8fd176b0c3162a4dc4788892bd8 WatchSource:0}: Error finding container 43de5fd510306ce25eeb0eb28211558063f4a8fd176b0c3162a4dc4788892bd8: Status 404 returned error can't find the container with id 43de5fd510306ce25eeb0eb28211558063f4a8fd176b0c3162a4dc4788892bd8 Nov 04 04:57:56.524769 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:56.524723 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" event={"ID":"08dff920-431b-4fc1-bfb3-5f01a5a171fb","Type":"ContainerStarted","Data":"fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308"} Nov 04 04:57:56.524769 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:56.524773 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" event={"ID":"08dff920-431b-4fc1-bfb3-5f01a5a171fb","Type":"ContainerStarted","Data":"43de5fd510306ce25eeb0eb28211558063f4a8fd176b0c3162a4dc4788892bd8"} Nov 04 04:57:56.634902 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:56.634852 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" podStartSLOduration=2.634839445 podStartE2EDuration="2.634839445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:57:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:57:56.633800469 +0000 UTC m=+727.103626621" watchObservedRunningTime="2026-11-04 04:57:56.634839445 +0000 UTC m=+727.104665583" Nov 04 04:57:57.213141 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:57:57.213109 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:57:58.189056 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:57:58.189015 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:58:05.214079 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:05.214045 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:58:05.227141 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:05.227119 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:58:05.586538 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:05.586512 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 04:58:15.202881 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.202846 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w"] Nov 04 04:58:15.207096 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.207074 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.303692 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.303644 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-home\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.303892 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.303801 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtrnx\" (UniqueName: \"kubernetes.io/projected/732b58ba-fc75-486d-8bd7-445b928fe8e1-kube-api-access-mtrnx\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.303892 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.303850 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-204e38\"/\"premium-w3-204e38-kserve-self-signed-certs\"" Nov 04 04:58:15.303892 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.303877 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-tmp-dir\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.304038 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.303968 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-model-cache\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.304038 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.303995 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/732b58ba-fc75-486d-8bd7-445b928fe8e1-tls-certs\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.304038 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.304014 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-dshm\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.306539 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.306518 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w"] Nov 04 04:58:15.405122 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.405085 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-model-cache\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.405340 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.405129 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/732b58ba-fc75-486d-8bd7-445b928fe8e1-tls-certs\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.405340 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.405298 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-dshm\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.405467 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.405380 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-home\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.405528 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.405511 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtrnx\" (UniqueName: \"kubernetes.io/projected/732b58ba-fc75-486d-8bd7-445b928fe8e1-kube-api-access-mtrnx\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.405584 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.405541 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-model-cache\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.405665 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.405630 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-tmp-dir\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.405723 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.405688 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-home\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.405943 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.405921 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-tmp-dir\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.407542 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.407521 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-dshm\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.407804 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.407787 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/732b58ba-fc75-486d-8bd7-445b928fe8e1-tls-certs\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.463386 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.463295 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtrnx\" (UniqueName: \"kubernetes.io/projected/732b58ba-fc75-486d-8bd7-445b928fe8e1-kube-api-access-mtrnx\") pod \"premium-w3-204e38-kserve-c87948dd5-jmh7w\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.522393 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.522348 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:15.926937 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:15.926903 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w"] Nov 04 04:58:15.933957 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:58:15.933921 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod732b58ba_fc75_486d_8bd7_445b928fe8e1.slice/crio-c2dd868681bd60e56fb9c34a4437315fcacc821aecb42271205b8cffaadce184 WatchSource:0}: Error finding container c2dd868681bd60e56fb9c34a4437315fcacc821aecb42271205b8cffaadce184: Status 404 returned error can't find the container with id c2dd868681bd60e56fb9c34a4437315fcacc821aecb42271205b8cffaadce184 Nov 04 04:58:16.639914 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:16.639875 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" event={"ID":"732b58ba-fc75-486d-8bd7-445b928fe8e1","Type":"ContainerStarted","Data":"41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea"} Nov 04 04:58:16.639914 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:16.639926 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" event={"ID":"732b58ba-fc75-486d-8bd7-445b928fe8e1","Type":"ContainerStarted","Data":"c2dd868681bd60e56fb9c34a4437315fcacc821aecb42271205b8cffaadce184"} Nov 04 04:58:16.750273 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:16.750202 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" podStartSLOduration=1.750188619 podStartE2EDuration="1.750188619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:58:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:58:16.748293794 +0000 UTC m=+747.218119924" watchObservedRunningTime="2026-11-04 04:58:16.750188619 +0000 UTC m=+747.220014758" Nov 04 04:58:17.522828 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:17.522788 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:25.523118 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:25.523084 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:25.535295 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:25.535255 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:25.699648 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:25.699621 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 04:58:28.189216 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:58:28.189183 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:58:49.814559 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:49.814528 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz"] Nov 04 04:58:49.818531 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:49.818510 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:49.915344 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:49.915309 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a48f7e\"/\"premium-w4-a48f7e-kserve-self-signed-certs\"" Nov 04 04:58:49.918050 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:49.918025 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz"] Nov 04 04:58:49.945585 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:49.945550 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gdml\" (UniqueName: \"kubernetes.io/projected/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-kube-api-access-4gdml\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:49.945757 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:49.945692 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-model-cache\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:49.945757 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:49.945735 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tls-certs\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:49.945869 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:49.945762 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-dshm\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:49.945950 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:49.945928 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-home\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:49.945999 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:49.945967 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tmp-dir\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.047322 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.047257 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-model-cache\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.047502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.047357 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tls-certs\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.047502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.047396 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-dshm\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.047502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.047444 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-home\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.047502 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.047470 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tmp-dir\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.047714 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.047502 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gdml\" (UniqueName: \"kubernetes.io/projected/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-kube-api-access-4gdml\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.047714 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.047647 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-model-cache\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.047832 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.047811 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-home\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.047890 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.047850 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tmp-dir\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.049839 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.049809 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-dshm\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.050138 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.050115 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tls-certs\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.104636 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.104558 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gdml\" (UniqueName: \"kubernetes.io/projected/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-kube-api-access-4gdml\") pod \"premium-w4-a48f7e-kserve-75869df4ff-477xz\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.130445 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.130410 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:50.532783 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.532695 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz"] Nov 04 04:58:50.539235 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:58:50.539203 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14fa9f1c_5b3e_4364_a533_001d9c32e6b0.slice/crio-2b736c1131a6cbf0d87dc29016647e2a1d1c0e9fbebe08f68102024f84a38b68 WatchSource:0}: Error finding container 2b736c1131a6cbf0d87dc29016647e2a1d1c0e9fbebe08f68102024f84a38b68: Status 404 returned error can't find the container with id 2b736c1131a6cbf0d87dc29016647e2a1d1c0e9fbebe08f68102024f84a38b68 Nov 04 04:58:50.835577 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.835541 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" event={"ID":"14fa9f1c-5b3e-4364-a533-001d9c32e6b0","Type":"ContainerStarted","Data":"5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd"} Nov 04 04:58:50.835577 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.835584 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" event={"ID":"14fa9f1c-5b3e-4364-a533-001d9c32e6b0","Type":"ContainerStarted","Data":"2b736c1131a6cbf0d87dc29016647e2a1d1c0e9fbebe08f68102024f84a38b68"} Nov 04 04:58:50.945989 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:50.945936 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" podStartSLOduration=1.945921593 podStartE2EDuration="1.945921593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:58:50.944222755 +0000 UTC m=+781.414048894" watchObservedRunningTime="2026-11-04 04:58:50.945921593 +0000 UTC m=+781.415747763" Nov 04 04:58:51.130864 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:51.130790 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:58:55.161483 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.161450 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj"] Nov 04 04:58:55.166201 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.166180 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.214962 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.214929 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-c5bb6d-openshift-default-dockercfg-7x2zp\"" Nov 04 04:58:55.263651 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.263611 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj"] Nov 04 04:58:55.308500 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.308464 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-token\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.308658 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.308508 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-credential-socket\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.308658 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.308609 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-envoy\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.308658 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.308643 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr7m2\" (UniqueName: \"kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-kube-api-access-kr7m2\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.308761 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.308666 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-certs\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.308795 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.308766 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27d6755b-919a-4c3d-8f3d-673d8292ce05-istiod-ca-cert\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.308840 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.308825 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-podinfo\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.308879 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.308863 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-socket\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.308913 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.308889 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-data\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410214 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410178 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-token\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410410 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410229 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-credential-socket\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410410 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410325 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-envoy\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410410 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410359 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr7m2\" (UniqueName: \"kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-kube-api-access-kr7m2\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410410 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410388 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-certs\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410620 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410412 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27d6755b-919a-4c3d-8f3d-673d8292ce05-istiod-ca-cert\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410620 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410437 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-podinfo\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410620 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410480 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-socket\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410620 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410509 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-data\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410812 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410708 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-credential-socket\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410870 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410804 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-certs\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410926 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410869 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-socket\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.410926 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.410886 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-data\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.411337 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.411318 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27d6755b-919a-4c3d-8f3d-673d8292ce05-istiod-ca-cert\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.412618 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.412564 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-envoy\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.412793 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.412776 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-podinfo\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.467293 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.467230 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-token\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.467446 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.467385 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr7m2\" (UniqueName: \"kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-kube-api-access-kr7m2\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.480397 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.480374 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:55.916916 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.916883 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj"] Nov 04 04:58:55.924021 ip-10-0-132-197 kubenswrapper[4955]: W1104 04:58:55.923987 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d6755b_919a_4c3d_8f3d_673d8292ce05.slice/crio-bce88299dd696b382471f5cb0287e496b8ae504062cb2e007116a52b760f1296 WatchSource:0}: Error finding container bce88299dd696b382471f5cb0287e496b8ae504062cb2e007116a52b760f1296: Status 404 returned error can't find the container with id bce88299dd696b382471f5cb0287e496b8ae504062cb2e007116a52b760f1296 Nov 04 04:58:55.926255 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.926226 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:58:55.926351 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.926305 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:58:55.926351 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:55.926335 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 04:58:56.883659 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:56.883619 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" event={"ID":"27d6755b-919a-4c3d-8f3d-673d8292ce05","Type":"ContainerStarted","Data":"70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4"} Nov 04 04:58:56.884178 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:56.883698 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" event={"ID":"27d6755b-919a-4c3d-8f3d-673d8292ce05","Type":"ContainerStarted","Data":"bce88299dd696b382471f5cb0287e496b8ae504062cb2e007116a52b760f1296"} Nov 04 04:58:57.044430 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:57.044375 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" podStartSLOduration=2.04435907 podStartE2EDuration="2.04435907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:58:57.042154599 +0000 UTC m=+787.511980750" watchObservedRunningTime="2026-11-04 04:58:57.04435907 +0000 UTC m=+787.514185209" Nov 04 04:58:57.480513 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:57.480472 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:58:57.482673 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:57.482646 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 04 04:58:57.482809 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:57.482699 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" podUID="27d6755b-919a-4c3d-8f3d-673d8292ce05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 04 04:58:58.204604 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:58:58.204568 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:58:58.481739 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:58.481647 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 04 04:58:58.481739 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:58.481706 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" podUID="27d6755b-919a-4c3d-8f3d-673d8292ce05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 04 04:58:59.481334 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:59.481294 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 04 04:58:59.481840 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:58:59.481357 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" podUID="27d6755b-919a-4c3d-8f3d-673d8292ce05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 04 04:59:00.130926 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:59:00.130889 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:59:00.143591 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:59:00.143563 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:59:00.481665 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:59:00.481580 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 04 04:59:00.481665 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:59:00.481631 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" podUID="27d6755b-919a-4c3d-8f3d-673d8292ce05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 04 04:59:00.923650 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:59:00.923622 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 04:59:01.481585 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:59:01.481548 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 04 04:59:01.481776 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:59:01.481608 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" podUID="27d6755b-919a-4c3d-8f3d-673d8292ce05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 04 04:59:02.675452 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:59:02.675420 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:59:02.675958 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:59:02.675848 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:59:02.677239 ip-10-0-132-197 kubenswrapper[4955]: I1104 04:59:02.677213 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 04:59:28.188620 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:59:28.188585 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 04:59:58.189243 ip-10-0-132-197 kubenswrapper[4955]: E1104 04:59:58.189208 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:00:00.170321 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.170240 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl"] Nov 04 05:00:00.174449 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.174424 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6"] Nov 04 05:00:00.174599 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.174551 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" Nov 04 05:00:00.178411 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.178393 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c"] Nov 04 05:00:00.178534 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.178508 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" Nov 04 05:00:00.181811 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.181796 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" Nov 04 05:00:00.216235 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.216212 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv"] Nov 04 05:00:00.219943 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.219922 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" Nov 04 05:00:00.222995 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.222974 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nz4vh\"" Nov 04 05:00:00.264816 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.264785 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6"] Nov 04 05:00:00.268772 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.268750 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl"] Nov 04 05:00:00.290102 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.290069 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11c22530-78b8-4805-a614-5ccdc96abd22-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c\" (UID: \"11c22530-78b8-4805-a614-5ccdc96abd22\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" Nov 04 05:00:00.290245 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.290151 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8dg7\" (UniqueName: \"kubernetes.io/projected/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-kube-api-access-m8dg7\") pod \"maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv\" (UID: \"7ffe4759-69b1-43ff-b1f7-bc6a3068749f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" Nov 04 05:00:00.290245 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.290228 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3641b82e-eaa3-43ff-b437-a986ca399896-maas-api-service-ca\") pod \"maas-api-key-cleanup-29896140-5p9vl\" (UID: \"3641b82e-eaa3-43ff-b437-a986ca399896\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" Nov 04 05:00:00.290398 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.290291 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd423c9-5ce5-4f6e-a687-864d213ce51a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6\" (UID: \"4dd423c9-5ce5-4f6e-a687-864d213ce51a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" Nov 04 05:00:00.290398 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.290345 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2prt7\" (UniqueName: \"kubernetes.io/projected/4dd423c9-5ce5-4f6e-a687-864d213ce51a-kube-api-access-2prt7\") pod \"maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6\" (UID: \"4dd423c9-5ce5-4f6e-a687-864d213ce51a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" Nov 04 05:00:00.290507 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.290418 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv\" (UID: \"7ffe4759-69b1-43ff-b1f7-bc6a3068749f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" Nov 04 05:00:00.290507 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.290447 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck4dh\" (UniqueName: \"kubernetes.io/projected/11c22530-78b8-4805-a614-5ccdc96abd22-kube-api-access-ck4dh\") pod \"maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c\" (UID: \"11c22530-78b8-4805-a614-5ccdc96abd22\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" Nov 04 05:00:00.290507 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.290482 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfcqs\" (UniqueName: \"kubernetes.io/projected/3641b82e-eaa3-43ff-b437-a986ca399896-kube-api-access-rfcqs\") pod \"maas-api-key-cleanup-29896140-5p9vl\" (UID: \"3641b82e-eaa3-43ff-b437-a986ca399896\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" Nov 04 05:00:00.310096 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.310069 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c"] Nov 04 05:00:00.314437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.314412 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv"] Nov 04 05:00:00.391514 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.391488 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv\" (UID: \"7ffe4759-69b1-43ff-b1f7-bc6a3068749f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" Nov 04 05:00:00.391662 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.391517 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck4dh\" (UniqueName: \"kubernetes.io/projected/11c22530-78b8-4805-a614-5ccdc96abd22-kube-api-access-ck4dh\") pod \"maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c\" (UID: \"11c22530-78b8-4805-a614-5ccdc96abd22\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" Nov 04 05:00:00.391662 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.391541 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfcqs\" (UniqueName: \"kubernetes.io/projected/3641b82e-eaa3-43ff-b437-a986ca399896-kube-api-access-rfcqs\") pod \"maas-api-key-cleanup-29896140-5p9vl\" (UID: \"3641b82e-eaa3-43ff-b437-a986ca399896\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" Nov 04 05:00:00.391662 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.391580 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11c22530-78b8-4805-a614-5ccdc96abd22-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c\" (UID: \"11c22530-78b8-4805-a614-5ccdc96abd22\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" Nov 04 05:00:00.391662 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.391608 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8dg7\" (UniqueName: \"kubernetes.io/projected/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-kube-api-access-m8dg7\") pod \"maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv\" (UID: \"7ffe4759-69b1-43ff-b1f7-bc6a3068749f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" Nov 04 05:00:00.391662 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.391651 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3641b82e-eaa3-43ff-b437-a986ca399896-maas-api-service-ca\") pod \"maas-api-key-cleanup-29896140-5p9vl\" (UID: \"3641b82e-eaa3-43ff-b437-a986ca399896\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" Nov 04 05:00:00.391938 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.391675 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd423c9-5ce5-4f6e-a687-864d213ce51a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6\" (UID: \"4dd423c9-5ce5-4f6e-a687-864d213ce51a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" Nov 04 05:00:00.391938 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.391740 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2prt7\" (UniqueName: \"kubernetes.io/projected/4dd423c9-5ce5-4f6e-a687-864d213ce51a-kube-api-access-2prt7\") pod \"maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6\" (UID: \"4dd423c9-5ce5-4f6e-a687-864d213ce51a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" Nov 04 05:00:00.392372 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.392353 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv\" (UID: \"7ffe4759-69b1-43ff-b1f7-bc6a3068749f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" Nov 04 05:00:00.392430 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.392353 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11c22530-78b8-4805-a614-5ccdc96abd22-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c\" (UID: \"11c22530-78b8-4805-a614-5ccdc96abd22\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" Nov 04 05:00:00.392562 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.392541 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd423c9-5ce5-4f6e-a687-864d213ce51a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6\" (UID: \"4dd423c9-5ce5-4f6e-a687-864d213ce51a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" Nov 04 05:00:00.392601 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.392541 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3641b82e-eaa3-43ff-b437-a986ca399896-maas-api-service-ca\") pod \"maas-api-key-cleanup-29896140-5p9vl\" (UID: \"3641b82e-eaa3-43ff-b437-a986ca399896\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" Nov 04 05:00:00.448855 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.448798 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck4dh\" (UniqueName: \"kubernetes.io/projected/11c22530-78b8-4805-a614-5ccdc96abd22-kube-api-access-ck4dh\") pod \"maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c\" (UID: \"11c22530-78b8-4805-a614-5ccdc96abd22\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" Nov 04 05:00:00.449047 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.449025 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2prt7\" (UniqueName: \"kubernetes.io/projected/4dd423c9-5ce5-4f6e-a687-864d213ce51a-kube-api-access-2prt7\") pod \"maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6\" (UID: \"4dd423c9-5ce5-4f6e-a687-864d213ce51a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" Nov 04 05:00:00.449305 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.449278 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfcqs\" (UniqueName: \"kubernetes.io/projected/3641b82e-eaa3-43ff-b437-a986ca399896-kube-api-access-rfcqs\") pod \"maas-api-key-cleanup-29896140-5p9vl\" (UID: \"3641b82e-eaa3-43ff-b437-a986ca399896\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" Nov 04 05:00:00.449305 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.449293 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8dg7\" (UniqueName: \"kubernetes.io/projected/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-kube-api-access-m8dg7\") pod \"maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv\" (UID: \"7ffe4759-69b1-43ff-b1f7-bc6a3068749f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" Nov 04 05:00:00.519984 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.519961 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" Nov 04 05:00:00.528301 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.528251 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" Nov 04 05:00:00.536199 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.536180 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" Nov 04 05:00:00.542125 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.542106 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" Nov 04 05:00:00.916962 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.916927 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6"] Nov 04 05:00:00.930394 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:00:00.930367 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd423c9_5ce5_4f6e_a687_864d213ce51a.slice/crio-01ebbc81d477d3f463ddef3effe4ad384b63fb9f0fa48725576829808d8adb9d WatchSource:0}: Error finding container 01ebbc81d477d3f463ddef3effe4ad384b63fb9f0fa48725576829808d8adb9d: Status 404 returned error can't find the container with id 01ebbc81d477d3f463ddef3effe4ad384b63fb9f0fa48725576829808d8adb9d Nov 04 05:00:00.966364 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.966331 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl"] Nov 04 05:00:00.969127 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.969104 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c"] Nov 04 05:00:00.971689 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:00.971662 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv"] Nov 04 05:00:00.972928 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:00:00.972908 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3641b82e_eaa3_43ff_b437_a986ca399896.slice/crio-683ca8d29db2419b0d2757829b3bbe90d62bd6409f5801f94b2e672ca71635d2 WatchSource:0}: Error finding container 683ca8d29db2419b0d2757829b3bbe90d62bd6409f5801f94b2e672ca71635d2: Status 404 returned error can't find the container with id 683ca8d29db2419b0d2757829b3bbe90d62bd6409f5801f94b2e672ca71635d2 Nov 04 05:00:00.975826 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:00:00.975801 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c22530_78b8_4805_a614_5ccdc96abd22.slice/crio-04f35583d0e80c3de7de9d6afbfce0568784deb934b05dffc2b16e0e24d4332b WatchSource:0}: Error finding container 04f35583d0e80c3de7de9d6afbfce0568784deb934b05dffc2b16e0e24d4332b: Status 404 returned error can't find the container with id 04f35583d0e80c3de7de9d6afbfce0568784deb934b05dffc2b16e0e24d4332b Nov 04 05:00:00.976941 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:00:00.976922 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ffe4759_69b1_43ff_b1f7_bc6a3068749f.slice/crio-f85ecc10199e2d493da25a38f5f1c87c1d3de7a709cc636a4f730d4f447d9b9e WatchSource:0}: Error finding container f85ecc10199e2d493da25a38f5f1c87c1d3de7a709cc636a4f730d4f447d9b9e: Status 404 returned error can't find the container with id f85ecc10199e2d493da25a38f5f1c87c1d3de7a709cc636a4f730d4f447d9b9e Nov 04 05:00:01.305745 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.305685 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" event={"ID":"3641b82e-eaa3-43ff-b437-a986ca399896","Type":"ContainerStarted","Data":"683ca8d29db2419b0d2757829b3bbe90d62bd6409f5801f94b2e672ca71635d2"} Nov 04 05:00:01.307065 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.307041 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" event={"ID":"7ffe4759-69b1-43ff-b1f7-bc6a3068749f","Type":"ContainerStarted","Data":"f85ecc10199e2d493da25a38f5f1c87c1d3de7a709cc636a4f730d4f447d9b9e"} Nov 04 05:00:01.308300 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.308278 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" event={"ID":"11c22530-78b8-4805-a614-5ccdc96abd22","Type":"ContainerStarted","Data":"04f35583d0e80c3de7de9d6afbfce0568784deb934b05dffc2b16e0e24d4332b"} Nov 04 05:00:01.309485 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.309462 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" event={"ID":"4dd423c9-5ce5-4f6e-a687-864d213ce51a","Type":"ContainerStarted","Data":"01ebbc81d477d3f463ddef3effe4ad384b63fb9f0fa48725576829808d8adb9d"} Nov 04 05:00:01.710276 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.710183 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp"] Nov 04 05:00:01.715648 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.715628 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.808951 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.808916 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-home\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.808951 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.808952 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-dshm\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.809169 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.808985 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rdgv\" (UniqueName: \"kubernetes.io/projected/92236588-ff47-4a13-bc40-022f0f21c77c-kube-api-access-6rdgv\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.809205 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.809179 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-tmp-dir\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.809255 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.809240 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92236588-ff47-4a13-bc40-022f0f21c77c-tls-certs\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.809334 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.809320 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-model-cache\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.811301 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.811278 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-c5bb6d\"/\"distinct-w2-c5bb6d-kserve-self-signed-certs\"" Nov 04 05:00:01.814413 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.814393 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp"] Nov 04 05:00:01.910340 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.910302 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-tmp-dir\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.910540 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.910394 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92236588-ff47-4a13-bc40-022f0f21c77c-tls-certs\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.910540 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.910440 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-model-cache\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.910540 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.910506 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-home\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.910540 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.910530 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-dshm\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.910760 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.910563 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rdgv\" (UniqueName: \"kubernetes.io/projected/92236588-ff47-4a13-bc40-022f0f21c77c-kube-api-access-6rdgv\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.910760 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.910707 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-tmp-dir\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.910890 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.910853 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-model-cache\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.910890 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.910872 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-home\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.912892 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.912856 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-dshm\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.913069 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.913051 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92236588-ff47-4a13-bc40-022f0f21c77c-tls-certs\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:01.968439 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:01.968359 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rdgv\" (UniqueName: \"kubernetes.io/projected/92236588-ff47-4a13-bc40-022f0f21c77c-kube-api-access-6rdgv\") pod \"distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:02.028064 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:02.028003 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:02.414024 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:02.413991 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp"] Nov 04 05:00:02.420328 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:00:02.420300 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92236588_ff47_4a13_bc40_022f0f21c77c.slice/crio-1fb559b92894567952de849fb6123ab260e5a94b871a3f7d46b59ff194b3a9fe WatchSource:0}: Error finding container 1fb559b92894567952de849fb6123ab260e5a94b871a3f7d46b59ff194b3a9fe: Status 404 returned error can't find the container with id 1fb559b92894567952de849fb6123ab260e5a94b871a3f7d46b59ff194b3a9fe Nov 04 05:00:03.326043 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:03.326007 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" event={"ID":"92236588-ff47-4a13-bc40-022f0f21c77c","Type":"ContainerStarted","Data":"7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc"} Nov 04 05:00:03.326225 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:03.326054 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" event={"ID":"92236588-ff47-4a13-bc40-022f0f21c77c","Type":"ContainerStarted","Data":"1fb559b92894567952de849fb6123ab260e5a94b871a3f7d46b59ff194b3a9fe"} Nov 04 05:00:03.437330 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:03.437276 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" podStartSLOduration=2.437247099 podStartE2EDuration="2.437247099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:00:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:00:03.43533059 +0000 UTC m=+853.905156722" watchObservedRunningTime="2026-11-04 05:00:03.437247099 +0000 UTC m=+853.907073237" Nov 04 05:00:04.028888 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:04.028858 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:07.357498 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:07.357423 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" event={"ID":"3641b82e-eaa3-43ff-b437-a986ca399896","Type":"ContainerStarted","Data":"ee37453a1d294adec91a250df4e1ff786c2a2c36f41a9ad45bbe1f2ad019aba3"} Nov 04 05:00:08.367419 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:08.367387 4955 generic.go:356] "Generic (PLEG): container finished" podID="3641b82e-eaa3-43ff-b437-a986ca399896" containerID="ee37453a1d294adec91a250df4e1ff786c2a2c36f41a9ad45bbe1f2ad019aba3" exitCode=60 Nov 04 05:00:08.367788 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:08.367482 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" event={"ID":"3641b82e-eaa3-43ff-b437-a986ca399896","Type":"ContainerDied","Data":"ee37453a1d294adec91a250df4e1ff786c2a2c36f41a9ad45bbe1f2ad019aba3"} Nov 04 05:00:08.367788 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:08.367761 4955 scope.go:122] "RemoveContainer" containerID="ee37453a1d294adec91a250df4e1ff786c2a2c36f41a9ad45bbe1f2ad019aba3" Nov 04 05:00:08.369196 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:08.369172 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" event={"ID":"7ffe4759-69b1-43ff-b1f7-bc6a3068749f","Type":"ContainerStarted","Data":"8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240"} Nov 04 05:00:08.369426 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:08.369409 4955 scope.go:122] "RemoveContainer" containerID="8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240" Nov 04 05:00:09.376573 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.376542 4955 generic.go:356] "Generic (PLEG): container finished" podID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" containerID="8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240" exitCode=60 Nov 04 05:00:09.376573 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.376564 4955 generic.go:356] "Generic (PLEG): container finished" podID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" containerID="d6fb1555832795c9a1a543bb2622124ddb32d6237cd9a4e47a1c3631775a136d" exitCode=60 Nov 04 05:00:09.377064 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.376629 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" event={"ID":"7ffe4759-69b1-43ff-b1f7-bc6a3068749f","Type":"ContainerDied","Data":"8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240"} Nov 04 05:00:09.377064 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.376689 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" event={"ID":"7ffe4759-69b1-43ff-b1f7-bc6a3068749f","Type":"ContainerDied","Data":"d6fb1555832795c9a1a543bb2622124ddb32d6237cd9a4e47a1c3631775a136d"} Nov 04 05:00:09.377064 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.376713 4955 scope.go:122] "RemoveContainer" containerID="8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240" Nov 04 05:00:09.377064 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.376873 4955 scope.go:122] "RemoveContainer" containerID="d6fb1555832795c9a1a543bb2622124ddb32d6237cd9a4e47a1c3631775a136d" Nov 04 05:00:09.377300 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:09.377153 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv_odh-ai-gateway-infra(7ffe4759-69b1-43ff-b1f7-bc6a3068749f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" Nov 04 05:00:09.378236 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.378215 4955 generic.go:356] "Generic (PLEG): container finished" podID="11c22530-78b8-4805-a614-5ccdc96abd22" containerID="0863e71e3ac9f9a459805f4c7bd018da7cdc6e2afa00e35b242e5790868af1d0" exitCode=60 Nov 04 05:00:09.378388 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.378303 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" event={"ID":"11c22530-78b8-4805-a614-5ccdc96abd22","Type":"ContainerDied","Data":"0863e71e3ac9f9a459805f4c7bd018da7cdc6e2afa00e35b242e5790868af1d0"} Nov 04 05:00:09.378554 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.378538 4955 scope.go:122] "RemoveContainer" containerID="0863e71e3ac9f9a459805f4c7bd018da7cdc6e2afa00e35b242e5790868af1d0" Nov 04 05:00:09.380291 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.380252 4955 generic.go:356] "Generic (PLEG): container finished" podID="3641b82e-eaa3-43ff-b437-a986ca399896" containerID="52d9e5ca23efc0b3dead8d8f0a8eaabbfc416ebafe114f98d4d95d3ba126d73d" exitCode=60 Nov 04 05:00:09.380385 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.380293 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" event={"ID":"3641b82e-eaa3-43ff-b437-a986ca399896","Type":"ContainerDied","Data":"52d9e5ca23efc0b3dead8d8f0a8eaabbfc416ebafe114f98d4d95d3ba126d73d"} Nov 04 05:00:09.380617 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.380556 4955 scope.go:122] "RemoveContainer" containerID="52d9e5ca23efc0b3dead8d8f0a8eaabbfc416ebafe114f98d4d95d3ba126d73d" Nov 04 05:00:09.380824 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:09.380800 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29896140-5p9vl_odh-ai-gateway-infra(3641b82e-eaa3-43ff-b437-a986ca399896)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" Nov 04 05:00:09.392927 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.392891 4955 scope.go:122] "RemoveContainer" containerID="8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240" Nov 04 05:00:09.393186 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:09.393163 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240\": container with ID starting with 8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240 not found: ID does not exist" containerID="8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240" Nov 04 05:00:09.393228 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.393196 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240"} err="failed to get container status \"8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240\": rpc error: code = NotFound desc = could not find container \"8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240\": container with ID starting with 8c918f1da4b28b2f70b61effbdb0a1c1bb676ec59d7ad2fc26d042d89844b240 not found: ID does not exist" Nov 04 05:00:09.393228 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:09.393219 4955 scope.go:122] "RemoveContainer" containerID="ee37453a1d294adec91a250df4e1ff786c2a2c36f41a9ad45bbe1f2ad019aba3" Nov 04 05:00:10.388870 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:10.388845 4955 scope.go:122] "RemoveContainer" containerID="52d9e5ca23efc0b3dead8d8f0a8eaabbfc416ebafe114f98d4d95d3ba126d73d" Nov 04 05:00:10.389368 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:10.389155 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29896140-5p9vl_odh-ai-gateway-infra(3641b82e-eaa3-43ff-b437-a986ca399896)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" Nov 04 05:00:10.390680 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:10.390654 4955 scope.go:122] "RemoveContainer" containerID="d6fb1555832795c9a1a543bb2622124ddb32d6237cd9a4e47a1c3631775a136d" Nov 04 05:00:10.390971 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:10.390943 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv_odh-ai-gateway-infra(7ffe4759-69b1-43ff-b1f7-bc6a3068749f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" Nov 04 05:00:10.392619 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:10.392589 4955 generic.go:356] "Generic (PLEG): container finished" podID="11c22530-78b8-4805-a614-5ccdc96abd22" containerID="a7437c04bac249e7aff7840fdf4029b8e9fc79161f8ed278917cad959d2276fc" exitCode=60 Nov 04 05:00:10.392715 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:10.392637 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" event={"ID":"11c22530-78b8-4805-a614-5ccdc96abd22","Type":"ContainerDied","Data":"a7437c04bac249e7aff7840fdf4029b8e9fc79161f8ed278917cad959d2276fc"} Nov 04 05:00:10.392715 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:10.392691 4955 scope.go:122] "RemoveContainer" containerID="0863e71e3ac9f9a459805f4c7bd018da7cdc6e2afa00e35b242e5790868af1d0" Nov 04 05:00:10.392939 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:10.392920 4955 scope.go:122] "RemoveContainer" containerID="a7437c04bac249e7aff7840fdf4029b8e9fc79161f8ed278917cad959d2276fc" Nov 04 05:00:10.393240 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:10.393206 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c_odh-ai-gateway-infra(11c22530-78b8-4805-a614-5ccdc96abd22)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" Nov 04 05:00:11.405939 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:11.405855 4955 scope.go:122] "RemoveContainer" containerID="a7437c04bac249e7aff7840fdf4029b8e9fc79161f8ed278917cad959d2276fc" Nov 04 05:00:11.406387 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:11.406143 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c_odh-ai-gateway-infra(11c22530-78b8-4805-a614-5ccdc96abd22)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" Nov 04 05:00:11.407729 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:11.407514 4955 generic.go:356] "Generic (PLEG): container finished" podID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" containerID="a156366a108a223d0c177bb24f0ca2c2523de8457c9bc4996ee637569c986e2d" exitCode=60 Nov 04 05:00:11.407729 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:11.407559 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" event={"ID":"4dd423c9-5ce5-4f6e-a687-864d213ce51a","Type":"ContainerDied","Data":"a156366a108a223d0c177bb24f0ca2c2523de8457c9bc4996ee637569c986e2d"} Nov 04 05:00:11.407871 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:11.407856 4955 scope.go:122] "RemoveContainer" containerID="a156366a108a223d0c177bb24f0ca2c2523de8457c9bc4996ee637569c986e2d" Nov 04 05:00:12.028596 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:12.028522 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:12.041831 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:12.041807 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:12.415825 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:12.415792 4955 generic.go:356] "Generic (PLEG): container finished" podID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" containerID="ed70fc3af41cc6c5b64976c1dafa0e671a4092207288c50bfa6c411987e97314" exitCode=60 Nov 04 05:00:12.416466 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:12.415881 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" event={"ID":"4dd423c9-5ce5-4f6e-a687-864d213ce51a","Type":"ContainerDied","Data":"ed70fc3af41cc6c5b64976c1dafa0e671a4092207288c50bfa6c411987e97314"} Nov 04 05:00:12.416466 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:12.415954 4955 scope.go:122] "RemoveContainer" containerID="a156366a108a223d0c177bb24f0ca2c2523de8457c9bc4996ee637569c986e2d" Nov 04 05:00:12.416466 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:12.416122 4955 scope.go:122] "RemoveContainer" containerID="ed70fc3af41cc6c5b64976c1dafa0e671a4092207288c50bfa6c411987e97314" Nov 04 05:00:12.416466 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:12.416429 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6_odh-ai-gateway-infra(4dd423c9-5ce5-4f6e-a687-864d213ce51a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" Nov 04 05:00:12.429298 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:12.428795 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:00:13.424736 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:13.424706 4955 scope.go:122] "RemoveContainer" containerID="ed70fc3af41cc6c5b64976c1dafa0e671a4092207288c50bfa6c411987e97314" Nov 04 05:00:13.425127 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:13.424988 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6_odh-ai-gateway-infra(4dd423c9-5ce5-4f6e-a687-864d213ce51a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" Nov 04 05:00:19.899068 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:19.899027 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf"] Nov 04 05:00:19.904789 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:19.904764 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:19.976101 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:19.976068 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf"] Nov 04 05:00:19.999332 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:19.999305 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-204e38\"/\"distinct-w3-204e38-kserve-self-signed-certs\"" Nov 04 05:00:20.007168 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.007143 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-tmp-dir\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.007307 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.007254 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-home\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.007360 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.007335 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-dshm\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.007403 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.007379 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f210ccde-8b86-463c-aa08-800670728377-tls-certs\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.007442 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.007434 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq92k\" (UniqueName: \"kubernetes.io/projected/f210ccde-8b86-463c-aa08-800670728377-kube-api-access-hq92k\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.007527 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.007511 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-model-cache\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.108284 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.108237 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-home\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.108476 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.108314 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-dshm\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.108476 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.108368 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f210ccde-8b86-463c-aa08-800670728377-tls-certs\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.108476 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.108438 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq92k\" (UniqueName: \"kubernetes.io/projected/f210ccde-8b86-463c-aa08-800670728377-kube-api-access-hq92k\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.108476 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.108458 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-model-cache\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.108711 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.108540 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-tmp-dir\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.108768 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.108725 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-home\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.108931 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.108907 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-tmp-dir\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.109062 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.108904 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-model-cache\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.110634 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.110605 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-dshm\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.110785 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.110768 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f210ccde-8b86-463c-aa08-800670728377-tls-certs\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.169278 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.169203 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq92k\" (UniqueName: \"kubernetes.io/projected/f210ccde-8b86-463c-aa08-800670728377-kube-api-access-hq92k\") pod \"distinct-w3-204e38-kserve-584895fd48-v8kxf\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.216629 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.216599 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:20.622500 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:20.622470 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf"] Nov 04 05:00:20.629026 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:00:20.628998 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf210ccde_8b86_463c_aa08_800670728377.slice/crio-6f044e660912bee88f3a362f002196ea85d9234c77c4f9cd66a3546d68bbfba4 WatchSource:0}: Error finding container 6f044e660912bee88f3a362f002196ea85d9234c77c4f9cd66a3546d68bbfba4: Status 404 returned error can't find the container with id 6f044e660912bee88f3a362f002196ea85d9234c77c4f9cd66a3546d68bbfba4 Nov 04 05:00:21.476333 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:21.476294 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" event={"ID":"f210ccde-8b86-463c-aa08-800670728377","Type":"ContainerStarted","Data":"a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f"} Nov 04 05:00:21.476333 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:21.476339 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" event={"ID":"f210ccde-8b86-463c-aa08-800670728377","Type":"ContainerStarted","Data":"6f044e660912bee88f3a362f002196ea85d9234c77c4f9cd66a3546d68bbfba4"} Nov 04 05:00:21.586647 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:21.586601 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" podStartSLOduration=2.586585865 podStartE2EDuration="2.586585865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:00:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:00:21.58445002 +0000 UTC m=+872.054276160" watchObservedRunningTime="2026-11-04 05:00:21.586585865 +0000 UTC m=+872.056412003" Nov 04 05:00:22.217151 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:22.217110 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:22.648360 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:22.648334 4955 scope.go:122] "RemoveContainer" containerID="52d9e5ca23efc0b3dead8d8f0a8eaabbfc416ebafe114f98d4d95d3ba126d73d" Nov 04 05:00:22.648816 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:22.648410 4955 scope.go:122] "RemoveContainer" containerID="d6fb1555832795c9a1a543bb2622124ddb32d6237cd9a4e47a1c3631775a136d" Nov 04 05:00:23.490834 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:23.490799 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" event={"ID":"3641b82e-eaa3-43ff-b437-a986ca399896","Type":"ContainerStarted","Data":"821b279258acb5ed0063b3eed6ef468ddfd36a688244663f058c43ee30cc6b2a"} Nov 04 05:00:23.493386 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:23.493362 4955 generic.go:356] "Generic (PLEG): container finished" podID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" containerID="5addd50a5e0814f92a82e00d613f79f323d9931a794f47c168abadaaa238015a" exitCode=60 Nov 04 05:00:23.493507 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:23.493432 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" event={"ID":"7ffe4759-69b1-43ff-b1f7-bc6a3068749f","Type":"ContainerDied","Data":"5addd50a5e0814f92a82e00d613f79f323d9931a794f47c168abadaaa238015a"} Nov 04 05:00:23.493507 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:23.493484 4955 scope.go:122] "RemoveContainer" containerID="d6fb1555832795c9a1a543bb2622124ddb32d6237cd9a4e47a1c3631775a136d" Nov 04 05:00:23.493896 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:23.493871 4955 scope.go:122] "RemoveContainer" containerID="5addd50a5e0814f92a82e00d613f79f323d9931a794f47c168abadaaa238015a" Nov 04 05:00:23.494110 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:23.494092 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv_odh-ai-gateway-infra(7ffe4759-69b1-43ff-b1f7-bc6a3068749f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" Nov 04 05:00:23.599461 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:23.599417 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" podStartSLOduration=18.055289497 podStartE2EDuration="23.599402821s" totalImagesPullingTime="5.544113324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:00:07.468466969 +0000 UTC m=+857.938293109" watchObservedRunningTime="2026-11-04 05:00:23.599402821 +0000 UTC m=+874.069228959" Nov 04 05:00:23.648541 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:23.648519 4955 scope.go:122] "RemoveContainer" containerID="a7437c04bac249e7aff7840fdf4029b8e9fc79161f8ed278917cad959d2276fc" Nov 04 05:00:24.501061 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.501029 4955 generic.go:356] "Generic (PLEG): container finished" podID="3641b82e-eaa3-43ff-b437-a986ca399896" containerID="821b279258acb5ed0063b3eed6ef468ddfd36a688244663f058c43ee30cc6b2a" exitCode=60 Nov 04 05:00:24.501182 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.501102 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" event={"ID":"3641b82e-eaa3-43ff-b437-a986ca399896","Type":"ContainerDied","Data":"821b279258acb5ed0063b3eed6ef468ddfd36a688244663f058c43ee30cc6b2a"} Nov 04 05:00:24.501182 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.501163 4955 scope.go:122] "RemoveContainer" containerID="52d9e5ca23efc0b3dead8d8f0a8eaabbfc416ebafe114f98d4d95d3ba126d73d" Nov 04 05:00:24.501611 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.501591 4955 scope.go:122] "RemoveContainer" containerID="821b279258acb5ed0063b3eed6ef468ddfd36a688244663f058c43ee30cc6b2a" Nov 04 05:00:24.501885 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:24.501863 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29896140-5p9vl_odh-ai-gateway-infra(3641b82e-eaa3-43ff-b437-a986ca399896)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" Nov 04 05:00:24.504552 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.504528 4955 generic.go:356] "Generic (PLEG): container finished" podID="11c22530-78b8-4805-a614-5ccdc96abd22" containerID="0b0d6d4328ea690a4f15edfde4fa25607c019cd8b5fd3c102a1bf6d87f01e211" exitCode=60 Nov 04 05:00:24.504666 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.504598 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" event={"ID":"11c22530-78b8-4805-a614-5ccdc96abd22","Type":"ContainerDied","Data":"0b0d6d4328ea690a4f15edfde4fa25607c019cd8b5fd3c102a1bf6d87f01e211"} Nov 04 05:00:24.504965 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.504946 4955 scope.go:122] "RemoveContainer" containerID="0b0d6d4328ea690a4f15edfde4fa25607c019cd8b5fd3c102a1bf6d87f01e211" Nov 04 05:00:24.505227 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:24.505206 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c_odh-ai-gateway-infra(11c22530-78b8-4805-a614-5ccdc96abd22)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" Nov 04 05:00:24.522320 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.522303 4955 scope.go:122] "RemoveContainer" containerID="a7437c04bac249e7aff7840fdf4029b8e9fc79161f8ed278917cad959d2276fc" Nov 04 05:00:24.608813 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.608789 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl"] Nov 04 05:00:24.717714 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.717630 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv"] Nov 04 05:00:24.877788 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.877765 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" Nov 04 05:00:24.959958 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.959934 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-maas-api-service-ca\") pod \"7ffe4759-69b1-43ff-b1f7-bc6a3068749f\" (UID: \"7ffe4759-69b1-43ff-b1f7-bc6a3068749f\") " Nov 04 05:00:24.960088 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.959990 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-kube-api-access-m8dg7\" (UniqueName: \"kubernetes.io/projected/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-kube-api-access-m8dg7\") pod \"7ffe4759-69b1-43ff-b1f7-bc6a3068749f\" (UID: \"7ffe4759-69b1-43ff-b1f7-bc6a3068749f\") " Nov 04 05:00:24.960258 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.960238 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-maas-api-service-ca" pod "7ffe4759-69b1-43ff-b1f7-bc6a3068749f" (UID: "7ffe4759-69b1-43ff-b1f7-bc6a3068749f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:00:24.960465 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.960446 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-maas-api-service-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:00:24.962190 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:24.962168 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-kube-api-access-m8dg7" pod "7ffe4759-69b1-43ff-b1f7-bc6a3068749f" (UID: "7ffe4759-69b1-43ff-b1f7-bc6a3068749f"). InnerVolumeSpecName "kube-api-access-m8dg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:00:25.061213 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.061179 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8dg7\" (UniqueName: \"kubernetes.io/projected/7ffe4759-69b1-43ff-b1f7-bc6a3068749f-kube-api-access-m8dg7\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:00:25.517149 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.517122 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" event={"ID":"7ffe4759-69b1-43ff-b1f7-bc6a3068749f","Type":"ContainerDied","Data":"f85ecc10199e2d493da25a38f5f1c87c1d3de7a709cc636a4f730d4f447d9b9e"} Nov 04 05:00:25.517284 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.517155 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv" Nov 04 05:00:25.517284 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.517188 4955 scope.go:122] "RemoveContainer" containerID="5addd50a5e0814f92a82e00d613f79f323d9931a794f47c168abadaaa238015a" Nov 04 05:00:25.662010 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.661986 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" Nov 04 05:00:25.735310 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.735281 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv"] Nov 04 05:00:25.741790 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.741765 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c"] Nov 04 05:00:25.747804 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.747779 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-a48f7e-29896140-7fmzv"] Nov 04 05:00:25.767207 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.767146 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3641b82e-eaa3-43ff-b437-a986ca399896-kube-api-access-rfcqs\" (UniqueName: \"kubernetes.io/projected/3641b82e-eaa3-43ff-b437-a986ca399896-kube-api-access-rfcqs\") pod \"3641b82e-eaa3-43ff-b437-a986ca399896\" (UID: \"3641b82e-eaa3-43ff-b437-a986ca399896\") " Nov 04 05:00:25.767207 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.767193 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3641b82e-eaa3-43ff-b437-a986ca399896-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3641b82e-eaa3-43ff-b437-a986ca399896-maas-api-service-ca\") pod \"3641b82e-eaa3-43ff-b437-a986ca399896\" (UID: \"3641b82e-eaa3-43ff-b437-a986ca399896\") " Nov 04 05:00:25.767588 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.767566 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3641b82e-eaa3-43ff-b437-a986ca399896-maas-api-service-ca" pod "3641b82e-eaa3-43ff-b437-a986ca399896" (UID: "3641b82e-eaa3-43ff-b437-a986ca399896"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:00:25.769335 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.769310 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3641b82e-eaa3-43ff-b437-a986ca399896-kube-api-access-rfcqs" pod "3641b82e-eaa3-43ff-b437-a986ca399896" (UID: "3641b82e-eaa3-43ff-b437-a986ca399896"). InnerVolumeSpecName "kube-api-access-rfcqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:00:25.868658 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.868620 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfcqs\" (UniqueName: \"kubernetes.io/projected/3641b82e-eaa3-43ff-b437-a986ca399896-kube-api-access-rfcqs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:00:25.868658 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.868649 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3641b82e-eaa3-43ff-b437-a986ca399896-maas-api-service-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:00:25.902830 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.902803 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" Nov 04 05:00:25.969547 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.969516 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11c22530-78b8-4805-a614-5ccdc96abd22-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11c22530-78b8-4805-a614-5ccdc96abd22-maas-api-service-ca\") pod \"11c22530-78b8-4805-a614-5ccdc96abd22\" (UID: \"11c22530-78b8-4805-a614-5ccdc96abd22\") " Nov 04 05:00:25.969705 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.969600 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11c22530-78b8-4805-a614-5ccdc96abd22-kube-api-access-ck4dh\" (UniqueName: \"kubernetes.io/projected/11c22530-78b8-4805-a614-5ccdc96abd22-kube-api-access-ck4dh\") pod \"11c22530-78b8-4805-a614-5ccdc96abd22\" (UID: \"11c22530-78b8-4805-a614-5ccdc96abd22\") " Nov 04 05:00:25.969940 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.969911 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c22530-78b8-4805-a614-5ccdc96abd22-maas-api-service-ca" pod "11c22530-78b8-4805-a614-5ccdc96abd22" (UID: "11c22530-78b8-4805-a614-5ccdc96abd22"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:00:25.970142 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.970121 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11c22530-78b8-4805-a614-5ccdc96abd22-maas-api-service-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:00:25.971878 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:25.971850 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11c22530-78b8-4805-a614-5ccdc96abd22-kube-api-access-ck4dh" pod "11c22530-78b8-4805-a614-5ccdc96abd22" (UID: "11c22530-78b8-4805-a614-5ccdc96abd22"). InnerVolumeSpecName "kube-api-access-ck4dh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:00:26.071314 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:26.071283 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck4dh\" (UniqueName: \"kubernetes.io/projected/11c22530-78b8-4805-a614-5ccdc96abd22-kube-api-access-ck4dh\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:00:26.526993 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:26.526914 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" Nov 04 05:00:26.526993 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:26.526949 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c" event={"ID":"11c22530-78b8-4805-a614-5ccdc96abd22","Type":"ContainerDied","Data":"04f35583d0e80c3de7de9d6afbfce0568784deb934b05dffc2b16e0e24d4332b"} Nov 04 05:00:26.527219 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:26.527037 4955 scope.go:122] "RemoveContainer" containerID="0b0d6d4328ea690a4f15edfde4fa25607c019cd8b5fd3c102a1bf6d87f01e211" Nov 04 05:00:26.528490 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:26.528465 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" event={"ID":"3641b82e-eaa3-43ff-b437-a986ca399896","Type":"ContainerDied","Data":"683ca8d29db2419b0d2757829b3bbe90d62bd6409f5801f94b2e672ca71635d2"} Nov 04 05:00:26.528588 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:26.528521 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl" Nov 04 05:00:26.537283 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:26.537252 4955 scope.go:122] "RemoveContainer" containerID="821b279258acb5ed0063b3eed6ef468ddfd36a688244663f058c43ee30cc6b2a" Nov 04 05:00:26.648487 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:26.648465 4955 scope.go:122] "RemoveContainer" containerID="ed70fc3af41cc6c5b64976c1dafa0e671a4092207288c50bfa6c411987e97314" Nov 04 05:00:26.679326 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:26.679301 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c"] Nov 04 05:00:26.725286 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:26.725244 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-19bf5b-29896140-s8g4c"] Nov 04 05:00:26.788294 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:26.788222 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl"] Nov 04 05:00:26.792756 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:26.792736 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896140-5p9vl"] Nov 04 05:00:27.538539 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:27.538513 4955 generic.go:356] "Generic (PLEG): container finished" podID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" containerID="5d8bcdc9c402747816c27f81a74f04cb927987d32da2fab5fd574f5a35ca2493" exitCode=60 Nov 04 05:00:27.538669 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:27.538557 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" event={"ID":"4dd423c9-5ce5-4f6e-a687-864d213ce51a","Type":"ContainerDied","Data":"5d8bcdc9c402747816c27f81a74f04cb927987d32da2fab5fd574f5a35ca2493"} Nov 04 05:00:27.538669 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:27.538602 4955 scope.go:122] "RemoveContainer" containerID="ed70fc3af41cc6c5b64976c1dafa0e671a4092207288c50bfa6c411987e97314" Nov 04 05:00:27.538942 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:27.538921 4955 scope.go:122] "RemoveContainer" containerID="5d8bcdc9c402747816c27f81a74f04cb927987d32da2fab5fd574f5a35ca2493" Nov 04 05:00:27.539203 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:27.539183 4955 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6_odh-ai-gateway-infra(4dd423c9-5ce5-4f6e-a687-864d213ce51a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" Nov 04 05:00:27.657017 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:27.656984 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" path="/var/lib/kubelet/pods/11c22530-78b8-4805-a614-5ccdc96abd22/volumes" Nov 04 05:00:27.657477 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:27.657458 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" path="/var/lib/kubelet/pods/3641b82e-eaa3-43ff-b437-a986ca399896/volumes" Nov 04 05:00:27.657872 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:27.657855 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" path="/var/lib/kubelet/pods/7ffe4759-69b1-43ff-b1f7-bc6a3068749f/volumes" Nov 04 05:00:28.193062 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:28.193007 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:00:28.658073 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:28.658046 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6"] Nov 04 05:00:28.810529 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:28.810502 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" Nov 04 05:00:28.899782 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:28.899758 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4dd423c9-5ce5-4f6e-a687-864d213ce51a-kube-api-access-2prt7\" (UniqueName: \"kubernetes.io/projected/4dd423c9-5ce5-4f6e-a687-864d213ce51a-kube-api-access-2prt7\") pod \"4dd423c9-5ce5-4f6e-a687-864d213ce51a\" (UID: \"4dd423c9-5ce5-4f6e-a687-864d213ce51a\") " Nov 04 05:00:28.899968 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:28.899795 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4dd423c9-5ce5-4f6e-a687-864d213ce51a-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd423c9-5ce5-4f6e-a687-864d213ce51a-maas-api-service-ca\") pod \"4dd423c9-5ce5-4f6e-a687-864d213ce51a\" (UID: \"4dd423c9-5ce5-4f6e-a687-864d213ce51a\") " Nov 04 05:00:28.900187 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:28.900164 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd423c9-5ce5-4f6e-a687-864d213ce51a-maas-api-service-ca" pod "4dd423c9-5ce5-4f6e-a687-864d213ce51a" (UID: "4dd423c9-5ce5-4f6e-a687-864d213ce51a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:00:28.901841 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:28.901820 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd423c9-5ce5-4f6e-a687-864d213ce51a-kube-api-access-2prt7" pod "4dd423c9-5ce5-4f6e-a687-864d213ce51a" (UID: "4dd423c9-5ce5-4f6e-a687-864d213ce51a"). InnerVolumeSpecName "kube-api-access-2prt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:00:29.000815 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:29.000768 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2prt7\" (UniqueName: \"kubernetes.io/projected/4dd423c9-5ce5-4f6e-a687-864d213ce51a-kube-api-access-2prt7\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:00:29.000815 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:29.000799 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd423c9-5ce5-4f6e-a687-864d213ce51a-maas-api-service-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:00:29.553080 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:29.553052 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" Nov 04 05:00:29.553550 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:29.553080 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6" event={"ID":"4dd423c9-5ce5-4f6e-a687-864d213ce51a","Type":"ContainerDied","Data":"01ebbc81d477d3f463ddef3effe4ad384b63fb9f0fa48725576829808d8adb9d"} Nov 04 05:00:29.553550 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:29.553158 4955 scope.go:122] "RemoveContainer" containerID="5d8bcdc9c402747816c27f81a74f04cb927987d32da2fab5fd574f5a35ca2493" Nov 04 05:00:29.705575 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:29.705553 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6"] Nov 04 05:00:29.751369 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:29.751346 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-e62689-29896140-tt5s6"] Nov 04 05:00:30.217564 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:30.217534 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:30.229844 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:30.229821 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:30.571488 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:30.571461 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:00:31.657686 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:31.657648 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" path="/var/lib/kubelet/pods/4dd423c9-5ce5-4f6e-a687-864d213ce51a/volumes" Nov 04 05:00:49.752850 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:49.752824 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/2.log" Nov 04 05:00:49.756369 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:00:49.756346 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/2.log" Nov 04 05:00:58.190055 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:00:58.190015 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:01:01.461615 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.461577 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz"] Nov 04 05:01:01.462334 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462313 4955 cpu_manager.go:414] "containerMap: removing container" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" containerName="cleanup" Nov 04 05:01:01.462437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462334 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" containerName="cleanup" Nov 04 05:01:01.462437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462346 4955 cpu_manager.go:414] "containerMap: removing container" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" containerName="cleanup" Nov 04 05:01:01.462437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462353 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" containerName="cleanup" Nov 04 05:01:01.462437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462365 4955 cpu_manager.go:414] "containerMap: removing container" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" containerName="cleanup" Nov 04 05:01:01.462437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462372 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" containerName="cleanup" Nov 04 05:01:01.462437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462382 4955 cpu_manager.go:414] "containerMap: removing container" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" containerName="cleanup" Nov 04 05:01:01.462437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462388 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" containerName="cleanup" Nov 04 05:01:01.462437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462401 4955 cpu_manager.go:414] "containerMap: removing container" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" containerName="cleanup" Nov 04 05:01:01.462437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462407 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" containerName="cleanup" Nov 04 05:01:01.462437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462419 4955 cpu_manager.go:414] "containerMap: removing container" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" containerName="cleanup" Nov 04 05:01:01.462437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462425 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462444 4955 cpu_manager.go:414] "containerMap: removing container" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462451 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462477 4955 cpu_manager.go:414] "containerMap: removing container" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462485 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462502 4955 cpu_manager.go:414] "containerMap: removing container" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462509 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462534 4955 cpu_manager.go:414] "containerMap: removing container" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462540 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462554 4955 cpu_manager.go:414] "containerMap: removing container" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462562 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462709 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462720 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462729 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462738 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462748 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462759 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462767 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462774 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="4dd423c9-5ce5-4f6e-a687-864d213ce51a" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462783 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462792 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" containerName="cleanup" Nov 04 05:01:01.462957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.462802 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="3641b82e-eaa3-43ff-b437-a986ca399896" containerName="cleanup" Nov 04 05:01:01.470085 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.470063 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:01.519998 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.519967 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz"] Nov 04 05:01:01.536922 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.536895 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c15a6fe1-5xhcz\" (UID: \"e65020ec-12d9-4bd4-8966-a8142208be4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:01.537068 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.537026 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c15a6fe1-5xhcz\" (UID: \"e65020ec-12d9-4bd4-8966-a8142208be4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:01.537135 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.537074 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxftj\" (UniqueName: \"kubernetes.io/projected/e65020ec-12d9-4bd4-8966-a8142208be4d-kube-api-access-fxftj\") pod \"maas-api-revoke-sub-c15a6fe1-5xhcz\" (UID: \"e65020ec-12d9-4bd4-8966-a8142208be4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:01.562573 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.562548 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nz4vh\"" Nov 04 05:01:01.562704 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.562587 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 05:01:01.638192 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.638147 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c15a6fe1-5xhcz\" (UID: \"e65020ec-12d9-4bd4-8966-a8142208be4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:01.638403 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.638300 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c15a6fe1-5xhcz\" (UID: \"e65020ec-12d9-4bd4-8966-a8142208be4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:01.638403 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.638363 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxftj\" (UniqueName: \"kubernetes.io/projected/e65020ec-12d9-4bd4-8966-a8142208be4d-kube-api-access-fxftj\") pod \"maas-api-revoke-sub-c15a6fe1-5xhcz\" (UID: \"e65020ec-12d9-4bd4-8966-a8142208be4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:01.638981 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.638958 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c15a6fe1-5xhcz\" (UID: \"e65020ec-12d9-4bd4-8966-a8142208be4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:01.640523 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.640493 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c15a6fe1-5xhcz\" (UID: \"e65020ec-12d9-4bd4-8966-a8142208be4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:01.695452 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.695415 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxftj\" (UniqueName: \"kubernetes.io/projected/e65020ec-12d9-4bd4-8966-a8142208be4d-kube-api-access-fxftj\") pod \"maas-api-revoke-sub-c15a6fe1-5xhcz\" (UID: \"e65020ec-12d9-4bd4-8966-a8142208be4d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:01.783603 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:01.783512 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:02.169348 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:02.169318 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz"] Nov 04 05:01:02.175926 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:01:02.175893 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65020ec_12d9_4bd4_8966_a8142208be4d.slice/crio-186d17da61f03cf53a24c87c14a461bf4806da97d59809ad1e623b6624d4be1c WatchSource:0}: Error finding container 186d17da61f03cf53a24c87c14a461bf4806da97d59809ad1e623b6624d4be1c: Status 404 returned error can't find the container with id 186d17da61f03cf53a24c87c14a461bf4806da97d59809ad1e623b6624d4be1c Nov 04 05:01:02.756278 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:02.756162 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" event={"ID":"e65020ec-12d9-4bd4-8966-a8142208be4d","Type":"ContainerStarted","Data":"0f32c7c83dfb05baeaefeac274a16da15968966d1d2b3b3584e52f68219d6568"} Nov 04 05:01:02.756278 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:02.756220 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" event={"ID":"e65020ec-12d9-4bd4-8966-a8142208be4d","Type":"ContainerStarted","Data":"186d17da61f03cf53a24c87c14a461bf4806da97d59809ad1e623b6624d4be1c"} Nov 04 05:01:02.863793 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:02.863749 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" podStartSLOduration=1.863735917 podStartE2EDuration="1.863735917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:01:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:01:02.862991217 +0000 UTC m=+913.332817355" watchObservedRunningTime="2026-11-04 05:01:02.863735917 +0000 UTC m=+913.333562083" Nov 04 05:01:03.763137 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:03.763096 4955 generic.go:356] "Generic (PLEG): container finished" podID="e65020ec-12d9-4bd4-8966-a8142208be4d" containerID="0f32c7c83dfb05baeaefeac274a16da15968966d1d2b3b3584e52f68219d6568" exitCode=0 Nov 04 05:01:03.763556 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:03.763138 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" event={"ID":"e65020ec-12d9-4bd4-8966-a8142208be4d","Type":"ContainerDied","Data":"0f32c7c83dfb05baeaefeac274a16da15968966d1d2b3b3584e52f68219d6568"} Nov 04 05:01:04.910613 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:04.910591 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:04.973720 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:04.973695 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-openshift-ca\") pod \"e65020ec-12d9-4bd4-8966-a8142208be4d\" (UID: \"e65020ec-12d9-4bd4-8966-a8142208be4d\") " Nov 04 05:01:04.973845 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:04.973817 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e65020ec-12d9-4bd4-8966-a8142208be4d-kube-api-access-fxftj\" (UniqueName: \"kubernetes.io/projected/e65020ec-12d9-4bd4-8966-a8142208be4d-kube-api-access-fxftj\") pod \"e65020ec-12d9-4bd4-8966-a8142208be4d\" (UID: \"e65020ec-12d9-4bd4-8966-a8142208be4d\") " Nov 04 05:01:04.973887 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:04.973845 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-xks-ca\") pod \"e65020ec-12d9-4bd4-8966-a8142208be4d\" (UID: \"e65020ec-12d9-4bd4-8966-a8142208be4d\") " Nov 04 05:01:04.974026 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:04.974005 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-openshift-ca" pod "e65020ec-12d9-4bd4-8966-a8142208be4d" (UID: "e65020ec-12d9-4bd4-8966-a8142208be4d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:01:04.974186 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:04.974164 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-openshift-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:04.975812 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:04.975790 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e65020ec-12d9-4bd4-8966-a8142208be4d-kube-api-access-fxftj" pod "e65020ec-12d9-4bd4-8966-a8142208be4d" (UID: "e65020ec-12d9-4bd4-8966-a8142208be4d"). InnerVolumeSpecName "kube-api-access-fxftj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:01:04.975902 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:04.975862 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-xks-ca" pod "e65020ec-12d9-4bd4-8966-a8142208be4d" (UID: "e65020ec-12d9-4bd4-8966-a8142208be4d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:01:05.075470 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.075437 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxftj\" (UniqueName: \"kubernetes.io/projected/e65020ec-12d9-4bd4-8966-a8142208be4d-kube-api-access-fxftj\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:05.075470 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.075467 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e65020ec-12d9-4bd4-8966-a8142208be4d-maas-api-xks-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:05.776079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.776051 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" Nov 04 05:01:05.776233 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.776081 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz" event={"ID":"e65020ec-12d9-4bd4-8966-a8142208be4d","Type":"ContainerDied","Data":"186d17da61f03cf53a24c87c14a461bf4806da97d59809ad1e623b6624d4be1c"} Nov 04 05:01:05.776233 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.776126 4955 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="186d17da61f03cf53a24c87c14a461bf4806da97d59809ad1e623b6624d4be1c" Nov 04 05:01:05.965298 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.965210 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8"] Nov 04 05:01:05.965751 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.965737 4955 cpu_manager.go:414] "containerMap: removing container" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" containerName="cleanup" Nov 04 05:01:05.965796 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.965752 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7ffe4759-69b1-43ff-b1f7-bc6a3068749f" containerName="cleanup" Nov 04 05:01:05.965796 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.965784 4955 cpu_manager.go:414] "containerMap: removing container" podUID="e65020ec-12d9-4bd4-8966-a8142208be4d" containerName="revoke-keys" Nov 04 05:01:05.965796 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.965789 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e65020ec-12d9-4bd4-8966-a8142208be4d" containerName="revoke-keys" Nov 04 05:01:05.965897 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.965878 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="11c22530-78b8-4805-a614-5ccdc96abd22" containerName="cleanup" Nov 04 05:01:05.965897 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.965892 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="e65020ec-12d9-4bd4-8966-a8142208be4d" containerName="revoke-keys" Nov 04 05:01:05.969512 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:05.969490 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:06.019277 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.019237 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 05:01:06.019420 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.019283 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nz4vh\"" Nov 04 05:01:06.022925 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.022901 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8"] Nov 04 05:01:06.084688 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.084658 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-24f46344-qswd8\" (UID: \"674f0068-5f4c-4635-b332-07c9f352f59d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:06.084825 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.084718 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-24f46344-qswd8\" (UID: \"674f0068-5f4c-4635-b332-07c9f352f59d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:06.084825 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.084795 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lptq\" (UniqueName: \"kubernetes.io/projected/674f0068-5f4c-4635-b332-07c9f352f59d-kube-api-access-7lptq\") pod \"maas-api-revoke-sub-24f46344-qswd8\" (UID: \"674f0068-5f4c-4635-b332-07c9f352f59d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:06.185642 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.185615 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-24f46344-qswd8\" (UID: \"674f0068-5f4c-4635-b332-07c9f352f59d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:06.185784 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.185661 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-24f46344-qswd8\" (UID: \"674f0068-5f4c-4635-b332-07c9f352f59d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:06.185784 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.185696 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lptq\" (UniqueName: \"kubernetes.io/projected/674f0068-5f4c-4635-b332-07c9f352f59d-kube-api-access-7lptq\") pod \"maas-api-revoke-sub-24f46344-qswd8\" (UID: \"674f0068-5f4c-4635-b332-07c9f352f59d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:06.186421 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.186392 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-24f46344-qswd8\" (UID: \"674f0068-5f4c-4635-b332-07c9f352f59d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:06.187957 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.187932 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-24f46344-qswd8\" (UID: \"674f0068-5f4c-4635-b332-07c9f352f59d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:06.242669 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.242617 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lptq\" (UniqueName: \"kubernetes.io/projected/674f0068-5f4c-4635-b332-07c9f352f59d-kube-api-access-7lptq\") pod \"maas-api-revoke-sub-24f46344-qswd8\" (UID: \"674f0068-5f4c-4635-b332-07c9f352f59d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:06.283741 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.283715 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:06.658907 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.658880 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8"] Nov 04 05:01:06.664792 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:01:06.664765 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674f0068_5f4c_4635_b332_07c9f352f59d.slice/crio-7bbd1916fdc93ad400fb32c8491a0b6e170ffb5068f810f89879b80e0ac94e7d WatchSource:0}: Error finding container 7bbd1916fdc93ad400fb32c8491a0b6e170ffb5068f810f89879b80e0ac94e7d: Status 404 returned error can't find the container with id 7bbd1916fdc93ad400fb32c8491a0b6e170ffb5068f810f89879b80e0ac94e7d Nov 04 05:01:06.782840 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:06.782803 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" event={"ID":"674f0068-5f4c-4635-b332-07c9f352f59d","Type":"ContainerStarted","Data":"7bbd1916fdc93ad400fb32c8491a0b6e170ffb5068f810f89879b80e0ac94e7d"} Nov 04 05:01:07.794108 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:07.794028 4955 generic.go:356] "Generic (PLEG): container finished" podID="674f0068-5f4c-4635-b332-07c9f352f59d" containerID="bffff04286d84a1b1cc3ff2ea0aa177b845345bfb46bac6fd65086694faa8552" exitCode=0 Nov 04 05:01:07.794515 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:07.794117 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" event={"ID":"674f0068-5f4c-4635-b332-07c9f352f59d","Type":"ContainerDied","Data":"bffff04286d84a1b1cc3ff2ea0aa177b845345bfb46bac6fd65086694faa8552"} Nov 04 05:01:08.946749 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:08.946726 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:09.015549 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.015520 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-xks-ca\") pod \"674f0068-5f4c-4635-b332-07c9f352f59d\" (UID: \"674f0068-5f4c-4635-b332-07c9f352f59d\") " Nov 04 05:01:09.015712 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.015563 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/674f0068-5f4c-4635-b332-07c9f352f59d-kube-api-access-7lptq\" (UniqueName: \"kubernetes.io/projected/674f0068-5f4c-4635-b332-07c9f352f59d-kube-api-access-7lptq\") pod \"674f0068-5f4c-4635-b332-07c9f352f59d\" (UID: \"674f0068-5f4c-4635-b332-07c9f352f59d\") " Nov 04 05:01:09.015712 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.015616 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-openshift-ca\") pod \"674f0068-5f4c-4635-b332-07c9f352f59d\" (UID: \"674f0068-5f4c-4635-b332-07c9f352f59d\") " Nov 04 05:01:09.016008 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.015983 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-openshift-ca" pod "674f0068-5f4c-4635-b332-07c9f352f59d" (UID: "674f0068-5f4c-4635-b332-07c9f352f59d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:01:09.017593 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.017571 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-xks-ca" pod "674f0068-5f4c-4635-b332-07c9f352f59d" (UID: "674f0068-5f4c-4635-b332-07c9f352f59d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:01:09.017655 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.017620 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674f0068-5f4c-4635-b332-07c9f352f59d-kube-api-access-7lptq" pod "674f0068-5f4c-4635-b332-07c9f352f59d" (UID: "674f0068-5f4c-4635-b332-07c9f352f59d"). InnerVolumeSpecName "kube-api-access-7lptq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:01:09.116926 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.116846 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-xks-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:09.116926 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.116876 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lptq\" (UniqueName: \"kubernetes.io/projected/674f0068-5f4c-4635-b332-07c9f352f59d-kube-api-access-7lptq\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:09.116926 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.116891 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/674f0068-5f4c-4635-b332-07c9f352f59d-maas-api-openshift-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:09.676635 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.676609 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d"] Nov 04 05:01:09.677138 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.677123 4955 cpu_manager.go:414] "containerMap: removing container" podUID="674f0068-5f4c-4635-b332-07c9f352f59d" containerName="revoke-keys" Nov 04 05:01:09.677187 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.677139 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="674f0068-5f4c-4635-b332-07c9f352f59d" containerName="revoke-keys" Nov 04 05:01:09.677231 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.677225 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="674f0068-5f4c-4635-b332-07c9f352f59d" containerName="revoke-keys" Nov 04 05:01:09.680533 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.680511 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:09.723511 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.723484 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-xks-ca\") pod \"maas-api-revoke-sub-46105daa-7vh9d\" (UID: \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:09.723641 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.723607 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4qcf\" (UniqueName: \"kubernetes.io/projected/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-kube-api-access-f4qcf\") pod \"maas-api-revoke-sub-46105daa-7vh9d\" (UID: \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:09.723708 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.723692 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-46105daa-7vh9d\" (UID: \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:09.735674 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.735651 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d"] Nov 04 05:01:09.806791 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.806767 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" Nov 04 05:01:09.806916 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.806766 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-24f46344-qswd8" event={"ID":"674f0068-5f4c-4635-b332-07c9f352f59d","Type":"ContainerDied","Data":"7bbd1916fdc93ad400fb32c8491a0b6e170ffb5068f810f89879b80e0ac94e7d"} Nov 04 05:01:09.806916 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.806887 4955 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bbd1916fdc93ad400fb32c8491a0b6e170ffb5068f810f89879b80e0ac94e7d" Nov 04 05:01:09.824646 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.824618 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-xks-ca\") pod \"maas-api-revoke-sub-46105daa-7vh9d\" (UID: \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:09.824784 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.824700 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4qcf\" (UniqueName: \"kubernetes.io/projected/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-kube-api-access-f4qcf\") pod \"maas-api-revoke-sub-46105daa-7vh9d\" (UID: \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:09.824784 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.824728 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-46105daa-7vh9d\" (UID: \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:09.825474 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.825453 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-46105daa-7vh9d\" (UID: \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:09.826963 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.826940 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-xks-ca\") pod \"maas-api-revoke-sub-46105daa-7vh9d\" (UID: \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:09.881933 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.881912 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4qcf\" (UniqueName: \"kubernetes.io/projected/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-kube-api-access-f4qcf\") pod \"maas-api-revoke-sub-46105daa-7vh9d\" (UID: \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:09.993349 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:09.993294 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:10.367743 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:10.367713 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d"] Nov 04 05:01:10.373708 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:01:10.373682 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5e91cf_e239_4fa4_9bb1_34c9b6d58fee.slice/crio-98ffe786ada33ab3514527981216be610bf3bdd3bd004506f7251a66a97f0091 WatchSource:0}: Error finding container 98ffe786ada33ab3514527981216be610bf3bdd3bd004506f7251a66a97f0091: Status 404 returned error can't find the container with id 98ffe786ada33ab3514527981216be610bf3bdd3bd004506f7251a66a97f0091 Nov 04 05:01:10.813773 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:10.813739 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" event={"ID":"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee","Type":"ContainerStarted","Data":"f33982dbc3317866535dd9a1e4ab9e6784d34936eb490a05f0c25b7ccbaa98b1"} Nov 04 05:01:10.813913 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:10.813795 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" event={"ID":"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee","Type":"ContainerStarted","Data":"98ffe786ada33ab3514527981216be610bf3bdd3bd004506f7251a66a97f0091"} Nov 04 05:01:10.921902 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:10.921790 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" podStartSLOduration=1.921776586 podStartE2EDuration="1.921776586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:01:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:01:10.920304867 +0000 UTC m=+921.390131007" watchObservedRunningTime="2026-11-04 05:01:10.921776586 +0000 UTC m=+921.391602724" Nov 04 05:01:11.821142 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:11.821112 4955 generic.go:356] "Generic (PLEG): container finished" podID="2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee" containerID="f33982dbc3317866535dd9a1e4ab9e6784d34936eb490a05f0c25b7ccbaa98b1" exitCode=0 Nov 04 05:01:11.821569 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:11.821197 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" event={"ID":"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee","Type":"ContainerDied","Data":"f33982dbc3317866535dd9a1e4ab9e6784d34936eb490a05f0c25b7ccbaa98b1"} Nov 04 05:01:12.981397 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:12.981372 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:13.056548 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:13.056521 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-xks-ca\") pod \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\" (UID: \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\") " Nov 04 05:01:13.056673 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:13.056660 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-openshift-ca\") pod \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\" (UID: \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\") " Nov 04 05:01:13.056726 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:13.056696 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-kube-api-access-f4qcf\" (UniqueName: \"kubernetes.io/projected/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-kube-api-access-f4qcf\") pod \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\" (UID: \"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee\") " Nov 04 05:01:13.057022 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:13.056994 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-openshift-ca" pod "2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee" (UID: "2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:01:13.058670 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:13.058641 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-xks-ca" pod "2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee" (UID: "2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:01:13.058750 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:13.058705 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-kube-api-access-f4qcf" pod "2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee" (UID: "2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee"). InnerVolumeSpecName "kube-api-access-f4qcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:01:13.158008 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:13.157938 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4qcf\" (UniqueName: \"kubernetes.io/projected/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-kube-api-access-f4qcf\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:13.158008 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:13.157966 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-xks-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:13.158008 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:13.157977 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee-maas-api-openshift-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:13.834697 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:13.834665 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" Nov 04 05:01:13.834838 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:13.834718 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-46105daa-7vh9d" event={"ID":"2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee","Type":"ContainerDied","Data":"98ffe786ada33ab3514527981216be610bf3bdd3bd004506f7251a66a97f0091"} Nov 04 05:01:13.834838 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:13.834759 4955 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98ffe786ada33ab3514527981216be610bf3bdd3bd004506f7251a66a97f0091" Nov 04 05:01:14.040559 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:14.040485 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p"] Nov 04 05:01:18.588767 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.588737 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26"] Nov 04 05:01:18.589251 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.589238 4955 cpu_manager.go:414] "containerMap: removing container" podUID="2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee" containerName="revoke-keys" Nov 04 05:01:18.589323 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.589252 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee" containerName="revoke-keys" Nov 04 05:01:18.589392 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.589383 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee" containerName="revoke-keys" Nov 04 05:01:18.592770 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.592752 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:18.643150 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.643127 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 05:01:18.646684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.646652 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26"] Nov 04 05:01:18.689296 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.689258 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nz4vh\"" Nov 04 05:01:18.715054 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.715027 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8ab5c526-hhx26\" (UID: \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:18.715180 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.715062 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8ab5c526-hhx26\" (UID: \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:18.715257 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.715239 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fbcb\" (UniqueName: \"kubernetes.io/projected/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-kube-api-access-2fbcb\") pod \"maas-api-revoke-sub-8ab5c526-hhx26\" (UID: \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:18.816586 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.816559 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8ab5c526-hhx26\" (UID: \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:18.816698 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.816599 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8ab5c526-hhx26\" (UID: \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:18.816772 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.816757 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fbcb\" (UniqueName: \"kubernetes.io/projected/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-kube-api-access-2fbcb\") pod \"maas-api-revoke-sub-8ab5c526-hhx26\" (UID: \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:18.817240 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.817220 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8ab5c526-hhx26\" (UID: \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:18.818986 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.818966 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8ab5c526-hhx26\" (UID: \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:18.874124 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.874068 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fbcb\" (UniqueName: \"kubernetes.io/projected/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-kube-api-access-2fbcb\") pod \"maas-api-revoke-sub-8ab5c526-hhx26\" (UID: \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:18.905387 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:18.905363 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:19.279661 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:19.279584 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26"] Nov 04 05:01:19.287121 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:01:19.287087 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1653d8_a6dd_4505_8fcf_b2948d3a79be.slice/crio-f8de4ad3d6f721325f97defaeb2a810185e06e34f47b498af3122b773a990acf WatchSource:0}: Error finding container f8de4ad3d6f721325f97defaeb2a810185e06e34f47b498af3122b773a990acf: Status 404 returned error can't find the container with id f8de4ad3d6f721325f97defaeb2a810185e06e34f47b498af3122b773a990acf Nov 04 05:01:19.870598 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:19.870517 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" event={"ID":"2d1653d8-a6dd-4505-8fcf-b2948d3a79be","Type":"ContainerStarted","Data":"4a256820c38f7a77437e21d2b047cca007c52a5144eaac3c6ecfc54a868b6413"} Nov 04 05:01:19.870598 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:19.870573 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" event={"ID":"2d1653d8-a6dd-4505-8fcf-b2948d3a79be","Type":"ContainerStarted","Data":"f8de4ad3d6f721325f97defaeb2a810185e06e34f47b498af3122b773a990acf"} Nov 04 05:01:19.978022 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:19.977974 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" podStartSLOduration=1.977959528 podStartE2EDuration="1.977959528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:01:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:01:19.977620763 +0000 UTC m=+930.447446901" watchObservedRunningTime="2026-11-04 05:01:19.977959528 +0000 UTC m=+930.447785667" Nov 04 05:01:20.877422 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:20.877390 4955 generic.go:356] "Generic (PLEG): container finished" podID="2d1653d8-a6dd-4505-8fcf-b2948d3a79be" containerID="4a256820c38f7a77437e21d2b047cca007c52a5144eaac3c6ecfc54a868b6413" exitCode=0 Nov 04 05:01:20.877899 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:20.877479 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" event={"ID":"2d1653d8-a6dd-4505-8fcf-b2948d3a79be","Type":"ContainerDied","Data":"4a256820c38f7a77437e21d2b047cca007c52a5144eaac3c6ecfc54a868b6413"} Nov 04 05:01:22.031977 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.031947 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:22.149291 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.149201 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-xks-ca\") pod \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\" (UID: \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\") " Nov 04 05:01:22.149291 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.149275 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-openshift-ca\") pod \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\" (UID: \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\") " Nov 04 05:01:22.149475 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.149324 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-kube-api-access-2fbcb\" (UniqueName: \"kubernetes.io/projected/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-kube-api-access-2fbcb\") pod \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\" (UID: \"2d1653d8-a6dd-4505-8fcf-b2948d3a79be\") " Nov 04 05:01:22.149703 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.149680 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-openshift-ca" pod "2d1653d8-a6dd-4505-8fcf-b2948d3a79be" (UID: "2d1653d8-a6dd-4505-8fcf-b2948d3a79be"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:01:22.151478 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.151440 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-xks-ca" pod "2d1653d8-a6dd-4505-8fcf-b2948d3a79be" (UID: "2d1653d8-a6dd-4505-8fcf-b2948d3a79be"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:01:22.151478 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.151445 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-kube-api-access-2fbcb" pod "2d1653d8-a6dd-4505-8fcf-b2948d3a79be" (UID: "2d1653d8-a6dd-4505-8fcf-b2948d3a79be"). InnerVolumeSpecName "kube-api-access-2fbcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:01:22.251233 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.251204 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-xks-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:22.251233 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.251230 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-maas-api-openshift-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:22.251233 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.251239 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fbcb\" (UniqueName: \"kubernetes.io/projected/2d1653d8-a6dd-4505-8fcf-b2948d3a79be-kube-api-access-2fbcb\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:22.590122 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.590080 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2"] Nov 04 05:01:22.590636 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.590619 4955 cpu_manager.go:414] "containerMap: removing container" podUID="2d1653d8-a6dd-4505-8fcf-b2948d3a79be" containerName="revoke-keys" Nov 04 05:01:22.590636 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.590635 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d1653d8-a6dd-4505-8fcf-b2948d3a79be" containerName="revoke-keys" Nov 04 05:01:22.590803 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.590755 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d1653d8-a6dd-4505-8fcf-b2948d3a79be" containerName="revoke-keys" Nov 04 05:01:22.594203 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.594184 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:22.648433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.648404 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2"] Nov 04 05:01:22.756899 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.756859 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-xks-ca\") pod \"maas-api-revoke-sub-93d9d2ec-znrf2\" (UID: \"7c40c646-e87a-4c02-9bd4-36d28c0be184\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:22.757076 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.756923 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntd2v\" (UniqueName: \"kubernetes.io/projected/7c40c646-e87a-4c02-9bd4-36d28c0be184-kube-api-access-ntd2v\") pod \"maas-api-revoke-sub-93d9d2ec-znrf2\" (UID: \"7c40c646-e87a-4c02-9bd4-36d28c0be184\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:22.757181 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.757167 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-93d9d2ec-znrf2\" (UID: \"7c40c646-e87a-4c02-9bd4-36d28c0be184\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:22.858298 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.858211 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-xks-ca\") pod \"maas-api-revoke-sub-93d9d2ec-znrf2\" (UID: \"7c40c646-e87a-4c02-9bd4-36d28c0be184\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:22.858298 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.858254 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntd2v\" (UniqueName: \"kubernetes.io/projected/7c40c646-e87a-4c02-9bd4-36d28c0be184-kube-api-access-ntd2v\") pod \"maas-api-revoke-sub-93d9d2ec-znrf2\" (UID: \"7c40c646-e87a-4c02-9bd4-36d28c0be184\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:22.858477 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.858332 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-93d9d2ec-znrf2\" (UID: \"7c40c646-e87a-4c02-9bd4-36d28c0be184\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:22.858900 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.858875 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-93d9d2ec-znrf2\" (UID: \"7c40c646-e87a-4c02-9bd4-36d28c0be184\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:22.860494 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.860468 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-xks-ca\") pod \"maas-api-revoke-sub-93d9d2ec-znrf2\" (UID: \"7c40c646-e87a-4c02-9bd4-36d28c0be184\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:22.890085 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.890054 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" event={"ID":"2d1653d8-a6dd-4505-8fcf-b2948d3a79be","Type":"ContainerDied","Data":"f8de4ad3d6f721325f97defaeb2a810185e06e34f47b498af3122b773a990acf"} Nov 04 05:01:22.890203 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.890089 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8ab5c526-hhx26" Nov 04 05:01:22.890203 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.890111 4955 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8de4ad3d6f721325f97defaeb2a810185e06e34f47b498af3122b773a990acf" Nov 04 05:01:22.915705 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:22.915679 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntd2v\" (UniqueName: \"kubernetes.io/projected/7c40c646-e87a-4c02-9bd4-36d28c0be184-kube-api-access-ntd2v\") pod \"maas-api-revoke-sub-93d9d2ec-znrf2\" (UID: \"7c40c646-e87a-4c02-9bd4-36d28c0be184\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:23.210096 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:23.210026 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:23.581341 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:23.581310 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2"] Nov 04 05:01:23.587896 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:01:23.587868 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c40c646_e87a_4c02_9bd4_36d28c0be184.slice/crio-6f4cd1bbd92d7414d7d8d074b3cc16ab428c92fb6374a8ad28daab2fa7eaaa40 WatchSource:0}: Error finding container 6f4cd1bbd92d7414d7d8d074b3cc16ab428c92fb6374a8ad28daab2fa7eaaa40: Status 404 returned error can't find the container with id 6f4cd1bbd92d7414d7d8d074b3cc16ab428c92fb6374a8ad28daab2fa7eaaa40 Nov 04 05:01:23.896982 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:23.896954 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" event={"ID":"7c40c646-e87a-4c02-9bd4-36d28c0be184","Type":"ContainerStarted","Data":"c6d9defb30506ce7e3b6ce4fc9751b1e0f4c0bd4cf149dd697c0cff8844d77e5"} Nov 04 05:01:23.897095 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:23.897009 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" event={"ID":"7c40c646-e87a-4c02-9bd4-36d28c0be184","Type":"ContainerStarted","Data":"6f4cd1bbd92d7414d7d8d074b3cc16ab428c92fb6374a8ad28daab2fa7eaaa40"} Nov 04 05:01:24.006084 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:24.006037 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" podStartSLOduration=2.006024093 podStartE2EDuration="2.006024093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:01:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:01:24.004165668 +0000 UTC m=+934.473991805" watchObservedRunningTime="2026-11-04 05:01:24.006024093 +0000 UTC m=+934.475850231" Nov 04 05:01:24.127922 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:24.127853 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc"] Nov 04 05:01:24.904049 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:24.904007 4955 generic.go:356] "Generic (PLEG): container finished" podID="7c40c646-e87a-4c02-9bd4-36d28c0be184" containerID="c6d9defb30506ce7e3b6ce4fc9751b1e0f4c0bd4cf149dd697c0cff8844d77e5" exitCode=0 Nov 04 05:01:24.904487 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:24.904073 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" event={"ID":"7c40c646-e87a-4c02-9bd4-36d28c0be184","Type":"ContainerDied","Data":"c6d9defb30506ce7e3b6ce4fc9751b1e0f4c0bd4cf149dd697c0cff8844d77e5"} Nov 04 05:01:26.062104 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.062080 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:26.111813 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.111788 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-openshift-ca\") pod \"7c40c646-e87a-4c02-9bd4-36d28c0be184\" (UID: \"7c40c646-e87a-4c02-9bd4-36d28c0be184\") " Nov 04 05:01:26.111974 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.111957 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-xks-ca\") pod \"7c40c646-e87a-4c02-9bd4-36d28c0be184\" (UID: \"7c40c646-e87a-4c02-9bd4-36d28c0be184\") " Nov 04 05:01:26.112040 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.111991 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c40c646-e87a-4c02-9bd4-36d28c0be184-kube-api-access-ntd2v\" (UniqueName: \"kubernetes.io/projected/7c40c646-e87a-4c02-9bd4-36d28c0be184-kube-api-access-ntd2v\") pod \"7c40c646-e87a-4c02-9bd4-36d28c0be184\" (UID: \"7c40c646-e87a-4c02-9bd4-36d28c0be184\") " Nov 04 05:01:26.112203 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.112174 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-openshift-ca" pod "7c40c646-e87a-4c02-9bd4-36d28c0be184" (UID: "7c40c646-e87a-4c02-9bd4-36d28c0be184"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:01:26.112509 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.112489 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-openshift-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:26.114360 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.114338 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-xks-ca" pod "7c40c646-e87a-4c02-9bd4-36d28c0be184" (UID: "7c40c646-e87a-4c02-9bd4-36d28c0be184"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:01:26.114444 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.114387 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c40c646-e87a-4c02-9bd4-36d28c0be184-kube-api-access-ntd2v" pod "7c40c646-e87a-4c02-9bd4-36d28c0be184" (UID: "7c40c646-e87a-4c02-9bd4-36d28c0be184"). InnerVolumeSpecName "kube-api-access-ntd2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:01:26.213820 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.213756 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7c40c646-e87a-4c02-9bd4-36d28c0be184-maas-api-xks-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:26.213820 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.213780 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntd2v\" (UniqueName: \"kubernetes.io/projected/7c40c646-e87a-4c02-9bd4-36d28c0be184-kube-api-access-ntd2v\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:26.918759 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.918728 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" Nov 04 05:01:26.918939 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.918755 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-93d9d2ec-znrf2" event={"ID":"7c40c646-e87a-4c02-9bd4-36d28c0be184","Type":"ContainerDied","Data":"6f4cd1bbd92d7414d7d8d074b3cc16ab428c92fb6374a8ad28daab2fa7eaaa40"} Nov 04 05:01:26.918939 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:26.918808 4955 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f4cd1bbd92d7414d7d8d074b3cc16ab428c92fb6374a8ad28daab2fa7eaaa40" Nov 04 05:01:28.197522 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:01:28.197480 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:01:29.061180 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.061088 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" podUID="08dff920-431b-4fc1-bfb3-5f01a5a171fb" containerName="main" containerID="cri-o://fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308" gracePeriod=45 Nov 04 05:01:29.128620 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.128582 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" podUID="9e8d9137-183b-4fd3-a138-bc3e1be7f0a6" containerName="payload-pre-processing" containerID="cri-o://2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174" gracePeriod=25 Nov 04 05:01:29.323401 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.323340 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 05:01:29.348273 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.348231 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-home\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-home\") pod \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " Nov 04 05:01:29.348424 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.348316 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tmp-dir\") pod \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " Nov 04 05:01:29.348505 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.348465 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tls-certs\" (UniqueName: \"kubernetes.io/secret/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tls-certs\") pod \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " Nov 04 05:01:29.348505 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.348466 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-home" pod "08dff920-431b-4fc1-bfb3-5f01a5a171fb" (UID: "08dff920-431b-4fc1-bfb3-5f01a5a171fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:01:29.348614 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.348521 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/08dff920-431b-4fc1-bfb3-5f01a5a171fb-kube-api-access-84gk5\" (UniqueName: \"kubernetes.io/projected/08dff920-431b-4fc1-bfb3-5f01a5a171fb-kube-api-access-84gk5\") pod \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " Nov 04 05:01:29.348614 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.348557 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-dshm\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-dshm\") pod \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " Nov 04 05:01:29.348614 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.348559 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tmp-dir" pod "08dff920-431b-4fc1-bfb3-5f01a5a171fb" (UID: "08dff920-431b-4fc1-bfb3-5f01a5a171fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:01:29.348758 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.348635 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-model-cache\") pod \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\" (UID: \"08dff920-431b-4fc1-bfb3-5f01a5a171fb\") " Nov 04 05:01:29.348996 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.348970 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-model-cache" pod "08dff920-431b-4fc1-bfb3-5f01a5a171fb" (UID: "08dff920-431b-4fc1-bfb3-5f01a5a171fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:01:29.349134 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.349090 4955 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-model-cache\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:29.349134 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.349109 4955 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-home\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:29.349134 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.349123 4955 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tmp-dir\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:29.350666 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.350646 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-dshm" pod "08dff920-431b-4fc1-bfb3-5f01a5a171fb" (UID: "08dff920-431b-4fc1-bfb3-5f01a5a171fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:01:29.350884 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.350868 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tls-certs" pod "08dff920-431b-4fc1-bfb3-5f01a5a171fb" (UID: "08dff920-431b-4fc1-bfb3-5f01a5a171fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:01:29.350932 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.350892 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08dff920-431b-4fc1-bfb3-5f01a5a171fb-kube-api-access-84gk5" pod "08dff920-431b-4fc1-bfb3-5f01a5a171fb" (UID: "08dff920-431b-4fc1-bfb3-5f01a5a171fb"). InnerVolumeSpecName "kube-api-access-84gk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:01:29.357716 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.357698 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4"] Nov 04 05:01:29.450176 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.450153 4955 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08dff920-431b-4fc1-bfb3-5f01a5a171fb-tls-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:29.450176 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.450174 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84gk5\" (UniqueName: \"kubernetes.io/projected/08dff920-431b-4fc1-bfb3-5f01a5a171fb-kube-api-access-84gk5\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:29.450346 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.450183 4955 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08dff920-431b-4fc1-bfb3-5f01a5a171fb-dshm\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:29.482075 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.482022 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9"] Nov 04 05:01:29.939042 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.938967 4955 generic.go:356] "Generic (PLEG): container finished" podID="08dff920-431b-4fc1-bfb3-5f01a5a171fb" containerID="fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308" exitCode=0 Nov 04 05:01:29.939042 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.939011 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" Nov 04 05:01:29.939215 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.939045 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" event={"ID":"08dff920-431b-4fc1-bfb3-5f01a5a171fb","Type":"ContainerDied","Data":"fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308"} Nov 04 05:01:29.939215 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.939085 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p" event={"ID":"08dff920-431b-4fc1-bfb3-5f01a5a171fb","Type":"ContainerDied","Data":"43de5fd510306ce25eeb0eb28211558063f4a8fd176b0c3162a4dc4788892bd8"} Nov 04 05:01:29.939215 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.939104 4955 scope.go:122] "RemoveContainer" containerID="fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308" Nov 04 05:01:29.948520 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.948496 4955 scope.go:122] "RemoveContainer" containerID="fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308" Nov 04 05:01:29.948794 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:01:29.948774 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308\": container with ID starting with fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308 not found: ID does not exist" containerID="fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308" Nov 04 05:01:29.948920 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:29.948798 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308"} err="failed to get container status \"fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308\": rpc error: code = NotFound desc = could not find container \"fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308\": container with ID starting with fce39bae8c41f2b2f1c903406e25d9ee583c5b5b4ea3532b73481a79b1abc308 not found: ID does not exist" Nov 04 05:01:30.095209 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:30.095175 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p"] Nov 04 05:01:30.098123 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:30.098086 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-e62689/simulator-w1-e62689-kserve-78b7468864-8hh5p"] Nov 04 05:01:30.951022 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:30.950987 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" podUID="9e8d9137-183b-4fd3-a138-bc3e1be7f0a6" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:01:31.655986 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:31.655957 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="08dff920-431b-4fc1-bfb3-5f01a5a171fb" path="/var/lib/kubelet/pods/08dff920-431b-4fc1-bfb3-5f01a5a171fb/volumes" Nov 04 05:01:32.025831 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:32.025742 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm"] Nov 04 05:01:32.148877 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:32.148836 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w"] Nov 04 05:01:34.358571 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.358533 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" podUID="edcb05a0-70d6-4abe-b1c5-85bb3f871c5c" containerName="payload-processing" containerID="cri-o://e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1" gracePeriod=25 Nov 04 05:01:34.467551 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.467525 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc"] Nov 04 05:01:34.468041 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.468027 4955 cpu_manager.go:414] "containerMap: removing container" podUID="08dff920-431b-4fc1-bfb3-5f01a5a171fb" containerName="main" Nov 04 05:01:34.468099 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.468041 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08dff920-431b-4fc1-bfb3-5f01a5a171fb" containerName="main" Nov 04 05:01:34.468099 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.468061 4955 cpu_manager.go:414] "containerMap: removing container" podUID="7c40c646-e87a-4c02-9bd4-36d28c0be184" containerName="revoke-keys" Nov 04 05:01:34.468099 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.468066 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7c40c646-e87a-4c02-9bd4-36d28c0be184" containerName="revoke-keys" Nov 04 05:01:34.468243 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.468183 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="7c40c646-e87a-4c02-9bd4-36d28c0be184" containerName="revoke-keys" Nov 04 05:01:34.468243 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.468203 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="08dff920-431b-4fc1-bfb3-5f01a5a171fb" containerName="main" Nov 04 05:01:34.471078 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.471056 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:34.482939 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.482913 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" podUID="929914ca-f11b-48ad-9e00-0c33b3e649d1" containerName="payload-pre-processing" containerID="cri-o://40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6" gracePeriod=25 Nov 04 05:01:34.502133 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.502108 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f0b92fe9-th7zc\" (UID: \"3ad4b541-0175-42e9-a906-98db680a8920\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:34.502241 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.502143 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f0b92fe9-th7zc\" (UID: \"3ad4b541-0175-42e9-a906-98db680a8920\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:34.502241 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.502230 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ms5h\" (UniqueName: \"kubernetes.io/projected/3ad4b541-0175-42e9-a906-98db680a8920-kube-api-access-4ms5h\") pod \"maas-api-revoke-sub-f0b92fe9-th7zc\" (UID: \"3ad4b541-0175-42e9-a906-98db680a8920\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:34.524597 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.524569 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc"] Nov 04 05:01:34.567516 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.567322 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 05:01:34.567516 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.567485 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nz4vh\"" Nov 04 05:01:34.603820 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.603787 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f0b92fe9-th7zc\" (UID: \"3ad4b541-0175-42e9-a906-98db680a8920\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:34.603820 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.603823 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f0b92fe9-th7zc\" (UID: \"3ad4b541-0175-42e9-a906-98db680a8920\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:34.604061 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.603878 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ms5h\" (UniqueName: \"kubernetes.io/projected/3ad4b541-0175-42e9-a906-98db680a8920-kube-api-access-4ms5h\") pod \"maas-api-revoke-sub-f0b92fe9-th7zc\" (UID: \"3ad4b541-0175-42e9-a906-98db680a8920\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:34.604685 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.604655 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f0b92fe9-th7zc\" (UID: \"3ad4b541-0175-42e9-a906-98db680a8920\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:34.606225 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.606206 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f0b92fe9-th7zc\" (UID: \"3ad4b541-0175-42e9-a906-98db680a8920\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:34.635210 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.635183 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" Nov 04 05:01:34.660895 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.660862 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ms5h\" (UniqueName: \"kubernetes.io/projected/3ad4b541-0175-42e9-a906-98db680a8920-kube-api-access-4ms5h\") pod \"maas-api-revoke-sub-f0b92fe9-th7zc\" (UID: \"3ad4b541-0175-42e9-a906-98db680a8920\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:34.705088 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.705058 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-kube-api-access-jgsx4\" (UniqueName: \"kubernetes.io/projected/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-kube-api-access-jgsx4\") pod \"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c\" (UID: \"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c\") " Nov 04 05:01:34.705235 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.705205 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-plugins-config-volume\") pod \"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c\" (UID: \"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c\") " Nov 04 05:01:34.705569 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.705544 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-plugins-config-volume" pod "edcb05a0-70d6-4abe-b1c5-85bb3f871c5c" (UID: "edcb05a0-70d6-4abe-b1c5-85bb3f871c5c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:01:34.705868 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.705852 4955 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-plugins-config-volume\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:34.707421 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.707402 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-kube-api-access-jgsx4" pod "edcb05a0-70d6-4abe-b1c5-85bb3f871c5c" (UID: "edcb05a0-70d6-4abe-b1c5-85bb3f871c5c"). InnerVolumeSpecName "kube-api-access-jgsx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:01:34.784670 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.784644 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:34.807462 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.807437 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgsx4\" (UniqueName: \"kubernetes.io/projected/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c-kube-api-access-jgsx4\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:34.827082 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.827048 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk"] Nov 04 05:01:34.973840 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.973766 4955 generic.go:356] "Generic (PLEG): container finished" podID="edcb05a0-70d6-4abe-b1c5-85bb3f871c5c" containerID="e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1" exitCode=0 Nov 04 05:01:34.973840 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.973809 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" Nov 04 05:01:34.974026 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.973846 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" event={"ID":"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c","Type":"ContainerDied","Data":"e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1"} Nov 04 05:01:34.974026 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.973897 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4" event={"ID":"edcb05a0-70d6-4abe-b1c5-85bb3f871c5c","Type":"ContainerDied","Data":"0d1a72cedd8e4feedba9961425d96c08505926eb2be9e8c43755cb7050e7afe4"} Nov 04 05:01:34.974026 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.973910 4955 scope.go:122] "RemoveContainer" containerID="e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1" Nov 04 05:01:34.983770 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.983753 4955 scope.go:122] "RemoveContainer" containerID="e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1" Nov 04 05:01:34.984023 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:01:34.984006 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1\": container with ID starting with e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1 not found: ID does not exist" containerID="e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1" Nov 04 05:01:34.984056 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:34.984035 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1"} err="failed to get container status \"e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1\": rpc error: code = NotFound desc = could not find container \"e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1\": container with ID starting with e5892274c80f422b7f9264a1f51c227a4ab08af3c443de01073091e3e91cf4f1 not found: ID does not exist" Nov 04 05:01:35.127866 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:35.127839 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4"] Nov 04 05:01:35.131361 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:35.131336 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-204fa0-5d5c565b7b-wmcf4"] Nov 04 05:01:35.172723 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:35.172320 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc"] Nov 04 05:01:35.182560 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:01:35.181829 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad4b541_0175_42e9_a906_98db680a8920.slice/crio-042fe2185676ae141395d73afd7b01669666864b450caf5f1d4e9fd79141411b WatchSource:0}: Error finding container 042fe2185676ae141395d73afd7b01669666864b450caf5f1d4e9fd79141411b: Status 404 returned error can't find the container with id 042fe2185676ae141395d73afd7b01669666864b450caf5f1d4e9fd79141411b Nov 04 05:01:35.656776 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:35.656704 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="edcb05a0-70d6-4abe-b1c5-85bb3f871c5c" path="/var/lib/kubelet/pods/edcb05a0-70d6-4abe-b1c5-85bb3f871c5c/volumes" Nov 04 05:01:35.980229 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:35.980153 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" podUID="929914ca-f11b-48ad-9e00-0c33b3e649d1" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:01:35.983741 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:35.983712 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" event={"ID":"3ad4b541-0175-42e9-a906-98db680a8920","Type":"ContainerStarted","Data":"4217e57825755756c1178662354714a69bf8861c1340cc678cfcf03f0e542b5d"} Nov 04 05:01:35.983857 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:35.983762 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" event={"ID":"3ad4b541-0175-42e9-a906-98db680a8920","Type":"ContainerStarted","Data":"042fe2185676ae141395d73afd7b01669666864b450caf5f1d4e9fd79141411b"} Nov 04 05:01:36.091809 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:36.091763 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" podStartSLOduration=2.091750005 podStartE2EDuration="2.091750005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:01:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:01:36.091249998 +0000 UTC m=+946.561076136" watchObservedRunningTime="2026-11-04 05:01:36.091750005 +0000 UTC m=+946.561576142" Nov 04 05:01:36.991619 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:36.991581 4955 generic.go:356] "Generic (PLEG): container finished" podID="3ad4b541-0175-42e9-a906-98db680a8920" containerID="4217e57825755756c1178662354714a69bf8861c1340cc678cfcf03f0e542b5d" exitCode=0 Nov 04 05:01:36.991619 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:36.991622 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" event={"ID":"3ad4b541-0175-42e9-a906-98db680a8920","Type":"ContainerDied","Data":"4217e57825755756c1178662354714a69bf8861c1340cc678cfcf03f0e542b5d"} Nov 04 05:01:37.026862 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:37.026818 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" podUID="76df42a9-a151-4532-97aa-0a4c29314243" containerName="payload-processing" containerID="cri-o://5bbf38efd573790b453b5d18bed5e663f6abe7c2e7baa4242d20324c126662e0" gracePeriod=25 Nov 04 05:01:37.149768 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:37.149728 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" podUID="40ef3408-9353-4074-a199-3e996a324d6e" containerName="payload-pre-processing" containerID="cri-o://6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145" gracePeriod=25 Nov 04 05:01:37.933853 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:37.933820 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" podUID="40ef3408-9353-4074-a199-3e996a324d6e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:01:37.934044 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:37.933855 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" podUID="76df42a9-a151-4532-97aa-0a4c29314243" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:01:38.161746 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:38.161708 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:38.244509 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:38.244439 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ad4b541-0175-42e9-a906-98db680a8920-kube-api-access-4ms5h\" (UniqueName: \"kubernetes.io/projected/3ad4b541-0175-42e9-a906-98db680a8920-kube-api-access-4ms5h\") pod \"3ad4b541-0175-42e9-a906-98db680a8920\" (UID: \"3ad4b541-0175-42e9-a906-98db680a8920\") " Nov 04 05:01:38.244509 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:38.244494 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-openshift-ca\") pod \"3ad4b541-0175-42e9-a906-98db680a8920\" (UID: \"3ad4b541-0175-42e9-a906-98db680a8920\") " Nov 04 05:01:38.244694 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:38.244519 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-xks-ca\") pod \"3ad4b541-0175-42e9-a906-98db680a8920\" (UID: \"3ad4b541-0175-42e9-a906-98db680a8920\") " Nov 04 05:01:38.244919 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:38.244888 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-openshift-ca" pod "3ad4b541-0175-42e9-a906-98db680a8920" (UID: "3ad4b541-0175-42e9-a906-98db680a8920"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:01:38.246485 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:38.246464 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad4b541-0175-42e9-a906-98db680a8920-kube-api-access-4ms5h" pod "3ad4b541-0175-42e9-a906-98db680a8920" (UID: "3ad4b541-0175-42e9-a906-98db680a8920"). InnerVolumeSpecName "kube-api-access-4ms5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:01:38.246692 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:38.246671 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-xks-ca" pod "3ad4b541-0175-42e9-a906-98db680a8920" (UID: "3ad4b541-0175-42e9-a906-98db680a8920"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:01:38.346034 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:38.345997 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ms5h\" (UniqueName: \"kubernetes.io/projected/3ad4b541-0175-42e9-a906-98db680a8920-kube-api-access-4ms5h\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:38.346034 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:38.346035 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-openshift-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:38.346325 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:38.346053 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3ad4b541-0175-42e9-a906-98db680a8920-maas-api-xks-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:39.004474 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:39.004427 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" Nov 04 05:01:39.004638 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:39.004478 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f0b92fe9-th7zc" event={"ID":"3ad4b541-0175-42e9-a906-98db680a8920","Type":"ContainerDied","Data":"042fe2185676ae141395d73afd7b01669666864b450caf5f1d4e9fd79141411b"} Nov 04 05:01:39.004638 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:39.004524 4955 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="042fe2185676ae141395d73afd7b01669666864b450caf5f1d4e9fd79141411b" Nov 04 05:01:39.828311 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:39.828223 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" podUID="1733b7c2-b85c-4ee9-859c-a6f6f617bbc7" containerName="payload-pre-processing" containerID="cri-o://593821518bf6c2cadab86da26a5adc052521df374fe2bef8863ee98d2ca68632" gracePeriod=25 Nov 04 05:01:40.950851 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:40.950810 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" podUID="9e8d9137-183b-4fd3-a138-bc3e1be7f0a6" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:01:41.232932 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.232859 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj"] Nov 04 05:01:41.233401 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.233388 4955 cpu_manager.go:414] "containerMap: removing container" podUID="3ad4b541-0175-42e9-a906-98db680a8920" containerName="revoke-keys" Nov 04 05:01:41.233449 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.233402 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ad4b541-0175-42e9-a906-98db680a8920" containerName="revoke-keys" Nov 04 05:01:41.233483 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.233457 4955 cpu_manager.go:414] "containerMap: removing container" podUID="edcb05a0-70d6-4abe-b1c5-85bb3f871c5c" containerName="payload-processing" Nov 04 05:01:41.233483 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.233463 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edcb05a0-70d6-4abe-b1c5-85bb3f871c5c" containerName="payload-processing" Nov 04 05:01:41.233547 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.233537 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ad4b541-0175-42e9-a906-98db680a8920" containerName="revoke-keys" Nov 04 05:01:41.233583 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.233554 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="edcb05a0-70d6-4abe-b1c5-85bb3f871c5c" containerName="payload-processing" Nov 04 05:01:41.236337 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.236318 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.287009 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.286980 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-a48f7e-openshift-default-dockercfg-tlcwj\"" Nov 04 05:01:41.337514 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.337479 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj"] Nov 04 05:01:41.378241 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.378209 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istiod-ca-cert\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.378241 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.378247 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-podinfo\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.378449 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.378389 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-data\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.378485 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.378461 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.378533 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.378484 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-token\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.378533 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.378508 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xr4k\" (UniqueName: \"kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-kube-api-access-9xr4k\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.378641 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.378605 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-certs\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.378695 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.378639 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-envoy\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.378695 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.378675 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-credential-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.479649 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.479617 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-podinfo\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.479846 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.479684 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-data\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.479846 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.479712 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.479846 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.479734 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-token\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.479846 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.479766 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xr4k\" (UniqueName: \"kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-kube-api-access-9xr4k\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.479846 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.479814 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-certs\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.480101 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.479870 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-envoy\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.480101 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.479901 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-credential-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.480101 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.480033 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istiod-ca-cert\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.480276 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.480100 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.480276 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.480126 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-data\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.480482 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.480459 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-credential-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.480544 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.480475 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-certs\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.480698 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.480675 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istiod-ca-cert\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.482154 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.482127 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-envoy\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.482298 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.482277 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-podinfo\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.536628 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.536563 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-token\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.536752 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.536631 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xr4k\" (UniqueName: \"kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-kube-api-access-9xr4k\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.548398 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.548373 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:41.978384 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.978350 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj"] Nov 04 05:01:41.984221 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:01:41.984194 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b343b5_e9cc_4ea5_94b7_18797d9a6052.slice/crio-8261ddd587a3fd55dfa25ec7c7fe0a0452a5df31cb9afee205b81b11e73169e2 WatchSource:0}: Error finding container 8261ddd587a3fd55dfa25ec7c7fe0a0452a5df31cb9afee205b81b11e73169e2: Status 404 returned error can't find the container with id 8261ddd587a3fd55dfa25ec7c7fe0a0452a5df31cb9afee205b81b11e73169e2 Nov 04 05:01:41.986395 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.986364 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:01:41.986487 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.986427 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:01:41.986487 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:41.986454 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:01:42.023311 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:42.023288 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" event={"ID":"76b343b5-e9cc-4ea5-94b7-18797d9a6052","Type":"ContainerStarted","Data":"8261ddd587a3fd55dfa25ec7c7fe0a0452a5df31cb9afee205b81b11e73169e2"} Nov 04 05:01:43.031058 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:43.031025 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" event={"ID":"76b343b5-e9cc-4ea5-94b7-18797d9a6052","Type":"ContainerStarted","Data":"54e3b279ea61e1051935c78b7c511fb4f0b5fb03bf089ba3aa541e96a5fc421c"} Nov 04 05:01:43.144334 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:43.144278 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" podStartSLOduration=2.144252107 podStartE2EDuration="2.144252107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:01:43.1437237 +0000 UTC m=+953.613549822" watchObservedRunningTime="2026-11-04 05:01:43.144252107 +0000 UTC m=+953.614078244" Nov 04 05:01:43.549062 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:43.549024 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:43.550911 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:43.550882 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 04 05:01:43.551052 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:43.550940 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" podUID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 04 05:01:44.548854 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:44.548813 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 04 05:01:44.549253 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:44.548871 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" podUID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 04 05:01:45.549587 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:45.549552 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 04 05:01:45.549979 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:45.549602 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" podUID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 04 05:01:45.980552 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:45.980463 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" podUID="929914ca-f11b-48ad-9e00-0c33b3e649d1" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:01:46.548960 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:46.548926 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 04 05:01:46.549137 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:46.548980 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" podUID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 04 05:01:47.548979 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:47.548940 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 04 05:01:47.549413 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:47.549004 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" podUID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 04 05:01:47.933933 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:47.933889 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" podUID="76df42a9-a151-4532-97aa-0a4c29314243" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:01:47.933933 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:47.933925 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" podUID="40ef3408-9353-4074-a199-3e996a324d6e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:01:48.549778 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:48.549739 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 04 05:01:48.550235 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:48.549796 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" podUID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 04 05:01:49.012775 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:49.012678 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" podUID="1733b7c2-b85c-4ee9-859c-a6f6f617bbc7" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:01:49.405543 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:49.405503 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" Nov 04 05:01:49.474370 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:49.474334 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-plugins-config-volume\") pod \"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6\" (UID: \"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6\") " Nov 04 05:01:49.474552 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:49.474512 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-kube-api-access-4k6wb\" (UniqueName: \"kubernetes.io/projected/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-kube-api-access-4k6wb\") pod \"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6\" (UID: \"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6\") " Nov 04 05:01:49.474813 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:49.474783 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-plugins-config-volume" pod "9e8d9137-183b-4fd3-a138-bc3e1be7f0a6" (UID: "9e8d9137-183b-4fd3-a138-bc3e1be7f0a6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:01:49.474967 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:49.474948 4955 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-plugins-config-volume\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:49.476771 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:49.476745 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-kube-api-access-4k6wb" pod "9e8d9137-183b-4fd3-a138-bc3e1be7f0a6" (UID: "9e8d9137-183b-4fd3-a138-bc3e1be7f0a6"). InnerVolumeSpecName "kube-api-access-4k6wb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:01:49.553692 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:49.553658 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:49.554175 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:49.553965 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:49.554728 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:49.554707 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:01:49.575949 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:49.575907 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k6wb\" (UniqueName: \"kubernetes.io/projected/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6-kube-api-access-4k6wb\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:50.090585 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:50.090501 4955 generic.go:356] "Generic (PLEG): container finished" podID="9e8d9137-183b-4fd3-a138-bc3e1be7f0a6" containerID="2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174" exitCode=0 Nov 04 05:01:50.090585 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:50.090546 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" Nov 04 05:01:50.090741 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:50.090581 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" event={"ID":"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6","Type":"ContainerDied","Data":"2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174"} Nov 04 05:01:50.090741 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:50.090635 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc" event={"ID":"9e8d9137-183b-4fd3-a138-bc3e1be7f0a6","Type":"ContainerDied","Data":"8cc5a3d2a1852fa68303baea311259906145a0b3b9f315b51ae3d59c30c01923"} Nov 04 05:01:50.090741 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:50.090663 4955 scope.go:122] "RemoveContainer" containerID="2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174" Nov 04 05:01:50.100211 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:50.100190 4955 scope.go:122] "RemoveContainer" containerID="2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174" Nov 04 05:01:50.100502 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:01:50.100479 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174\": container with ID starting with 2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174 not found: ID does not exist" containerID="2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174" Nov 04 05:01:50.100580 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:50.100513 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174"} err="failed to get container status \"2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174\": rpc error: code = NotFound desc = could not find container \"2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174\": container with ID starting with 2e54598633ca79b67381c8119d6bf1137d1a06c5d1ced576343a6b111a08e174 not found: ID does not exist" Nov 04 05:01:50.245453 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:50.245424 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc"] Nov 04 05:01:50.248679 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:50.248654 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-19bf5b-788f567bdc-7qxvc"] Nov 04 05:01:51.656744 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:51.656710 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e8d9137-183b-4fd3-a138-bc3e1be7f0a6" path="/var/lib/kubelet/pods/9e8d9137-183b-4fd3-a138-bc3e1be7f0a6/volumes" Nov 04 05:01:54.787878 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:54.787850 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" Nov 04 05:01:54.886478 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:54.886442 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt"] Nov 04 05:01:54.886713 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:54.886687 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" podUID="187a1fae-5842-45b7-ba66-10fa4ec6a515" containerName="istio-proxy" containerID="cri-o://b4081bb25bace893c1cbf661ca66c7803265866dcf062d143614ddab4df263e7" gracePeriod=30 Nov 04 05:01:54.946081 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:54.946043 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/929914ca-f11b-48ad-9e00-0c33b3e649d1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/929914ca-f11b-48ad-9e00-0c33b3e649d1-plugins-config-volume\") pod \"929914ca-f11b-48ad-9e00-0c33b3e649d1\" (UID: \"929914ca-f11b-48ad-9e00-0c33b3e649d1\") " Nov 04 05:01:54.946332 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:54.946200 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/929914ca-f11b-48ad-9e00-0c33b3e649d1-kube-api-access-k9ckx\" (UniqueName: \"kubernetes.io/projected/929914ca-f11b-48ad-9e00-0c33b3e649d1-kube-api-access-k9ckx\") pod \"929914ca-f11b-48ad-9e00-0c33b3e649d1\" (UID: \"929914ca-f11b-48ad-9e00-0c33b3e649d1\") " Nov 04 05:01:54.946908 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:54.946878 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/929914ca-f11b-48ad-9e00-0c33b3e649d1-plugins-config-volume" pod "929914ca-f11b-48ad-9e00-0c33b3e649d1" (UID: "929914ca-f11b-48ad-9e00-0c33b3e649d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:01:54.948325 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:54.948297 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/929914ca-f11b-48ad-9e00-0c33b3e649d1-kube-api-access-k9ckx" pod "929914ca-f11b-48ad-9e00-0c33b3e649d1" (UID: "929914ca-f11b-48ad-9e00-0c33b3e649d1"). InnerVolumeSpecName "kube-api-access-k9ckx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:01:55.047981 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:55.047903 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9ckx\" (UniqueName: \"kubernetes.io/projected/929914ca-f11b-48ad-9e00-0c33b3e649d1-kube-api-access-k9ckx\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:55.047981 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:55.047934 4955 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/929914ca-f11b-48ad-9e00-0c33b3e649d1-plugins-config-volume\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:55.129543 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:55.129509 4955 generic.go:356] "Generic (PLEG): container finished" podID="929914ca-f11b-48ad-9e00-0c33b3e649d1" containerID="40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6" exitCode=0 Nov 04 05:01:55.129729 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:55.129564 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" Nov 04 05:01:55.129729 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:55.129593 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" event={"ID":"929914ca-f11b-48ad-9e00-0c33b3e649d1","Type":"ContainerDied","Data":"40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6"} Nov 04 05:01:55.129729 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:55.129646 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9" event={"ID":"929914ca-f11b-48ad-9e00-0c33b3e649d1","Type":"ContainerDied","Data":"3a9ab6a8a33d99d70da22a8910a79e0e1aa7b6d94bf5ce3a0576f0a1b3d9e7e5"} Nov 04 05:01:55.129729 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:55.129668 4955 scope.go:122] "RemoveContainer" containerID="40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6" Nov 04 05:01:55.139310 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:55.139290 4955 scope.go:122] "RemoveContainer" containerID="40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6" Nov 04 05:01:55.139577 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:01:55.139560 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6\": container with ID starting with 40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6 not found: ID does not exist" containerID="40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6" Nov 04 05:01:55.139643 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:55.139583 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6"} err="failed to get container status \"40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6\": rpc error: code = NotFound desc = could not find container \"40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6\": container with ID starting with 40a43b04eb28543fc36bf5fd3e522bc056a82a4f3d4ba226d3464aa4ec7312c6 not found: ID does not exist" Nov 04 05:01:55.286782 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:55.286739 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9"] Nov 04 05:01:55.290313 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:55.290282 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-204fa0-54f6974999-bk4s9"] Nov 04 05:01:55.656109 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:55.656076 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="929914ca-f11b-48ad-9e00-0c33b3e649d1" path="/var/lib/kubelet/pods/929914ca-f11b-48ad-9e00-0c33b3e649d1/volumes" Nov 04 05:01:57.146454 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.146422 4955 generic.go:356] "Generic (PLEG): container finished" podID="76df42a9-a151-4532-97aa-0a4c29314243" containerID="5bbf38efd573790b453b5d18bed5e663f6abe7c2e7baa4242d20324c126662e0" exitCode=0 Nov 04 05:01:57.146794 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.146454 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" event={"ID":"76df42a9-a151-4532-97aa-0a4c29314243","Type":"ContainerDied","Data":"5bbf38efd573790b453b5d18bed5e663f6abe7c2e7baa4242d20324c126662e0"} Nov 04 05:01:57.335676 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.335298 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" Nov 04 05:01:57.463519 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.463493 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" Nov 04 05:01:57.478508 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.478478 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/76df42a9-a151-4532-97aa-0a4c29314243-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76df42a9-a151-4532-97aa-0a4c29314243-plugins-config-volume\") pod \"76df42a9-a151-4532-97aa-0a4c29314243\" (UID: \"76df42a9-a151-4532-97aa-0a4c29314243\") " Nov 04 05:01:57.478714 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.478699 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76df42a9-a151-4532-97aa-0a4c29314243-kube-api-access-pjjbf\" (UniqueName: \"kubernetes.io/projected/76df42a9-a151-4532-97aa-0a4c29314243-kube-api-access-pjjbf\") pod \"76df42a9-a151-4532-97aa-0a4c29314243\" (UID: \"76df42a9-a151-4532-97aa-0a4c29314243\") " Nov 04 05:01:57.478913 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.478888 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76df42a9-a151-4532-97aa-0a4c29314243-plugins-config-volume" pod "76df42a9-a151-4532-97aa-0a4c29314243" (UID: "76df42a9-a151-4532-97aa-0a4c29314243"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:01:57.479119 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.479097 4955 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76df42a9-a151-4532-97aa-0a4c29314243-plugins-config-volume\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:57.480769 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.480743 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76df42a9-a151-4532-97aa-0a4c29314243-kube-api-access-pjjbf" pod "76df42a9-a151-4532-97aa-0a4c29314243" (UID: "76df42a9-a151-4532-97aa-0a4c29314243"). InnerVolumeSpecName "kube-api-access-pjjbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:01:57.580169 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.580133 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/40ef3408-9353-4074-a199-3e996a324d6e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40ef3408-9353-4074-a199-3e996a324d6e-plugins-config-volume\") pod \"40ef3408-9353-4074-a199-3e996a324d6e\" (UID: \"40ef3408-9353-4074-a199-3e996a324d6e\") " Nov 04 05:01:57.580425 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.580403 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40ef3408-9353-4074-a199-3e996a324d6e-kube-api-access-6m6pj\" (UniqueName: \"kubernetes.io/projected/40ef3408-9353-4074-a199-3e996a324d6e-kube-api-access-6m6pj\") pod \"40ef3408-9353-4074-a199-3e996a324d6e\" (UID: \"40ef3408-9353-4074-a199-3e996a324d6e\") " Nov 04 05:01:57.580835 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.580806 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjjbf\" (UniqueName: \"kubernetes.io/projected/76df42a9-a151-4532-97aa-0a4c29314243-kube-api-access-pjjbf\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:57.581601 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.581573 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40ef3408-9353-4074-a199-3e996a324d6e-plugins-config-volume" pod "40ef3408-9353-4074-a199-3e996a324d6e" (UID: "40ef3408-9353-4074-a199-3e996a324d6e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:01:57.583007 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.582977 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ef3408-9353-4074-a199-3e996a324d6e-kube-api-access-6m6pj" pod "40ef3408-9353-4074-a199-3e996a324d6e" (UID: "40ef3408-9353-4074-a199-3e996a324d6e"). InnerVolumeSpecName "kube-api-access-6m6pj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:01:57.681921 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.681892 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m6pj\" (UniqueName: \"kubernetes.io/projected/40ef3408-9353-4074-a199-3e996a324d6e-kube-api-access-6m6pj\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:57.681921 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:57.681920 4955 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40ef3408-9353-4074-a199-3e996a324d6e-plugins-config-volume\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:01:58.153607 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.153572 4955 generic.go:356] "Generic (PLEG): container finished" podID="40ef3408-9353-4074-a199-3e996a324d6e" containerID="6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145" exitCode=0 Nov 04 05:01:58.154020 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.153620 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" Nov 04 05:01:58.154020 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.153654 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" event={"ID":"40ef3408-9353-4074-a199-3e996a324d6e","Type":"ContainerDied","Data":"6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145"} Nov 04 05:01:58.154020 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.153704 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w" event={"ID":"40ef3408-9353-4074-a199-3e996a324d6e","Type":"ContainerDied","Data":"5528ea19ad7a77b159eb9f12755f7a08cd5e6788b8814a2dbdd239bbbbfd37cb"} Nov 04 05:01:58.154020 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.153725 4955 scope.go:122] "RemoveContainer" containerID="6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145" Nov 04 05:01:58.155258 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.155233 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" event={"ID":"76df42a9-a151-4532-97aa-0a4c29314243","Type":"ContainerDied","Data":"20eadbcf5700f0fad5d578ce2b09c542f4002270663816506576a64e98423b67"} Nov 04 05:01:58.155258 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.155276 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm" Nov 04 05:01:58.163505 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.163489 4955 scope.go:122] "RemoveContainer" containerID="6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145" Nov 04 05:01:58.163836 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:01:58.163818 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145\": container with ID starting with 6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145 not found: ID does not exist" containerID="6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145" Nov 04 05:01:58.163896 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.163842 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145"} err="failed to get container status \"6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145\": rpc error: code = NotFound desc = could not find container \"6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145\": container with ID starting with 6f80f289d136a719f735d8e2f1dd0eb08223f721f28f5678342d3fac2eb84145 not found: ID does not exist" Nov 04 05:01:58.163896 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.163858 4955 scope.go:122] "RemoveContainer" containerID="5bbf38efd573790b453b5d18bed5e663f6abe7c2e7baa4242d20324c126662e0" Nov 04 05:01:58.189840 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:01:58.189811 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:01:58.309089 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.309050 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm"] Nov 04 05:01:58.314696 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.314668 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-e62689-c899889b-5wqlm"] Nov 04 05:01:58.416278 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.416241 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w"] Nov 04 05:01:58.426217 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:58.426191 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-e62689-6ccf56677f-gdc7w"] Nov 04 05:01:59.013150 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:59.013107 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" podUID="1733b7c2-b85c-4ee9-859c-a6f6f617bbc7" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:01:59.655199 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:59.655167 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="40ef3408-9353-4074-a199-3e996a324d6e" path="/var/lib/kubelet/pods/40ef3408-9353-4074-a199-3e996a324d6e/volumes" Nov 04 05:01:59.655605 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:01:59.655578 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76df42a9-a151-4532-97aa-0a4c29314243" path="/var/lib/kubelet/pods/76df42a9-a151-4532-97aa-0a4c29314243/volumes" Nov 04 05:02:00.176692 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.176602 4955 generic.go:356] "Generic (PLEG): container finished" podID="1733b7c2-b85c-4ee9-859c-a6f6f617bbc7" containerID="593821518bf6c2cadab86da26a5adc052521df374fe2bef8863ee98d2ca68632" exitCode=0 Nov 04 05:02:00.176692 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.176674 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" event={"ID":"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7","Type":"ContainerDied","Data":"593821518bf6c2cadab86da26a5adc052521df374fe2bef8863ee98d2ca68632"} Nov 04 05:02:00.178597 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.178573 4955 generic.go:356] "Generic (PLEG): container finished" podID="187a1fae-5842-45b7-ba66-10fa4ec6a515" containerID="b4081bb25bace893c1cbf661ca66c7803265866dcf062d143614ddab4df263e7" exitCode=0 Nov 04 05:02:00.178723 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.178644 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" event={"ID":"187a1fae-5842-45b7-ba66-10fa4ec6a515","Type":"ContainerDied","Data":"b4081bb25bace893c1cbf661ca66c7803265866dcf062d143614ddab4df263e7"} Nov 04 05:02:00.224520 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.224494 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" Nov 04 05:02:00.228938 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.228913 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 05:02:00.268165 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.268134 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp"] Nov 04 05:02:00.314524 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.314494 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c"] Nov 04 05:02:00.318634 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.318604 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq"] Nov 04 05:02:00.411496 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.411453 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-kube-api-access-bd84l\" (UniqueName: \"kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-kube-api-access-bd84l\") pod \"187a1fae-5842-45b7-ba66-10fa4ec6a515\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " Nov 04 05:02:00.411686 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.411519 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/187a1fae-5842-45b7-ba66-10fa4ec6a515-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/187a1fae-5842-45b7-ba66-10fa4ec6a515-istiod-ca-cert\") pod \"187a1fae-5842-45b7-ba66-10fa4ec6a515\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " Nov 04 05:02:00.411686 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.411628 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-kube-api-access-z2sgl\" (UniqueName: \"kubernetes.io/projected/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-kube-api-access-z2sgl\") pod \"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7\" (UID: \"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7\") " Nov 04 05:02:00.411686 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.411660 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-envoy\") pod \"187a1fae-5842-45b7-ba66-10fa4ec6a515\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " Nov 04 05:02:00.411913 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.411687 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-plugins-config-volume\") pod \"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7\" (UID: \"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7\") " Nov 04 05:02:00.411913 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.411754 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-token\" (UniqueName: \"kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-token\") pod \"187a1fae-5842-45b7-ba66-10fa4ec6a515\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " Nov 04 05:02:00.412025 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.411991 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/187a1fae-5842-45b7-ba66-10fa4ec6a515-istiod-ca-cert" pod "187a1fae-5842-45b7-ba66-10fa4ec6a515" (UID: "187a1fae-5842-45b7-ba66-10fa4ec6a515"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:02:00.412174 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.412144 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-plugins-config-volume" pod "1733b7c2-b85c-4ee9-859c-a6f6f617bbc7" (UID: "1733b7c2-b85c-4ee9-859c-a6f6f617bbc7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:02:00.412350 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.412222 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-credential-socket\") pod \"187a1fae-5842-45b7-ba66-10fa4ec6a515\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " Nov 04 05:02:00.412350 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.412292 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-data\") pod \"187a1fae-5842-45b7-ba66-10fa4ec6a515\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " Nov 04 05:02:00.412609 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.412353 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-certs\") pod \"187a1fae-5842-45b7-ba66-10fa4ec6a515\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " Nov 04 05:02:00.412609 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.412412 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-podinfo\") pod \"187a1fae-5842-45b7-ba66-10fa4ec6a515\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " Nov 04 05:02:00.412609 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.412521 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-credential-socket" pod "187a1fae-5842-45b7-ba66-10fa4ec6a515" (UID: "187a1fae-5842-45b7-ba66-10fa4ec6a515"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:00.412609 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.412584 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-socket\") pod \"187a1fae-5842-45b7-ba66-10fa4ec6a515\" (UID: \"187a1fae-5842-45b7-ba66-10fa4ec6a515\") " Nov 04 05:02:00.412828 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.412716 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-data" pod "187a1fae-5842-45b7-ba66-10fa4ec6a515" (UID: "187a1fae-5842-45b7-ba66-10fa4ec6a515"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:00.412941 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.412919 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-certs" pod "187a1fae-5842-45b7-ba66-10fa4ec6a515" (UID: "187a1fae-5842-45b7-ba66-10fa4ec6a515"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:00.413094 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.413072 4955 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/187a1fae-5842-45b7-ba66-10fa4ec6a515-istiod-ca-cert\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:00.413162 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.413102 4955 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-plugins-config-volume\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:00.413162 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.413119 4955 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-credential-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:00.413162 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.413133 4955 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-data\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:00.413162 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.413147 4955 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:00.413404 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.413355 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-socket" pod "187a1fae-5842-45b7-ba66-10fa4ec6a515" (UID: "187a1fae-5842-45b7-ba66-10fa4ec6a515"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:00.414223 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.414197 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-kube-api-access-z2sgl" pod "1733b7c2-b85c-4ee9-859c-a6f6f617bbc7" (UID: "1733b7c2-b85c-4ee9-859c-a6f6f617bbc7"). InnerVolumeSpecName "kube-api-access-z2sgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:00.414376 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.414356 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-envoy" pod "187a1fae-5842-45b7-ba66-10fa4ec6a515" (UID: "187a1fae-5842-45b7-ba66-10fa4ec6a515"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:00.414454 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.414376 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-kube-api-access-bd84l" pod "187a1fae-5842-45b7-ba66-10fa4ec6a515" (UID: "187a1fae-5842-45b7-ba66-10fa4ec6a515"). InnerVolumeSpecName "kube-api-access-bd84l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:00.414541 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.414525 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-token" pod "187a1fae-5842-45b7-ba66-10fa4ec6a515" (UID: "187a1fae-5842-45b7-ba66-10fa4ec6a515"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:00.414959 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.414944 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-podinfo" pod "187a1fae-5842-45b7-ba66-10fa4ec6a515" (UID: "187a1fae-5842-45b7-ba66-10fa4ec6a515"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:02:00.514889 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.514809 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2sgl\" (UniqueName: \"kubernetes.io/projected/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7-kube-api-access-z2sgl\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:00.514889 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.514839 4955 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-envoy\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:00.514889 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.514855 4955 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-token\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:00.514889 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.514867 4955 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/187a1fae-5842-45b7-ba66-10fa4ec6a515-istio-podinfo\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:00.514889 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.514876 4955 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/187a1fae-5842-45b7-ba66-10fa4ec6a515-workload-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:00.514889 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:00.514885 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd84l\" (UniqueName: \"kubernetes.io/projected/187a1fae-5842-45b7-ba66-10fa4ec6a515-kube-api-access-bd84l\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:01.188488 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:01.188450 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" event={"ID":"1733b7c2-b85c-4ee9-859c-a6f6f617bbc7","Type":"ContainerDied","Data":"ba0ab813d68a043e2058c28f08c7390a9484c6cf9c014946f867d30e652d9e9d"} Nov 04 05:02:01.188976 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:01.188521 4955 scope.go:122] "RemoveContainer" containerID="593821518bf6c2cadab86da26a5adc052521df374fe2bef8863ee98d2ca68632" Nov 04 05:02:01.188976 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:01.188470 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk" Nov 04 05:02:01.191277 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:01.191237 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" event={"ID":"187a1fae-5842-45b7-ba66-10fa4ec6a515","Type":"ContainerDied","Data":"ef98b77c01ed7f971f38e9bd1570a04c9581a33b80d6d85be4c4f3efd5786ee3"} Nov 04 05:02:01.191557 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:01.191524 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt" Nov 04 05:02:01.203210 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:01.203190 4955 scope.go:122] "RemoveContainer" containerID="b4081bb25bace893c1cbf661ca66c7803265866dcf062d143614ddab4df263e7" Nov 04 05:02:01.343831 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:01.343796 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk"] Nov 04 05:02:01.348171 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:01.348146 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-db8fae-7874674859-wf2wk"] Nov 04 05:02:01.451322 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:01.451234 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt"] Nov 04 05:02:01.455989 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:01.455964 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-v7kjt"] Nov 04 05:02:01.656493 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:01.656465 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1733b7c2-b85c-4ee9-859c-a6f6f617bbc7" path="/var/lib/kubelet/pods/1733b7c2-b85c-4ee9-859c-a6f6f617bbc7/volumes" Nov 04 05:02:01.656970 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:01.656955 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="187a1fae-5842-45b7-ba66-10fa4ec6a515" path="/var/lib/kubelet/pods/187a1fae-5842-45b7-ba66-10fa4ec6a515/volumes" Nov 04 05:02:11.759463 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.759421 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc"] Nov 04 05:02:11.759944 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.759928 4955 cpu_manager.go:414] "containerMap: removing container" podUID="929914ca-f11b-48ad-9e00-0c33b3e649d1" containerName="payload-pre-processing" Nov 04 05:02:11.759990 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.759945 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="929914ca-f11b-48ad-9e00-0c33b3e649d1" containerName="payload-pre-processing" Nov 04 05:02:11.759990 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.759965 4955 cpu_manager.go:414] "containerMap: removing container" podUID="187a1fae-5842-45b7-ba66-10fa4ec6a515" containerName="istio-proxy" Nov 04 05:02:11.759990 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.759970 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="187a1fae-5842-45b7-ba66-10fa4ec6a515" containerName="istio-proxy" Nov 04 05:02:11.759990 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.759988 4955 cpu_manager.go:414] "containerMap: removing container" podUID="1733b7c2-b85c-4ee9-859c-a6f6f617bbc7" containerName="payload-pre-processing" Nov 04 05:02:11.760116 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.759993 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1733b7c2-b85c-4ee9-859c-a6f6f617bbc7" containerName="payload-pre-processing" Nov 04 05:02:11.760116 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.760022 4955 cpu_manager.go:414] "containerMap: removing container" podUID="40ef3408-9353-4074-a199-3e996a324d6e" containerName="payload-pre-processing" Nov 04 05:02:11.760116 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.760027 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40ef3408-9353-4074-a199-3e996a324d6e" containerName="payload-pre-processing" Nov 04 05:02:11.760116 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.760033 4955 cpu_manager.go:414] "containerMap: removing container" podUID="76df42a9-a151-4532-97aa-0a4c29314243" containerName="payload-processing" Nov 04 05:02:11.760116 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.760038 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76df42a9-a151-4532-97aa-0a4c29314243" containerName="payload-processing" Nov 04 05:02:11.760116 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.760048 4955 cpu_manager.go:414] "containerMap: removing container" podUID="9e8d9137-183b-4fd3-a138-bc3e1be7f0a6" containerName="payload-pre-processing" Nov 04 05:02:11.760116 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.760053 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e8d9137-183b-4fd3-a138-bc3e1be7f0a6" containerName="payload-pre-processing" Nov 04 05:02:11.760383 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.760135 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="1733b7c2-b85c-4ee9-859c-a6f6f617bbc7" containerName="payload-pre-processing" Nov 04 05:02:11.760383 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.760146 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="40ef3408-9353-4074-a199-3e996a324d6e" containerName="payload-pre-processing" Nov 04 05:02:11.760383 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.760153 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="76df42a9-a151-4532-97aa-0a4c29314243" containerName="payload-processing" Nov 04 05:02:11.760383 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.760160 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e8d9137-183b-4fd3-a138-bc3e1be7f0a6" containerName="payload-pre-processing" Nov 04 05:02:11.760383 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.760166 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="929914ca-f11b-48ad-9e00-0c33b3e649d1" containerName="payload-pre-processing" Nov 04 05:02:11.760383 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.760173 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="187a1fae-5842-45b7-ba66-10fa4ec6a515" containerName="istio-proxy" Nov 04 05:02:11.763925 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.763903 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.829002 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.828965 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-certs\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.829002 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.829003 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-envoy\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.829205 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.829028 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-socket\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.829205 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.829114 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-credential-socket\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.829205 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.829158 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjpqs\" (UniqueName: \"kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-kube-api-access-xjpqs\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.829377 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.829351 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-podinfo\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.829483 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.829462 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-data\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.829559 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.829542 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-token\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.829662 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.829645 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f43c96-8170-4c54-aa5a-d73994cb353a-istiod-ca-cert\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.882827 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.882791 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc"] Nov 04 05:02:11.930780 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.930744 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-podinfo\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.930976 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.930805 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-data\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.930976 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.930825 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-token\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.930976 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.930864 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f43c96-8170-4c54-aa5a-d73994cb353a-istiod-ca-cert\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.930976 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.930887 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-certs\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.930976 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.930905 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-envoy\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.930976 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.930944 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-socket\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.931350 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.930987 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-credential-socket\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.931350 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.931012 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjpqs\" (UniqueName: \"kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-kube-api-access-xjpqs\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.931350 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.931215 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-data\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.931534 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.931368 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-certs\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.931589 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.931558 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-credential-socket\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.931633 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.931613 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-socket\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.931936 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.931917 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f43c96-8170-4c54-aa5a-d73994cb353a-istiod-ca-cert\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.933744 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.933721 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-envoy\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:11.934083 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:11.934060 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-podinfo\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:12.027708 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:12.027638 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-token\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:12.027831 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:12.027801 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjpqs\" (UniqueName: \"kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-kube-api-access-xjpqs\") pod \"e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:12.077776 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:12.077745 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:12.311702 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:12.311659 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6"] Nov 04 05:02:12.428604 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:12.428573 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l"] Nov 04 05:02:12.505512 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:12.505480 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc"] Nov 04 05:02:12.511880 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:02:12.511855 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f43c96_8170_4c54_aa5a_d73994cb353a.slice/crio-24db9341e67b21c50bad564936421f6139efa4bcf55c3d3b0d5913cf5167b652 WatchSource:0}: Error finding container 24db9341e67b21c50bad564936421f6139efa4bcf55c3d3b0d5913cf5167b652: Status 404 returned error can't find the container with id 24db9341e67b21c50bad564936421f6139efa4bcf55c3d3b0d5913cf5167b652 Nov 04 05:02:12.514072 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:12.514038 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:02:12.514135 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:12.514107 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:02:12.514174 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:12.514156 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:02:13.282697 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:13.282653 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" event={"ID":"66f43c96-8170-4c54-aa5a-d73994cb353a","Type":"ContainerStarted","Data":"6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea"} Nov 04 05:02:13.283194 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:13.282725 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" event={"ID":"66f43c96-8170-4c54-aa5a-d73994cb353a","Type":"ContainerStarted","Data":"24db9341e67b21c50bad564936421f6139efa4bcf55c3d3b0d5913cf5167b652"} Nov 04 05:02:13.396782 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:13.396725 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" podStartSLOduration=2.3967096359999998 podStartE2EDuration="2.396709636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:02:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:02:13.394860131 +0000 UTC m=+983.864686270" watchObservedRunningTime="2026-11-04 05:02:13.396709636 +0000 UTC m=+983.866535775" Nov 04 05:02:14.087289 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:14.086329 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:14.090682 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:14.087789 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Nov 04 05:02:14.090682 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:14.087844 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" podUID="66f43c96-8170-4c54-aa5a-d73994cb353a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Nov 04 05:02:15.078725 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.078683 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Nov 04 05:02:15.079186 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.078747 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" podUID="66f43c96-8170-4c54-aa5a-d73994cb353a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Nov 04 05:02:15.180648 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.180604 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph"] Nov 04 05:02:15.185761 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.185732 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:15.234205 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.234173 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 05:02:15.234432 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.234400 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nz4vh\"" Nov 04 05:02:15.291385 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.291302 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph"] Nov 04 05:02:15.292603 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.292574 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-7a85b2c9-tlxph\" (UID: \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:15.292865 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.292827 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-7a85b2c9-tlxph\" (UID: \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:15.293008 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.292991 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdrdd\" (UniqueName: \"kubernetes.io/projected/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-kube-api-access-zdrdd\") pod \"maas-api-revoke-sub-7a85b2c9-tlxph\" (UID: \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:15.296166 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.296113 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" podUID="92236588-ff47-4a13-bc40-022f0f21c77c" containerName="main" containerID="cri-o://7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc" gracePeriod=45 Nov 04 05:02:15.337863 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.337789 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" podUID="ef55c5ea-46c5-422f-851f-f85fadc9bbf1" containerName="main" containerID="cri-o://37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0" gracePeriod=45 Nov 04 05:02:15.342307 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.342270 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" podUID="50106aec-7c7a-4c81-beb4-9f015c566a75" containerName="main" containerID="cri-o://de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564" gracePeriod=45 Nov 04 05:02:15.393900 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.393865 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-7a85b2c9-tlxph\" (UID: \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:15.394027 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.393940 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-7a85b2c9-tlxph\" (UID: \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:15.394027 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.393967 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdrdd\" (UniqueName: \"kubernetes.io/projected/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-kube-api-access-zdrdd\") pod \"maas-api-revoke-sub-7a85b2c9-tlxph\" (UID: \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:15.394528 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.394503 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-7a85b2c9-tlxph\" (UID: \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:15.396243 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.396223 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-7a85b2c9-tlxph\" (UID: \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:15.416465 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.416430 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" podUID="92236588-ff47-4a13-bc40-022f0f21c77c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": dial tcp 10.132.0.79:8000: connect: connection refused" Nov 04 05:02:15.440090 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.440001 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" podUID="ef55c5ea-46c5-422f-851f-f85fadc9bbf1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": dial tcp 10.132.0.69:8000: connect: connection refused" Nov 04 05:02:15.483468 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.483408 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdrdd\" (UniqueName: \"kubernetes.io/projected/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-kube-api-access-zdrdd\") pod \"maas-api-revoke-sub-7a85b2c9-tlxph\" (UID: \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:15.509301 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.506453 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:15.713862 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.713472 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:02:15.743314 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.743291 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 05:02:15.752062 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.752029 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 05:02:15.800119 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.800061 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-model-cache\") pod \"92236588-ff47-4a13-bc40-022f0f21c77c\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " Nov 04 05:02:15.800317 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.800217 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92236588-ff47-4a13-bc40-022f0f21c77c-tls-certs\" (UniqueName: \"kubernetes.io/secret/92236588-ff47-4a13-bc40-022f0f21c77c-tls-certs\") pod \"92236588-ff47-4a13-bc40-022f0f21c77c\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " Nov 04 05:02:15.800317 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.800288 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-tmp-dir\") pod \"92236588-ff47-4a13-bc40-022f0f21c77c\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " Nov 04 05:02:15.800474 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.800321 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-dshm\") pod \"92236588-ff47-4a13-bc40-022f0f21c77c\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " Nov 04 05:02:15.800474 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.800386 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92236588-ff47-4a13-bc40-022f0f21c77c-kube-api-access-6rdgv\" (UniqueName: \"kubernetes.io/projected/92236588-ff47-4a13-bc40-022f0f21c77c-kube-api-access-6rdgv\") pod \"92236588-ff47-4a13-bc40-022f0f21c77c\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " Nov 04 05:02:15.800474 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.800426 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-home\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-home\") pod \"92236588-ff47-4a13-bc40-022f0f21c77c\" (UID: \"92236588-ff47-4a13-bc40-022f0f21c77c\") " Nov 04 05:02:15.800985 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.800956 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-tmp-dir" pod "92236588-ff47-4a13-bc40-022f0f21c77c" (UID: "92236588-ff47-4a13-bc40-022f0f21c77c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:15.801589 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.801532 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-model-cache" pod "92236588-ff47-4a13-bc40-022f0f21c77c" (UID: "92236588-ff47-4a13-bc40-022f0f21c77c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:15.801878 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.801856 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-home" pod "92236588-ff47-4a13-bc40-022f0f21c77c" (UID: "92236588-ff47-4a13-bc40-022f0f21c77c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:15.803824 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.803796 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-dshm" pod "92236588-ff47-4a13-bc40-022f0f21c77c" (UID: "92236588-ff47-4a13-bc40-022f0f21c77c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:15.803982 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.803961 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92236588-ff47-4a13-bc40-022f0f21c77c-tls-certs" pod "92236588-ff47-4a13-bc40-022f0f21c77c" (UID: "92236588-ff47-4a13-bc40-022f0f21c77c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:02:15.804424 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.804403 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92236588-ff47-4a13-bc40-022f0f21c77c-kube-api-access-6rdgv" pod "92236588-ff47-4a13-bc40-022f0f21c77c" (UID: "92236588-ff47-4a13-bc40-022f0f21c77c"). InnerVolumeSpecName "kube-api-access-6rdgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:15.902280 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902181 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50106aec-7c7a-4c81-beb4-9f015c566a75-kube-api-access-jhsfw\" (UniqueName: \"kubernetes.io/projected/50106aec-7c7a-4c81-beb4-9f015c566a75-kube-api-access-jhsfw\") pod \"50106aec-7c7a-4c81-beb4-9f015c566a75\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " Nov 04 05:02:15.902542 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902249 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-home\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-home\") pod \"50106aec-7c7a-4c81-beb4-9f015c566a75\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " Nov 04 05:02:15.902542 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902310 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-home\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-home\") pod \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " Nov 04 05:02:15.902542 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902345 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-model-cache\") pod \"50106aec-7c7a-4c81-beb4-9f015c566a75\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " Nov 04 05:02:15.902542 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902381 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tmp-dir\") pod \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " Nov 04 05:02:15.902542 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902416 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/50106aec-7c7a-4c81-beb4-9f015c566a75-tls-certs\" (UniqueName: \"kubernetes.io/secret/50106aec-7c7a-4c81-beb4-9f015c566a75-tls-certs\") pod \"50106aec-7c7a-4c81-beb4-9f015c566a75\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " Nov 04 05:02:15.902542 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902498 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-dshm\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-dshm\") pod \"50106aec-7c7a-4c81-beb4-9f015c566a75\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " Nov 04 05:02:15.902905 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902573 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-dshm\") pod \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " Nov 04 05:02:15.902905 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902612 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-kube-api-access-4lvxs\" (UniqueName: \"kubernetes.io/projected/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-kube-api-access-4lvxs\") pod \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " Nov 04 05:02:15.902905 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902622 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-home" pod "50106aec-7c7a-4c81-beb4-9f015c566a75" (UID: "50106aec-7c7a-4c81-beb4-9f015c566a75"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:15.902905 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902641 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tls-certs\") pod \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " Nov 04 05:02:15.902905 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902683 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-tmp-dir\") pod \"50106aec-7c7a-4c81-beb4-9f015c566a75\" (UID: \"50106aec-7c7a-4c81-beb4-9f015c566a75\") " Nov 04 05:02:15.902905 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902727 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-model-cache\") pod \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\" (UID: \"ef55c5ea-46c5-422f-851f-f85fadc9bbf1\") " Nov 04 05:02:15.902905 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902764 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tmp-dir" pod "ef55c5ea-46c5-422f-851f-f85fadc9bbf1" (UID: "ef55c5ea-46c5-422f-851f-f85fadc9bbf1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:15.903167 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.902973 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-home" pod "ef55c5ea-46c5-422f-851f-f85fadc9bbf1" (UID: "ef55c5ea-46c5-422f-851f-f85fadc9bbf1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:15.903204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.903176 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-model-cache" pod "ef55c5ea-46c5-422f-851f-f85fadc9bbf1" (UID: "ef55c5ea-46c5-422f-851f-f85fadc9bbf1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:15.903204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.903178 4955 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-model-cache\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:15.903314 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.903215 4955 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92236588-ff47-4a13-bc40-022f0f21c77c-tls-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:15.903314 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.903231 4955 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-tmp-dir\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:15.903314 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.903245 4955 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-dshm\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:15.903314 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.903287 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rdgv\" (UniqueName: \"kubernetes.io/projected/92236588-ff47-4a13-bc40-022f0f21c77c-kube-api-access-6rdgv\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:15.903314 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.903302 4955 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92236588-ff47-4a13-bc40-022f0f21c77c-home\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:15.903566 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.903347 4955 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-home\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:15.903566 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.903362 4955 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-home\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:15.903566 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.903370 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-model-cache" pod "50106aec-7c7a-4c81-beb4-9f015c566a75" (UID: "50106aec-7c7a-4c81-beb4-9f015c566a75"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:15.903566 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.903375 4955 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tmp-dir\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:15.904073 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.904041 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-tmp-dir" pod "50106aec-7c7a-4c81-beb4-9f015c566a75" (UID: "50106aec-7c7a-4c81-beb4-9f015c566a75"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:15.905583 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.905548 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-dshm" pod "50106aec-7c7a-4c81-beb4-9f015c566a75" (UID: "50106aec-7c7a-4c81-beb4-9f015c566a75"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:15.905886 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.905852 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tls-certs" pod "ef55c5ea-46c5-422f-851f-f85fadc9bbf1" (UID: "ef55c5ea-46c5-422f-851f-f85fadc9bbf1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:02:15.905886 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.905869 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-dshm" pod "ef55c5ea-46c5-422f-851f-f85fadc9bbf1" (UID: "ef55c5ea-46c5-422f-851f-f85fadc9bbf1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:15.906222 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.906196 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50106aec-7c7a-4c81-beb4-9f015c566a75-tls-certs" pod "50106aec-7c7a-4c81-beb4-9f015c566a75" (UID: "50106aec-7c7a-4c81-beb4-9f015c566a75"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:02:15.906688 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.906666 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-kube-api-access-4lvxs" pod "ef55c5ea-46c5-422f-851f-f85fadc9bbf1" (UID: "ef55c5ea-46c5-422f-851f-f85fadc9bbf1"). InnerVolumeSpecName "kube-api-access-4lvxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:15.907066 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.907047 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50106aec-7c7a-4c81-beb4-9f015c566a75-kube-api-access-jhsfw" pod "50106aec-7c7a-4c81-beb4-9f015c566a75" (UID: "50106aec-7c7a-4c81-beb4-9f015c566a75"). InnerVolumeSpecName "kube-api-access-jhsfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:15.986745 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:15.986716 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph"] Nov 04 05:02:16.004979 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.004949 4955 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-dshm\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:16.004979 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.004982 4955 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-dshm\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:16.005157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.004994 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lvxs\" (UniqueName: \"kubernetes.io/projected/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-kube-api-access-4lvxs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:16.005157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.005004 4955 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-tls-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:16.005157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.005015 4955 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-tmp-dir\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:16.005157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.005027 4955 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef55c5ea-46c5-422f-851f-f85fadc9bbf1-model-cache\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:16.005157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.005043 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhsfw\" (UniqueName: \"kubernetes.io/projected/50106aec-7c7a-4c81-beb4-9f015c566a75-kube-api-access-jhsfw\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:16.005157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.005051 4955 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50106aec-7c7a-4c81-beb4-9f015c566a75-model-cache\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:16.005157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.005060 4955 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50106aec-7c7a-4c81-beb4-9f015c566a75-tls-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:16.085999 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.085561 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Nov 04 05:02:16.085999 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.085615 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" podUID="66f43c96-8170-4c54-aa5a-d73994cb353a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Nov 04 05:02:16.313331 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.313287 4955 generic.go:356] "Generic (PLEG): container finished" podID="92236588-ff47-4a13-bc40-022f0f21c77c" containerID="7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc" exitCode=0 Nov 04 05:02:16.313509 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.313344 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" Nov 04 05:02:16.313509 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.313373 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" event={"ID":"92236588-ff47-4a13-bc40-022f0f21c77c","Type":"ContainerDied","Data":"7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc"} Nov 04 05:02:16.313509 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.313414 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp" event={"ID":"92236588-ff47-4a13-bc40-022f0f21c77c","Type":"ContainerDied","Data":"1fb559b92894567952de849fb6123ab260e5a94b871a3f7d46b59ff194b3a9fe"} Nov 04 05:02:16.313509 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.313433 4955 scope.go:122] "RemoveContainer" containerID="7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc" Nov 04 05:02:16.315083 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.315063 4955 generic.go:356] "Generic (PLEG): container finished" podID="ef55c5ea-46c5-422f-851f-f85fadc9bbf1" containerID="37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0" exitCode=0 Nov 04 05:02:16.315171 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.315111 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" Nov 04 05:02:16.315171 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.315146 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" event={"ID":"ef55c5ea-46c5-422f-851f-f85fadc9bbf1","Type":"ContainerDied","Data":"37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0"} Nov 04 05:02:16.315255 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.315183 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c" event={"ID":"ef55c5ea-46c5-422f-851f-f85fadc9bbf1","Type":"ContainerDied","Data":"c163aac8eba58bf22f0f3c4a44c23ec7dc630e24b86e8adc3433892e01f330e0"} Nov 04 05:02:16.316769 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.316745 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" event={"ID":"ae9bed1d-03e7-4dd1-a553-76698a6cbadc","Type":"ContainerStarted","Data":"7fa6793d3c9e7c509c59e23e7043903fdb25a97a457d44e6f222633873d7aad0"} Nov 04 05:02:16.318408 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.318383 4955 generic.go:356] "Generic (PLEG): container finished" podID="50106aec-7c7a-4c81-beb4-9f015c566a75" containerID="de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564" exitCode=0 Nov 04 05:02:16.318513 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.318419 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" Nov 04 05:02:16.318513 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.318456 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" event={"ID":"50106aec-7c7a-4c81-beb4-9f015c566a75","Type":"ContainerDied","Data":"de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564"} Nov 04 05:02:16.318513 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.318482 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq" event={"ID":"50106aec-7c7a-4c81-beb4-9f015c566a75","Type":"ContainerDied","Data":"f80bb4659d0dbfa85cbc960383899761407b68e5f4bcffb8ceb038e10d72990e"} Nov 04 05:02:16.345761 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.345744 4955 scope.go:122] "RemoveContainer" containerID="7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc" Nov 04 05:02:16.346018 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:02:16.346000 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc\": container with ID starting with 7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc not found: ID does not exist" containerID="7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc" Nov 04 05:02:16.346059 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.346029 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc"} err="failed to get container status \"7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc\": rpc error: code = NotFound desc = could not find container \"7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc\": container with ID starting with 7e8d2c74870ac62edae77bdee9c210db568c5210569589dbed0c94329eb1a6dc not found: ID does not exist" Nov 04 05:02:16.346059 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.346046 4955 scope.go:122] "RemoveContainer" containerID="37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0" Nov 04 05:02:16.379425 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.379397 4955 scope.go:122] "RemoveContainer" containerID="37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0" Nov 04 05:02:16.380102 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:02:16.379961 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0\": container with ID starting with 37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0 not found: ID does not exist" containerID="37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0" Nov 04 05:02:16.380102 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.380002 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0"} err="failed to get container status \"37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0\": rpc error: code = NotFound desc = could not find container \"37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0\": container with ID starting with 37b24be0b4235a000c8a89c935ba8f7febeb51574efaa628b7767324d5c8ece0 not found: ID does not exist" Nov 04 05:02:16.380102 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.380028 4955 scope.go:122] "RemoveContainer" containerID="de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564" Nov 04 05:02:16.390191 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.390167 4955 scope.go:122] "RemoveContainer" containerID="de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564" Nov 04 05:02:16.390534 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:02:16.390495 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564\": container with ID starting with de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564 not found: ID does not exist" containerID="de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564" Nov 04 05:02:16.390594 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.390546 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564"} err="failed to get container status \"de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564\": rpc error: code = NotFound desc = could not find container \"de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564\": container with ID starting with de2692a57d83264362eab761d42a07e6ad5beef7b377710ce02d9107cba7c564 not found: ID does not exist" Nov 04 05:02:16.481693 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.481582 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c"] Nov 04 05:02:16.484526 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.484495 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/premium-w2-c5bb6d-kserve-866f4897b6-xfv4c"] Nov 04 05:02:16.584936 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.584903 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq"] Nov 04 05:02:16.587640 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.587611 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/simulator-w2-c5bb6d-kserve-54fd55d4dc-848cq"] Nov 04 05:02:16.688401 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.688360 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp"] Nov 04 05:02:16.692487 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:16.692460 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-c5bb6d/distinct-w2-c5bb6d-kserve-6b6bd68c45-b97mp"] Nov 04 05:02:17.079108 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:17.079080 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Nov 04 05:02:17.079416 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:17.079350 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" podUID="66f43c96-8170-4c54-aa5a-d73994cb353a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Nov 04 05:02:17.312935 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:17.312899 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" podUID="05dd3ce4-b0c6-421e-973d-8c2016346904" containerName="payload-processing" containerID="cri-o://c62476b18963b89442013632921b7c8ec60cbab8dccca29322a90662e1dc89e1" gracePeriod=25 Nov 04 05:02:17.325516 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:17.325450 4955 generic.go:356] "Generic (PLEG): container finished" podID="ae9bed1d-03e7-4dd1-a553-76698a6cbadc" containerID="2a38b93062289906b9a37b3ed185d5c901fa3828c4e9542d7a49dc78695a440c" exitCode=0 Nov 04 05:02:17.325654 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:17.325538 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" event={"ID":"ae9bed1d-03e7-4dd1-a553-76698a6cbadc","Type":"ContainerDied","Data":"2a38b93062289906b9a37b3ed185d5c901fa3828c4e9542d7a49dc78695a440c"} Nov 04 05:02:17.429399 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:17.429363 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" podUID="14682013-c33e-4cf8-9e36-6c34caa800c1" containerName="payload-pre-processing" containerID="cri-o://113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee" gracePeriod=25 Nov 04 05:02:17.678686 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:17.678599 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50106aec-7c7a-4c81-beb4-9f015c566a75" path="/var/lib/kubelet/pods/50106aec-7c7a-4c81-beb4-9f015c566a75/volumes" Nov 04 05:02:17.679328 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:17.679303 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92236588-ff47-4a13-bc40-022f0f21c77c" path="/var/lib/kubelet/pods/92236588-ff47-4a13-bc40-022f0f21c77c/volumes" Nov 04 05:02:17.679921 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:17.679900 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef55c5ea-46c5-422f-851f-f85fadc9bbf1" path="/var/lib/kubelet/pods/ef55c5ea-46c5-422f-851f-f85fadc9bbf1/volumes" Nov 04 05:02:18.078795 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:18.078747 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Nov 04 05:02:18.078964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:18.078817 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" podUID="66f43c96-8170-4c54-aa5a-d73994cb353a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Nov 04 05:02:18.512910 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:18.512880 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:18.629627 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:18.629543 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-openshift-ca\") pod \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\" (UID: \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\") " Nov 04 05:02:18.629751 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:18.629720 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-kube-api-access-zdrdd\" (UniqueName: \"kubernetes.io/projected/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-kube-api-access-zdrdd\") pod \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\" (UID: \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\") " Nov 04 05:02:18.629796 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:18.629767 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-xks-ca\") pod \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\" (UID: \"ae9bed1d-03e7-4dd1-a553-76698a6cbadc\") " Nov 04 05:02:18.630014 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:18.629964 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-openshift-ca" pod "ae9bed1d-03e7-4dd1-a553-76698a6cbadc" (UID: "ae9bed1d-03e7-4dd1-a553-76698a6cbadc"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:02:18.630165 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:18.630139 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-openshift-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:18.632125 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:18.632091 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-kube-api-access-zdrdd" pod "ae9bed1d-03e7-4dd1-a553-76698a6cbadc" (UID: "ae9bed1d-03e7-4dd1-a553-76698a6cbadc"). InnerVolumeSpecName "kube-api-access-zdrdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:18.632237 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:18.632181 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-xks-ca" pod "ae9bed1d-03e7-4dd1-a553-76698a6cbadc" (UID: "ae9bed1d-03e7-4dd1-a553-76698a6cbadc"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:02:18.731543 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:18.731510 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdrdd\" (UniqueName: \"kubernetes.io/projected/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-kube-api-access-zdrdd\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:18.731543 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:18.731539 4955 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae9bed1d-03e7-4dd1-a553-76698a6cbadc-maas-api-xks-ca\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:19.078470 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:19.078435 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Nov 04 05:02:19.078639 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:19.078486 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" podUID="66f43c96-8170-4c54-aa5a-d73994cb353a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Nov 04 05:02:19.341782 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:19.341687 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" Nov 04 05:02:19.341782 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:19.341699 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7a85b2c9-tlxph" event={"ID":"ae9bed1d-03e7-4dd1-a553-76698a6cbadc","Type":"ContainerDied","Data":"7fa6793d3c9e7c509c59e23e7043903fdb25a97a457d44e6f222633873d7aad0"} Nov 04 05:02:19.341782 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:19.341746 4955 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fa6793d3c9e7c509c59e23e7043903fdb25a97a457d44e6f222633873d7aad0" Nov 04 05:02:19.459053 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:19.459016 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf"] Nov 04 05:02:19.467444 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:19.467406 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w"] Nov 04 05:02:19.477249 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:19.475744 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh"] Nov 04 05:02:19.888221 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:19.888179 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" podUID="14682013-c33e-4cf8-9e36-6c34caa800c1" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:02:20.894537 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:20.894498 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" podUID="05dd3ce4-b0c6-421e-973d-8c2016346904" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:02:21.119470 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:21.119427 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 05:02:21.119656 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:21.119499 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" podUID="66f43c96-8170-4c54-aa5a-d73994cb353a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 05:02:21.183045 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:21.182969 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:21.183342 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:21.183311 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:21.185252 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:21.185229 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:27.237216 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.237174 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9"] Nov 04 05:02:27.237900 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.237879 4955 cpu_manager.go:414] "containerMap: removing container" podUID="92236588-ff47-4a13-bc40-022f0f21c77c" containerName="main" Nov 04 05:02:27.237985 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.237903 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92236588-ff47-4a13-bc40-022f0f21c77c" containerName="main" Nov 04 05:02:27.237985 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.237922 4955 cpu_manager.go:414] "containerMap: removing container" podUID="ef55c5ea-46c5-422f-851f-f85fadc9bbf1" containerName="main" Nov 04 05:02:27.237985 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.237930 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef55c5ea-46c5-422f-851f-f85fadc9bbf1" containerName="main" Nov 04 05:02:27.237985 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.237946 4955 cpu_manager.go:414] "containerMap: removing container" podUID="50106aec-7c7a-4c81-beb4-9f015c566a75" containerName="main" Nov 04 05:02:27.237985 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.237954 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50106aec-7c7a-4c81-beb4-9f015c566a75" containerName="main" Nov 04 05:02:27.238243 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.237995 4955 cpu_manager.go:414] "containerMap: removing container" podUID="ae9bed1d-03e7-4dd1-a553-76698a6cbadc" containerName="revoke-keys" Nov 04 05:02:27.238243 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.238003 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae9bed1d-03e7-4dd1-a553-76698a6cbadc" containerName="revoke-keys" Nov 04 05:02:27.238243 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.238131 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="92236588-ff47-4a13-bc40-022f0f21c77c" containerName="main" Nov 04 05:02:27.238243 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.238146 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae9bed1d-03e7-4dd1-a553-76698a6cbadc" containerName="revoke-keys" Nov 04 05:02:27.238243 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.238155 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef55c5ea-46c5-422f-851f-f85fadc9bbf1" containerName="main" Nov 04 05:02:27.238243 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.238166 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="50106aec-7c7a-4c81-beb4-9f015c566a75" containerName="main" Nov 04 05:02:27.241751 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.241731 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.290470 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.290436 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-204e38-openshift-default-dockercfg-ftp67\"" Nov 04 05:02:27.339374 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.339335 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9"] Nov 04 05:02:27.346425 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.346400 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-certs\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.346502 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.346440 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istiod-ca-cert\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.346502 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.346461 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-token\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.346675 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.346654 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dd24\" (UniqueName: \"kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-kube-api-access-7dd24\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.346734 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.346720 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-socket\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.346769 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.346743 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-envoy\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.346801 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.346777 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-credential-socket\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.346834 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.346825 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-podinfo\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.346867 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.346852 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-data\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.447617 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.447578 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-socket\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.447617 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.447616 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-envoy\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.447829 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.447632 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-credential-socket\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.447829 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.447655 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-podinfo\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.447829 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.447776 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-data\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.447960 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.447827 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-certs\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.447960 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.447913 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istiod-ca-cert\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.447960 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.447942 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-token\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.448095 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.448051 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-credential-socket\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.448095 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.448081 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dd24\" (UniqueName: \"kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-kube-api-access-7dd24\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.448307 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.448234 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-data\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.448307 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.448288 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-socket\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.448490 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.448351 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-certs\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.448777 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.448754 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istiod-ca-cert\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.450020 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.450002 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-envoy\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.450248 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.450231 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-podinfo\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.508128 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.508053 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-token\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.510533 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.510502 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dd24\" (UniqueName: \"kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-kube-api-access-7dd24\") pod \"e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.554997 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.554952 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:27.988166 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.988124 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9"] Nov 04 05:02:27.994277 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:02:27.994240 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b3c49c_844f_499d_bdae_d01b1e3eefe6.slice/crio-0b6bc4ed52e3ed2e009db8a2cc367f536f50a391db098c2bfc22a856d76cc34b WatchSource:0}: Error finding container 0b6bc4ed52e3ed2e009db8a2cc367f536f50a391db098c2bfc22a856d76cc34b: Status 404 returned error can't find the container with id 0b6bc4ed52e3ed2e009db8a2cc367f536f50a391db098c2bfc22a856d76cc34b Nov 04 05:02:27.996482 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.996453 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:02:27.996561 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.996513 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:02:27.996561 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:27.996546 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:02:28.191636 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:02:28.191595 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:02:28.437811 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:28.437771 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" event={"ID":"19b3c49c-844f-499d-bdae-d01b1e3eefe6","Type":"ContainerStarted","Data":"e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194"} Nov 04 05:02:28.438330 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:28.437831 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" event={"ID":"19b3c49c-844f-499d-bdae-d01b1e3eefe6","Type":"ContainerStarted","Data":"0b6bc4ed52e3ed2e009db8a2cc367f536f50a391db098c2bfc22a856d76cc34b"} Nov 04 05:02:28.563287 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:28.555485 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:28.563287 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:28.556527 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" podStartSLOduration=1.556508837 podStartE2EDuration="1.556508837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:02:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:02:28.555437073 +0000 UTC m=+999.025263216" watchObservedRunningTime="2026-11-04 05:02:28.556508837 +0000 UTC m=+999.026334976" Nov 04 05:02:29.561250 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:29.561196 4955 patch_prober.go:29] interesting pod/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 04 05:02:29.561904 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:29.561866 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" podUID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 04 05:02:29.887949 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:29.887858 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" podUID="14682013-c33e-4cf8-9e36-6c34caa800c1" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:02:30.557747 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:30.557704 4955 patch_prober.go:29] interesting pod/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 04 05:02:30.558072 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:30.558043 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" podUID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 04 05:02:30.893879 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:30.893792 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" podUID="05dd3ce4-b0c6-421e-973d-8c2016346904" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 04 05:02:31.280742 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:31.280645 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj"] Nov 04 05:02:31.578736 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:31.578696 4955 patch_prober.go:29] interesting pod/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 04 05:02:31.578933 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:31.578778 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" podUID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 04 05:02:32.571740 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:32.571697 4955 patch_prober.go:29] interesting pod/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 04 05:02:32.573168 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:32.573134 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" podUID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 04 05:02:33.575247 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:33.575206 4955 patch_prober.go:29] interesting pod/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 04 05:02:33.575854 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:33.575821 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" podUID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 04 05:02:34.488394 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.488337 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" podUID="f210ccde-8b86-463c-aa08-800670728377" containerName="main" containerID="cri-o://a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f" gracePeriod=45 Nov 04 05:02:34.502199 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.502152 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" podUID="732b58ba-fc75-486d-8bd7-445b928fe8e1" containerName="main" containerID="cri-o://41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea" gracePeriod=45 Nov 04 05:02:34.503828 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.503785 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" podUID="cb7c4acd-be17-472b-b28a-ca273c6fccc4" containerName="main" containerID="cri-o://525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c" gracePeriod=45 Nov 04 05:02:34.555694 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.555654 4955 patch_prober.go:29] interesting pod/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 04 05:02:34.555890 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.555747 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" podUID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 04 05:02:34.561603 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.561562 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" podUID="f210ccde-8b86-463c-aa08-800670728377" containerName="main" probeResult="failure" output="Get \"https://10.132.0.80:8000/ready\": dial tcp 10.132.0.80:8000: connect: connection refused" Nov 04 05:02:34.689337 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.689287 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" podUID="732b58ba-fc75-486d-8bd7-445b928fe8e1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": dial tcp 10.132.0.72:8000: connect: connection refused" Nov 04 05:02:34.866761 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.866720 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:02:34.870093 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.870071 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 05:02:34.874896 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.874875 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 05:02:34.945193 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945155 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-model-cache\") pod \"f210ccde-8b86-463c-aa08-800670728377\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " Nov 04 05:02:34.945418 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945211 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-dshm\") pod \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " Nov 04 05:02:34.945418 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945294 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-tmp-dir\") pod \"f210ccde-8b86-463c-aa08-800670728377\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " Nov 04 05:02:34.945418 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945327 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f210ccde-8b86-463c-aa08-800670728377-tls-certs\" (UniqueName: \"kubernetes.io/secret/f210ccde-8b86-463c-aa08-800670728377-tls-certs\") pod \"f210ccde-8b86-463c-aa08-800670728377\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " Nov 04 05:02:34.945418 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945383 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tmp-dir\") pod \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " Nov 04 05:02:34.945652 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945438 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tls-certs\") pod \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " Nov 04 05:02:34.945652 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945468 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-model-cache\") pod \"732b58ba-fc75-486d-8bd7-445b928fe8e1\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " Nov 04 05:02:34.945652 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945494 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-model-cache" pod "f210ccde-8b86-463c-aa08-800670728377" (UID: "f210ccde-8b86-463c-aa08-800670728377"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:34.945652 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945509 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/732b58ba-fc75-486d-8bd7-445b928fe8e1-kube-api-access-mtrnx\" (UniqueName: \"kubernetes.io/projected/732b58ba-fc75-486d-8bd7-445b928fe8e1-kube-api-access-mtrnx\") pod \"732b58ba-fc75-486d-8bd7-445b928fe8e1\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " Nov 04 05:02:34.945652 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945545 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cb7c4acd-be17-472b-b28a-ca273c6fccc4-kube-api-access-m2ksh\" (UniqueName: \"kubernetes.io/projected/cb7c4acd-be17-472b-b28a-ca273c6fccc4-kube-api-access-m2ksh\") pod \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " Nov 04 05:02:34.945652 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945579 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-dshm\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-dshm\") pod \"732b58ba-fc75-486d-8bd7-445b928fe8e1\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " Nov 04 05:02:34.945652 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945626 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-tmp-dir\") pod \"732b58ba-fc75-486d-8bd7-445b928fe8e1\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " Nov 04 05:02:34.946046 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945678 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-home\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-home\") pod \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " Nov 04 05:02:34.946046 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945690 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tmp-dir" pod "cb7c4acd-be17-472b-b28a-ca273c6fccc4" (UID: "cb7c4acd-be17-472b-b28a-ca273c6fccc4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:34.946046 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945707 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-home\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-home\") pod \"f210ccde-8b86-463c-aa08-800670728377\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " Nov 04 05:02:34.946046 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945740 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-model-cache\") pod \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\" (UID: \"cb7c4acd-be17-472b-b28a-ca273c6fccc4\") " Nov 04 05:02:34.946046 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945775 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f210ccde-8b86-463c-aa08-800670728377-kube-api-access-hq92k\" (UniqueName: \"kubernetes.io/projected/f210ccde-8b86-463c-aa08-800670728377-kube-api-access-hq92k\") pod \"f210ccde-8b86-463c-aa08-800670728377\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " Nov 04 05:02:34.946046 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945853 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-home\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-home\") pod \"732b58ba-fc75-486d-8bd7-445b928fe8e1\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " Nov 04 05:02:34.946046 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945899 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-tmp-dir" pod "f210ccde-8b86-463c-aa08-800670728377" (UID: "f210ccde-8b86-463c-aa08-800670728377"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:34.946046 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945907 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/732b58ba-fc75-486d-8bd7-445b928fe8e1-tls-certs\" (UniqueName: \"kubernetes.io/secret/732b58ba-fc75-486d-8bd7-445b928fe8e1-tls-certs\") pod \"732b58ba-fc75-486d-8bd7-445b928fe8e1\" (UID: \"732b58ba-fc75-486d-8bd7-445b928fe8e1\") " Nov 04 05:02:34.946046 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.945957 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-dshm\") pod \"f210ccde-8b86-463c-aa08-800670728377\" (UID: \"f210ccde-8b86-463c-aa08-800670728377\") " Nov 04 05:02:34.949316 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.946085 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-tmp-dir" pod "732b58ba-fc75-486d-8bd7-445b928fe8e1" (UID: "732b58ba-fc75-486d-8bd7-445b928fe8e1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:34.949316 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.946419 4955 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-tmp-dir\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:34.949316 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.946441 4955 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tmp-dir\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:34.949316 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.946452 4955 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-tmp-dir\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:34.949316 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.946464 4955 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-model-cache\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:34.949316 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.946612 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-model-cache" pod "cb7c4acd-be17-472b-b28a-ca273c6fccc4" (UID: "cb7c4acd-be17-472b-b28a-ca273c6fccc4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:34.949316 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.946833 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-home" pod "cb7c4acd-be17-472b-b28a-ca273c6fccc4" (UID: "cb7c4acd-be17-472b-b28a-ca273c6fccc4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:34.949316 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.947034 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-home" pod "f210ccde-8b86-463c-aa08-800670728377" (UID: "f210ccde-8b86-463c-aa08-800670728377"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:34.949316 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.947886 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-model-cache" pod "732b58ba-fc75-486d-8bd7-445b928fe8e1" (UID: "732b58ba-fc75-486d-8bd7-445b928fe8e1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:34.949316 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.948075 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-home" pod "732b58ba-fc75-486d-8bd7-445b928fe8e1" (UID: "732b58ba-fc75-486d-8bd7-445b928fe8e1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:34.949877 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.949482 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-dshm" pod "f210ccde-8b86-463c-aa08-800670728377" (UID: "f210ccde-8b86-463c-aa08-800670728377"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:34.949877 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.949554 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tls-certs" pod "cb7c4acd-be17-472b-b28a-ca273c6fccc4" (UID: "cb7c4acd-be17-472b-b28a-ca273c6fccc4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:02:34.949877 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.949610 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f210ccde-8b86-463c-aa08-800670728377-tls-certs" pod "f210ccde-8b86-463c-aa08-800670728377" (UID: "f210ccde-8b86-463c-aa08-800670728377"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:02:34.952299 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.950559 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-dshm" pod "cb7c4acd-be17-472b-b28a-ca273c6fccc4" (UID: "cb7c4acd-be17-472b-b28a-ca273c6fccc4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:34.952299 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.951426 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/732b58ba-fc75-486d-8bd7-445b928fe8e1-kube-api-access-mtrnx" pod "732b58ba-fc75-486d-8bd7-445b928fe8e1" (UID: "732b58ba-fc75-486d-8bd7-445b928fe8e1"). InnerVolumeSpecName "kube-api-access-mtrnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:34.952299 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.951574 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f210ccde-8b86-463c-aa08-800670728377-kube-api-access-hq92k" pod "f210ccde-8b86-463c-aa08-800670728377" (UID: "f210ccde-8b86-463c-aa08-800670728377"). InnerVolumeSpecName "kube-api-access-hq92k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:34.952711 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.952686 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/732b58ba-fc75-486d-8bd7-445b928fe8e1-tls-certs" pod "732b58ba-fc75-486d-8bd7-445b928fe8e1" (UID: "732b58ba-fc75-486d-8bd7-445b928fe8e1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:02:34.952808 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.952789 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-dshm" pod "732b58ba-fc75-486d-8bd7-445b928fe8e1" (UID: "732b58ba-fc75-486d-8bd7-445b928fe8e1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:34.953132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:34.953096 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb7c4acd-be17-472b-b28a-ca273c6fccc4-kube-api-access-m2ksh" pod "cb7c4acd-be17-472b-b28a-ca273c6fccc4" (UID: "cb7c4acd-be17-472b-b28a-ca273c6fccc4"). InnerVolumeSpecName "kube-api-access-m2ksh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:35.047964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.047873 4955 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-dshm\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.047964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.047907 4955 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f210ccde-8b86-463c-aa08-800670728377-tls-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.047964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.047917 4955 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb7c4acd-be17-472b-b28a-ca273c6fccc4-tls-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.047964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.047926 4955 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-model-cache\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.047964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.047936 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtrnx\" (UniqueName: \"kubernetes.io/projected/732b58ba-fc75-486d-8bd7-445b928fe8e1-kube-api-access-mtrnx\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.047964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.047947 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2ksh\" (UniqueName: \"kubernetes.io/projected/cb7c4acd-be17-472b-b28a-ca273c6fccc4-kube-api-access-m2ksh\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.047964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.047956 4955 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-dshm\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.047964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.047968 4955 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-home\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.048368 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.047978 4955 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-home\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.048368 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.047985 4955 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb7c4acd-be17-472b-b28a-ca273c6fccc4-model-cache\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.048368 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.047993 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq92k\" (UniqueName: \"kubernetes.io/projected/f210ccde-8b86-463c-aa08-800670728377-kube-api-access-hq92k\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.048368 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.048002 4955 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/732b58ba-fc75-486d-8bd7-445b928fe8e1-home\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.048368 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.048009 4955 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/732b58ba-fc75-486d-8bd7-445b928fe8e1-tls-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.048368 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.048017 4955 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f210ccde-8b86-463c-aa08-800670728377-dshm\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:35.513743 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.513711 4955 generic.go:356] "Generic (PLEG): container finished" podID="732b58ba-fc75-486d-8bd7-445b928fe8e1" containerID="41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea" exitCode=0 Nov 04 05:02:35.513919 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.513766 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" Nov 04 05:02:35.513919 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.513791 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" event={"ID":"732b58ba-fc75-486d-8bd7-445b928fe8e1","Type":"ContainerDied","Data":"41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea"} Nov 04 05:02:35.513919 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.513829 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w" event={"ID":"732b58ba-fc75-486d-8bd7-445b928fe8e1","Type":"ContainerDied","Data":"c2dd868681bd60e56fb9c34a4437315fcacc821aecb42271205b8cffaadce184"} Nov 04 05:02:35.513919 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.513847 4955 scope.go:122] "RemoveContainer" containerID="41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea" Nov 04 05:02:35.515550 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.515528 4955 generic.go:356] "Generic (PLEG): container finished" podID="cb7c4acd-be17-472b-b28a-ca273c6fccc4" containerID="525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c" exitCode=0 Nov 04 05:02:35.515693 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.515583 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" event={"ID":"cb7c4acd-be17-472b-b28a-ca273c6fccc4","Type":"ContainerDied","Data":"525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c"} Nov 04 05:02:35.515693 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.515589 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" Nov 04 05:02:35.515693 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.515616 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh" event={"ID":"cb7c4acd-be17-472b-b28a-ca273c6fccc4","Type":"ContainerDied","Data":"4c6a57818f779e4fa549a43f4cfae0caeac3aeb87f44d3370bdd3685cc66dda8"} Nov 04 05:02:35.517520 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.517491 4955 generic.go:356] "Generic (PLEG): container finished" podID="f210ccde-8b86-463c-aa08-800670728377" containerID="a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f" exitCode=0 Nov 04 05:02:35.517624 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.517530 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" event={"ID":"f210ccde-8b86-463c-aa08-800670728377","Type":"ContainerDied","Data":"a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f"} Nov 04 05:02:35.517624 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.517551 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" event={"ID":"f210ccde-8b86-463c-aa08-800670728377","Type":"ContainerDied","Data":"6f044e660912bee88f3a362f002196ea85d9234c77c4f9cd66a3546d68bbfba4"} Nov 04 05:02:35.517624 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.517598 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf" Nov 04 05:02:35.526919 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.526894 4955 scope.go:122] "RemoveContainer" containerID="41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea" Nov 04 05:02:35.527583 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:02:35.527552 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea\": container with ID starting with 41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea not found: ID does not exist" containerID="41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea" Nov 04 05:02:35.527682 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.527595 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea"} err="failed to get container status \"41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea\": rpc error: code = NotFound desc = could not find container \"41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea\": container with ID starting with 41c617496108001a3bf93bbb529a58ad189a88e62c6f2882f99f4d875d1c67ea not found: ID does not exist" Nov 04 05:02:35.527682 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.527621 4955 scope.go:122] "RemoveContainer" containerID="525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c" Nov 04 05:02:35.537122 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.537100 4955 scope.go:122] "RemoveContainer" containerID="525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c" Nov 04 05:02:35.537500 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:02:35.537479 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c\": container with ID starting with 525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c not found: ID does not exist" containerID="525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c" Nov 04 05:02:35.537590 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.537510 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c"} err="failed to get container status \"525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c\": rpc error: code = NotFound desc = could not find container \"525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c\": container with ID starting with 525da61c81f53886915853440bcde5d585191355ae4f5d3fe6d617133ae7f14c not found: ID does not exist" Nov 04 05:02:35.537590 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.537526 4955 scope.go:122] "RemoveContainer" containerID="a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f" Nov 04 05:02:35.546851 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.546823 4955 scope.go:122] "RemoveContainer" containerID="a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f" Nov 04 05:02:35.547251 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:02:35.547225 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f\": container with ID starting with a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f not found: ID does not exist" containerID="a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f" Nov 04 05:02:35.547403 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.547291 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f"} err="failed to get container status \"a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f\": rpc error: code = NotFound desc = could not find container \"a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f\": container with ID starting with a85f17112bdb4c624dbe434c86795bcaaaaec27fb31f974c52b478d0843aa44f not found: ID does not exist" Nov 04 05:02:35.667983 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.667951 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh"] Nov 04 05:02:35.713932 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.713894 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/simulator-w3-204e38-kserve-6c9ff77cc6-q8mnh"] Nov 04 05:02:35.773900 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.773812 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf"] Nov 04 05:02:35.778240 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.778210 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/distinct-w3-204e38-kserve-584895fd48-v8kxf"] Nov 04 05:02:35.882094 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.882045 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w"] Nov 04 05:02:35.886647 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:35.886613 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-204e38/premium-w3-204e38-kserve-c87948dd5-jmh7w"] Nov 04 05:02:36.282007 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.281950 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" podUID="28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6" containerName="payload-pre-processing" containerID="cri-o://ee423e468e16c520bfd0b05ce65f63ae1a07bb739883451daa8945f8334a6465" gracePeriod=25 Nov 04 05:02:36.529674 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.529644 4955 generic.go:356] "Generic (PLEG): container finished" podID="28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6" containerID="ee423e468e16c520bfd0b05ce65f63ae1a07bb739883451daa8945f8334a6465" exitCode=0 Nov 04 05:02:36.529923 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.529727 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" event={"ID":"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6","Type":"ContainerDied","Data":"ee423e468e16c520bfd0b05ce65f63ae1a07bb739883451daa8945f8334a6465"} Nov 04 05:02:36.568830 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.568803 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" Nov 04 05:02:36.596543 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.596493 4955 patch_prober.go:29] interesting pod/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 05:02:36.596740 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.596571 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" podUID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 05:02:36.665792 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.665732 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-kube-api-access-7tbbk\" (UniqueName: \"kubernetes.io/projected/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-kube-api-access-7tbbk\") pod \"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6\" (UID: \"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6\") " Nov 04 05:02:36.666081 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.665838 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-plugins-config-volume\") pod \"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6\" (UID: \"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6\") " Nov 04 05:02:36.667026 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.666963 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-plugins-config-volume" pod "28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6" (UID: "28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:02:36.668574 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.668538 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-kube-api-access-7tbbk" pod "28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6" (UID: "28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6"). InnerVolumeSpecName "kube-api-access-7tbbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:36.767420 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.767381 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tbbk\" (UniqueName: \"kubernetes.io/projected/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-kube-api-access-7tbbk\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:36.767420 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.767419 4955 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6-plugins-config-volume\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:36.779482 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.779443 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:36.779895 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.779825 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:36.781999 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:36.781969 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:02:37.542469 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.542434 4955 generic.go:356] "Generic (PLEG): container finished" podID="05dd3ce4-b0c6-421e-973d-8c2016346904" containerID="c62476b18963b89442013632921b7c8ec60cbab8dccca29322a90662e1dc89e1" exitCode=0 Nov 04 05:02:37.542587 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.542501 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" event={"ID":"05dd3ce4-b0c6-421e-973d-8c2016346904","Type":"ContainerDied","Data":"c62476b18963b89442013632921b7c8ec60cbab8dccca29322a90662e1dc89e1"} Nov 04 05:02:37.544478 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.544460 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" Nov 04 05:02:37.544769 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.544749 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj" event={"ID":"28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6","Type":"ContainerDied","Data":"e7b2b5b970b7419ccbd58c0864fa5b79de7e0ce56e114254f47929459ae1518c"} Nov 04 05:02:37.544859 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.544799 4955 scope.go:122] "RemoveContainer" containerID="ee423e468e16c520bfd0b05ce65f63ae1a07bb739883451daa8945f8334a6465" Nov 04 05:02:37.609683 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.609593 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" Nov 04 05:02:37.669893 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.669824 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="732b58ba-fc75-486d-8bd7-445b928fe8e1" path="/var/lib/kubelet/pods/732b58ba-fc75-486d-8bd7-445b928fe8e1/volumes" Nov 04 05:02:37.670574 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.670550 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cb7c4acd-be17-472b-b28a-ca273c6fccc4" path="/var/lib/kubelet/pods/cb7c4acd-be17-472b-b28a-ca273c6fccc4/volumes" Nov 04 05:02:37.671007 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.670979 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f210ccde-8b86-463c-aa08-800670728377" path="/var/lib/kubelet/pods/f210ccde-8b86-463c-aa08-800670728377/volumes" Nov 04 05:02:37.684670 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.684639 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05dd3ce4-b0c6-421e-973d-8c2016346904-kube-api-access-gscnh\" (UniqueName: \"kubernetes.io/projected/05dd3ce4-b0c6-421e-973d-8c2016346904-kube-api-access-gscnh\") pod \"05dd3ce4-b0c6-421e-973d-8c2016346904\" (UID: \"05dd3ce4-b0c6-421e-973d-8c2016346904\") " Nov 04 05:02:37.685616 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.685577 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05dd3ce4-b0c6-421e-973d-8c2016346904-plugins-config-volume" pod "05dd3ce4-b0c6-421e-973d-8c2016346904" (UID: "05dd3ce4-b0c6-421e-973d-8c2016346904"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:02:37.685787 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.685256 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05dd3ce4-b0c6-421e-973d-8c2016346904-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05dd3ce4-b0c6-421e-973d-8c2016346904-plugins-config-volume\") pod \"05dd3ce4-b0c6-421e-973d-8c2016346904\" (UID: \"05dd3ce4-b0c6-421e-973d-8c2016346904\") " Nov 04 05:02:37.686420 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.686402 4955 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05dd3ce4-b0c6-421e-973d-8c2016346904-plugins-config-volume\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:37.687500 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.687479 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05dd3ce4-b0c6-421e-973d-8c2016346904-kube-api-access-gscnh" pod "05dd3ce4-b0c6-421e-973d-8c2016346904" (UID: "05dd3ce4-b0c6-421e-973d-8c2016346904"). InnerVolumeSpecName "kube-api-access-gscnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:37.702543 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.702508 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj"] Nov 04 05:02:37.706513 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.706489 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-204e38-68998d8559-nwnfj"] Nov 04 05:02:37.743614 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.743593 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" Nov 04 05:02:37.788174 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.788136 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14682013-c33e-4cf8-9e36-6c34caa800c1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14682013-c33e-4cf8-9e36-6c34caa800c1-plugins-config-volume\") pod \"14682013-c33e-4cf8-9e36-6c34caa800c1\" (UID: \"14682013-c33e-4cf8-9e36-6c34caa800c1\") " Nov 04 05:02:37.788710 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.788250 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14682013-c33e-4cf8-9e36-6c34caa800c1-kube-api-access-kj8s9\" (UniqueName: \"kubernetes.io/projected/14682013-c33e-4cf8-9e36-6c34caa800c1-kube-api-access-kj8s9\") pod \"14682013-c33e-4cf8-9e36-6c34caa800c1\" (UID: \"14682013-c33e-4cf8-9e36-6c34caa800c1\") " Nov 04 05:02:37.788710 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.788603 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gscnh\" (UniqueName: \"kubernetes.io/projected/05dd3ce4-b0c6-421e-973d-8c2016346904-kube-api-access-gscnh\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:37.789373 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.789329 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14682013-c33e-4cf8-9e36-6c34caa800c1-plugins-config-volume" pod "14682013-c33e-4cf8-9e36-6c34caa800c1" (UID: "14682013-c33e-4cf8-9e36-6c34caa800c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:02:37.791456 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.791420 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14682013-c33e-4cf8-9e36-6c34caa800c1-kube-api-access-kj8s9" pod "14682013-c33e-4cf8-9e36-6c34caa800c1" (UID: "14682013-c33e-4cf8-9e36-6c34caa800c1"). InnerVolumeSpecName "kube-api-access-kj8s9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:37.890013 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.889927 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj8s9\" (UniqueName: \"kubernetes.io/projected/14682013-c33e-4cf8-9e36-6c34caa800c1-kube-api-access-kj8s9\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:37.890013 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:37.889959 4955 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14682013-c33e-4cf8-9e36-6c34caa800c1-plugins-config-volume\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:38.554322 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.554294 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" Nov 04 05:02:38.554322 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.554303 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6" event={"ID":"05dd3ce4-b0c6-421e-973d-8c2016346904","Type":"ContainerDied","Data":"74dfe1705aab7aff04bed521a2ac36fdcf362e686a4ce59f47f6eae30ec3dc83"} Nov 04 05:02:38.554540 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.554372 4955 scope.go:122] "RemoveContainer" containerID="c62476b18963b89442013632921b7c8ec60cbab8dccca29322a90662e1dc89e1" Nov 04 05:02:38.556180 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.556153 4955 generic.go:356] "Generic (PLEG): container finished" podID="14682013-c33e-4cf8-9e36-6c34caa800c1" containerID="113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee" exitCode=0 Nov 04 05:02:38.556319 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.556203 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" Nov 04 05:02:38.556319 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.556250 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" event={"ID":"14682013-c33e-4cf8-9e36-6c34caa800c1","Type":"ContainerDied","Data":"113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee"} Nov 04 05:02:38.556453 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.556322 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l" event={"ID":"14682013-c33e-4cf8-9e36-6c34caa800c1","Type":"ContainerDied","Data":"135ebd0d07ca4cad76b43e05a7af9a6cfc164664f43f71d987886f76dbc387c1"} Nov 04 05:02:38.565289 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.565272 4955 scope.go:122] "RemoveContainer" containerID="113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee" Nov 04 05:02:38.575405 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.575379 4955 scope.go:122] "RemoveContainer" containerID="113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee" Nov 04 05:02:38.575747 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:02:38.575725 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee\": container with ID starting with 113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee not found: ID does not exist" containerID="113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee" Nov 04 05:02:38.575797 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.575757 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee"} err="failed to get container status \"113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee\": rpc error: code = NotFound desc = could not find container \"113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee\": container with ID starting with 113b70e10848878a6ba91d693a4d58688efe1d8bd4d768c046088b5171c287ee not found: ID does not exist" Nov 04 05:02:38.708134 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.708105 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6"] Nov 04 05:02:38.754137 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.754102 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-c5bb6d-6784dff9c8-kllx6"] Nov 04 05:02:38.813117 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.813081 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l"] Nov 04 05:02:38.815616 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:38.815592 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-c5bb6d-7dfd74784c-w2f9l"] Nov 04 05:02:39.654319 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:39.654286 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="05dd3ce4-b0c6-421e-973d-8c2016346904" path="/var/lib/kubelet/pods/05dd3ce4-b0c6-421e-973d-8c2016346904/volumes" Nov 04 05:02:39.654695 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:39.654682 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14682013-c33e-4cf8-9e36-6c34caa800c1" path="/var/lib/kubelet/pods/14682013-c33e-4cf8-9e36-6c34caa800c1/volumes" Nov 04 05:02:39.655017 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:39.655006 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6" path="/var/lib/kubelet/pods/28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6/volumes" Nov 04 05:02:45.151763 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:45.151734 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc"] Nov 04 05:02:45.152169 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:45.151947 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" podUID="66f43c96-8170-4c54-aa5a-d73994cb353a" containerName="istio-proxy" containerID="cri-o://6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea" gracePeriod=30 Nov 04 05:02:45.162128 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:45.162097 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj"] Nov 04 05:02:45.162365 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:45.162318 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" podUID="27d6755b-919a-4c3d-8f3d-673d8292ce05" containerName="istio-proxy" containerID="cri-o://70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4" gracePeriod=30 Nov 04 05:02:47.678678 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:47.678639 4955 patch_prober.go:29] interesting pod/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 05:02:47.679139 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:47.678709 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" podUID="27d6755b-919a-4c3d-8f3d-673d8292ce05" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 05:02:50.126880 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.126795 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz"] Nov 04 05:02:50.173232 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.173202 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9"] Nov 04 05:02:50.422244 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.422210 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:50.459797 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.459760 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 05:02:50.523311 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.523274 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-credential-socket\") pod \"66f43c96-8170-4c54-aa5a-d73994cb353a\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " Nov 04 05:02:50.523476 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.523318 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-podinfo\") pod \"66f43c96-8170-4c54-aa5a-d73994cb353a\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " Nov 04 05:02:50.523476 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.523357 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-data\") pod \"66f43c96-8170-4c54-aa5a-d73994cb353a\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " Nov 04 05:02:50.523476 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.523405 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-envoy\") pod \"66f43c96-8170-4c54-aa5a-d73994cb353a\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " Nov 04 05:02:50.523476 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.523427 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-certs\") pod \"66f43c96-8170-4c54-aa5a-d73994cb353a\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " Nov 04 05:02:50.523476 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.523462 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-socket\") pod \"66f43c96-8170-4c54-aa5a-d73994cb353a\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " Nov 04 05:02:50.523716 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.523481 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66f43c96-8170-4c54-aa5a-d73994cb353a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f43c96-8170-4c54-aa5a-d73994cb353a-istiod-ca-cert\") pod \"66f43c96-8170-4c54-aa5a-d73994cb353a\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " Nov 04 05:02:50.523716 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.523536 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-kube-api-access-xjpqs\" (UniqueName: \"kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-kube-api-access-xjpqs\") pod \"66f43c96-8170-4c54-aa5a-d73994cb353a\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " Nov 04 05:02:50.523716 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.523550 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-credential-socket" pod "66f43c96-8170-4c54-aa5a-d73994cb353a" (UID: "66f43c96-8170-4c54-aa5a-d73994cb353a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:50.523716 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.523563 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-token\" (UniqueName: \"kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-token\") pod \"66f43c96-8170-4c54-aa5a-d73994cb353a\" (UID: \"66f43c96-8170-4c54-aa5a-d73994cb353a\") " Nov 04 05:02:50.523884 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.523800 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-certs" pod "66f43c96-8170-4c54-aa5a-d73994cb353a" (UID: "66f43c96-8170-4c54-aa5a-d73994cb353a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:50.523884 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.523816 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-socket" pod "66f43c96-8170-4c54-aa5a-d73994cb353a" (UID: "66f43c96-8170-4c54-aa5a-d73994cb353a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:50.524075 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.524045 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66f43c96-8170-4c54-aa5a-d73994cb353a-istiod-ca-cert" pod "66f43c96-8170-4c54-aa5a-d73994cb353a" (UID: "66f43c96-8170-4c54-aa5a-d73994cb353a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:02:50.524139 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.524108 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-data" pod "66f43c96-8170-4c54-aa5a-d73994cb353a" (UID: "66f43c96-8170-4c54-aa5a-d73994cb353a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:50.524139 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.524119 4955 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.524218 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.524140 4955 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-credential-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.524218 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.524156 4955 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-workload-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.525762 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.525737 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-token" pod "66f43c96-8170-4c54-aa5a-d73994cb353a" (UID: "66f43c96-8170-4c54-aa5a-d73994cb353a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:50.525762 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.525745 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-envoy" pod "66f43c96-8170-4c54-aa5a-d73994cb353a" (UID: "66f43c96-8170-4c54-aa5a-d73994cb353a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:50.526012 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.525999 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-podinfo" pod "66f43c96-8170-4c54-aa5a-d73994cb353a" (UID: "66f43c96-8170-4c54-aa5a-d73994cb353a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:02:50.526054 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.526026 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-kube-api-access-xjpqs" pod "66f43c96-8170-4c54-aa5a-d73994cb353a" (UID: "66f43c96-8170-4c54-aa5a-d73994cb353a"). InnerVolumeSpecName "kube-api-access-xjpqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:50.624550 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.624515 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-kube-api-access-kr7m2\" (UniqueName: \"kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-kube-api-access-kr7m2\") pod \"27d6755b-919a-4c3d-8f3d-673d8292ce05\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " Nov 04 05:02:50.624550 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.624558 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-certs\") pod \"27d6755b-919a-4c3d-8f3d-673d8292ce05\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " Nov 04 05:02:50.624802 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.624577 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-podinfo\") pod \"27d6755b-919a-4c3d-8f3d-673d8292ce05\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " Nov 04 05:02:50.624802 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.624612 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-credential-socket\") pod \"27d6755b-919a-4c3d-8f3d-673d8292ce05\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " Nov 04 05:02:50.624802 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.624659 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/27d6755b-919a-4c3d-8f3d-673d8292ce05-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27d6755b-919a-4c3d-8f3d-673d8292ce05-istiod-ca-cert\") pod \"27d6755b-919a-4c3d-8f3d-673d8292ce05\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " Nov 04 05:02:50.624802 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.624731 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-data\") pod \"27d6755b-919a-4c3d-8f3d-673d8292ce05\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " Nov 04 05:02:50.624802 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.624777 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-socket\") pod \"27d6755b-919a-4c3d-8f3d-673d8292ce05\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " Nov 04 05:02:50.625052 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.624849 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-envoy\") pod \"27d6755b-919a-4c3d-8f3d-673d8292ce05\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " Nov 04 05:02:50.625052 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.624907 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-token\" (UniqueName: \"kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-token\") pod \"27d6755b-919a-4c3d-8f3d-673d8292ce05\" (UID: \"27d6755b-919a-4c3d-8f3d-673d8292ce05\") " Nov 04 05:02:50.625724 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.625192 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-socket" pod "27d6755b-919a-4c3d-8f3d-673d8292ce05" (UID: "27d6755b-919a-4c3d-8f3d-673d8292ce05"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:50.625724 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.625201 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-data" pod "27d6755b-919a-4c3d-8f3d-673d8292ce05" (UID: "27d6755b-919a-4c3d-8f3d-673d8292ce05"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:50.625724 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.625338 4955 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.625724 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.625352 4955 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-podinfo\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.625724 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.625366 4955 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-data\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.625724 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.625380 4955 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-envoy\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.625724 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.625394 4955 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f43c96-8170-4c54-aa5a-d73994cb353a-istiod-ca-cert\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.625724 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.625408 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjpqs\" (UniqueName: \"kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-kube-api-access-xjpqs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.625724 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.625423 4955 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66f43c96-8170-4c54-aa5a-d73994cb353a-istio-token\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.625724 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.625560 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-credential-socket" pod "27d6755b-919a-4c3d-8f3d-673d8292ce05" (UID: "27d6755b-919a-4c3d-8f3d-673d8292ce05"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:50.625724 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.625667 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-certs" pod "27d6755b-919a-4c3d-8f3d-673d8292ce05" (UID: "27d6755b-919a-4c3d-8f3d-673d8292ce05"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:50.626401 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.625869 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d6755b-919a-4c3d-8f3d-673d8292ce05-istiod-ca-cert" pod "27d6755b-919a-4c3d-8f3d-673d8292ce05" (UID: "27d6755b-919a-4c3d-8f3d-673d8292ce05"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:02:50.627464 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.627435 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-podinfo" pod "27d6755b-919a-4c3d-8f3d-673d8292ce05" (UID: "27d6755b-919a-4c3d-8f3d-673d8292ce05"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:02:50.627558 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.627495 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-token" pod "27d6755b-919a-4c3d-8f3d-673d8292ce05" (UID: "27d6755b-919a-4c3d-8f3d-673d8292ce05"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:50.627748 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.627729 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-envoy" pod "27d6755b-919a-4c3d-8f3d-673d8292ce05" (UID: "27d6755b-919a-4c3d-8f3d-673d8292ce05"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:02:50.627933 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.627913 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-kube-api-access-kr7m2" pod "27d6755b-919a-4c3d-8f3d-673d8292ce05" (UID: "27d6755b-919a-4c3d-8f3d-673d8292ce05"). InnerVolumeSpecName "kube-api-access-kr7m2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:02:50.630648 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.630594 4955 generic.go:356] "Generic (PLEG): container finished" podID="66f43c96-8170-4c54-aa5a-d73994cb353a" containerID="6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea" exitCode=0 Nov 04 05:02:50.630648 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.630638 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" Nov 04 05:02:50.630812 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.630674 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" event={"ID":"66f43c96-8170-4c54-aa5a-d73994cb353a","Type":"ContainerDied","Data":"6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea"} Nov 04 05:02:50.630812 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.630731 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc" event={"ID":"66f43c96-8170-4c54-aa5a-d73994cb353a","Type":"ContainerDied","Data":"24db9341e67b21c50bad564936421f6139efa4bcf55c3d3b0d5913cf5167b652"} Nov 04 05:02:50.630812 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.630767 4955 scope.go:122] "RemoveContainer" containerID="6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea" Nov 04 05:02:50.632199 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.632173 4955 generic.go:356] "Generic (PLEG): container finished" podID="27d6755b-919a-4c3d-8f3d-673d8292ce05" containerID="70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4" exitCode=0 Nov 04 05:02:50.632518 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.632222 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" Nov 04 05:02:50.632518 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.632383 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" event={"ID":"27d6755b-919a-4c3d-8f3d-673d8292ce05","Type":"ContainerDied","Data":"70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4"} Nov 04 05:02:50.632518 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.632433 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj" event={"ID":"27d6755b-919a-4c3d-8f3d-673d8292ce05","Type":"ContainerDied","Data":"bce88299dd696b382471f5cb0287e496b8ae504062cb2e007116a52b760f1296"} Nov 04 05:02:50.641600 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.641581 4955 scope.go:122] "RemoveContainer" containerID="6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea" Nov 04 05:02:50.641936 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:02:50.641919 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea\": container with ID starting with 6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea not found: ID does not exist" containerID="6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea" Nov 04 05:02:50.641996 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.641943 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea"} err="failed to get container status \"6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea\": rpc error: code = NotFound desc = could not find container \"6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea\": container with ID starting with 6e0fde70b55389b7a8437ff6c803658730190295e5ed7c7d22ab5e05bcba21ea not found: ID does not exist" Nov 04 05:02:50.641996 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.641959 4955 scope.go:122] "RemoveContainer" containerID="70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4" Nov 04 05:02:50.652025 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.652000 4955 scope.go:122] "RemoveContainer" containerID="70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4" Nov 04 05:02:50.652349 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:02:50.652328 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4\": container with ID starting with 70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4 not found: ID does not exist" containerID="70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4" Nov 04 05:02:50.652435 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.652360 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4"} err="failed to get container status \"70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4\": rpc error: code = NotFound desc = could not find container \"70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4\": container with ID starting with 70efb74675d0501ac61acad2069adc16c9dc9a0237b184ea3a9e3897d45967d4 not found: ID does not exist" Nov 04 05:02:50.726795 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.726749 4955 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-envoy\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.726795 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.726792 4955 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-token\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.726795 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.726804 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr7m2\" (UniqueName: \"kubernetes.io/projected/27d6755b-919a-4c3d-8f3d-673d8292ce05-kube-api-access-kr7m2\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.727033 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.726814 4955 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-workload-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.727033 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.726827 4955 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-podinfo\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.727033 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.726841 4955 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-credential-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.727033 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.726849 4955 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27d6755b-919a-4c3d-8f3d-673d8292ce05-istiod-ca-cert\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.727033 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.726858 4955 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27d6755b-919a-4c3d-8f3d-673d8292ce05-istio-data\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:02:50.750520 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.750484 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj"] Nov 04 05:02:50.755033 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.755006 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-g8fkj"] Nov 04 05:02:50.856807 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.856776 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc"] Nov 04 05:02:50.867158 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:50.862255 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-c5bb6d-openshift-default-64f56dfd77-nsxcc"] Nov 04 05:02:51.654380 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:51.654344 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="27d6755b-919a-4c3d-8f3d-673d8292ce05" path="/var/lib/kubelet/pods/27d6755b-919a-4c3d-8f3d-673d8292ce05/volumes" Nov 04 05:02:51.654973 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:51.654950 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66f43c96-8170-4c54-aa5a-d73994cb353a" path="/var/lib/kubelet/pods/66f43c96-8170-4c54-aa5a-d73994cb353a/volumes" Nov 04 05:02:56.918894 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.918855 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz"] Nov 04 05:02:56.919511 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919494 4955 cpu_manager.go:414] "containerMap: removing container" podUID="14682013-c33e-4cf8-9e36-6c34caa800c1" containerName="payload-pre-processing" Nov 04 05:02:56.919511 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919513 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14682013-c33e-4cf8-9e36-6c34caa800c1" containerName="payload-pre-processing" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919538 4955 cpu_manager.go:414] "containerMap: removing container" podUID="732b58ba-fc75-486d-8bd7-445b928fe8e1" containerName="main" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919546 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="732b58ba-fc75-486d-8bd7-445b928fe8e1" containerName="main" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919572 4955 cpu_manager.go:414] "containerMap: removing container" podUID="28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6" containerName="payload-pre-processing" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919579 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6" containerName="payload-pre-processing" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919590 4955 cpu_manager.go:414] "containerMap: removing container" podUID="27d6755b-919a-4c3d-8f3d-673d8292ce05" containerName="istio-proxy" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919597 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="27d6755b-919a-4c3d-8f3d-673d8292ce05" containerName="istio-proxy" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919617 4955 cpu_manager.go:414] "containerMap: removing container" podUID="05dd3ce4-b0c6-421e-973d-8c2016346904" containerName="payload-processing" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919624 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05dd3ce4-b0c6-421e-973d-8c2016346904" containerName="payload-processing" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919645 4955 cpu_manager.go:414] "containerMap: removing container" podUID="cb7c4acd-be17-472b-b28a-ca273c6fccc4" containerName="main" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919652 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cb7c4acd-be17-472b-b28a-ca273c6fccc4" containerName="main" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919667 4955 cpu_manager.go:414] "containerMap: removing container" podUID="f210ccde-8b86-463c-aa08-800670728377" containerName="main" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919680 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f210ccde-8b86-463c-aa08-800670728377" containerName="main" Nov 04 05:02:56.919684 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919689 4955 cpu_manager.go:414] "containerMap: removing container" podUID="66f43c96-8170-4c54-aa5a-d73994cb353a" containerName="istio-proxy" Nov 04 05:02:56.920131 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919696 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66f43c96-8170-4c54-aa5a-d73994cb353a" containerName="istio-proxy" Nov 04 05:02:56.920131 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919830 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="66f43c96-8170-4c54-aa5a-d73994cb353a" containerName="istio-proxy" Nov 04 05:02:56.920131 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919845 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="f210ccde-8b86-463c-aa08-800670728377" containerName="main" Nov 04 05:02:56.920131 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919861 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="14682013-c33e-4cf8-9e36-6c34caa800c1" containerName="payload-pre-processing" Nov 04 05:02:56.920131 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919870 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="28a0ad64-4dd9-4f9f-b8ab-fb647be8fec6" containerName="payload-pre-processing" Nov 04 05:02:56.920131 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919880 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="27d6755b-919a-4c3d-8f3d-673d8292ce05" containerName="istio-proxy" Nov 04 05:02:56.920131 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919890 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="05dd3ce4-b0c6-421e-973d-8c2016346904" containerName="payload-processing" Nov 04 05:02:56.920131 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919901 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="cb7c4acd-be17-472b-b28a-ca273c6fccc4" containerName="main" Nov 04 05:02:56.920131 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.919909 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="732b58ba-fc75-486d-8bd7-445b928fe8e1" containerName="main" Nov 04 05:02:56.925140 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:56.925121 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.023146 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.023109 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz"] Nov 04 05:02:57.092446 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.092365 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-podinfo\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.092619 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.092459 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rcvq\" (UniqueName: \"kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-kube-api-access-7rcvq\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.092619 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.092482 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-certs\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.092619 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.092499 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.092727 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.092628 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-credential-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.092727 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.092663 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istiod-ca-cert\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.092784 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.092754 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-token\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.092784 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.092777 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-data\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.092847 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.092796 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-envoy\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.193831 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.193745 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-podinfo\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.193831 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.193796 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rcvq\" (UniqueName: \"kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-kube-api-access-7rcvq\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.194039 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.193832 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-certs\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.194039 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.193858 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.194039 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.193940 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-credential-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.194039 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.193974 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istiod-ca-cert\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.194039 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.194029 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-token\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.194310 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.194063 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-data\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.194310 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.194300 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-envoy\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.194423 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.194401 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-certs\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.194475 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.194434 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.194539 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.194470 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-data\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.194641 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.194616 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-credential-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.194799 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.194779 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istiod-ca-cert\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.196309 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.196280 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-podinfo\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.196426 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.196347 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-envoy\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.250947 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.250911 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-token\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.251716 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.251692 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rcvq\" (UniqueName: \"kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-kube-api-access-7rcvq\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.538562 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.538470 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:57.989693 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.989654 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz"] Nov 04 05:02:57.995538 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:02:57.995504 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1fcf66_5ccb_45f7_b555_bc9879f088aa.slice/crio-655e797d39a43a91d21e71cf27462c30f27bce50e5be6eafae243c62053e8170 WatchSource:0}: Error finding container 655e797d39a43a91d21e71cf27462c30f27bce50e5be6eafae243c62053e8170: Status 404 returned error can't find the container with id 655e797d39a43a91d21e71cf27462c30f27bce50e5be6eafae243c62053e8170 Nov 04 05:02:57.997705 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.997676 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:02:57.997775 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.997740 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:02:57.997775 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:57.997768 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:02:58.191148 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:02:58.191102 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:02:58.686078 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:58.686043 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" event={"ID":"9a1fcf66-5ccb-45f7-b555-bc9879f088aa","Type":"ContainerStarted","Data":"f7137004cb03a20b93840414d3e963824fdb3894ea5573d2dddce888d01ea50a"} Nov 04 05:02:58.686289 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:58.686099 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" event={"ID":"9a1fcf66-5ccb-45f7-b555-bc9879f088aa","Type":"ContainerStarted","Data":"655e797d39a43a91d21e71cf27462c30f27bce50e5be6eafae243c62053e8170"} Nov 04 05:02:58.891702 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:58.891597 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" podStartSLOduration=2.891579493 podStartE2EDuration="2.891579493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:02:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:02:58.84364499 +0000 UTC m=+1029.313471130" watchObservedRunningTime="2026-11-04 05:02:58.891579493 +0000 UTC m=+1029.361405632" Nov 04 05:02:59.538878 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:59.538848 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:02:59.540732 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:59.540702 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 04 05:02:59.540885 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:02:59.540750 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 04 05:03:00.538917 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:00.538880 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 04 05:03:00.539356 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:00.538933 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 04 05:03:00.894465 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:00.894431 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9"] Nov 04 05:03:00.894685 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:00.894631 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" podUID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" containerName="istio-proxy" containerID="cri-o://e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194" gracePeriod=30 Nov 04 05:03:01.539657 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:01.539611 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 04 05:03:01.540067 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:01.539679 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 04 05:03:02.539231 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:02.539198 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 04 05:03:02.539416 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:02.539281 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 04 05:03:03.149516 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:03.149482 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6"] Nov 04 05:03:03.283976 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:03.283935 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg"] Nov 04 05:03:03.539254 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:03.539169 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 04 05:03:03.539254 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:03.539228 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 04 05:03:04.539064 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:04.539023 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 04 05:03:04.539476 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:04.539085 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 04 05:03:05.146966 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.146900 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" podUID="14fa9f1c-5b3e-4364-a533-001d9c32e6b0" containerName="main" containerID="cri-o://5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd" gracePeriod=45 Nov 04 05:03:05.193687 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.193646 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" podUID="26762e2a-611d-4269-8014-aa397641e47c" containerName="main" containerID="cri-o://460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91" gracePeriod=45 Nov 04 05:03:05.505574 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.505547 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 05:03:05.522433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.522405 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 05:03:05.589906 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.589873 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-home\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-home\") pod \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " Nov 04 05:03:05.590433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.589917 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-model-cache\") pod \"26762e2a-611d-4269-8014-aa397641e47c\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " Nov 04 05:03:05.590433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.589976 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/26762e2a-611d-4269-8014-aa397641e47c-tls-certs\" (UniqueName: \"kubernetes.io/secret/26762e2a-611d-4269-8014-aa397641e47c-tls-certs\") pod \"26762e2a-611d-4269-8014-aa397641e47c\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " Nov 04 05:03:05.590433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590008 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tls-certs\" (UniqueName: \"kubernetes.io/secret/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tls-certs\") pod \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " Nov 04 05:03:05.590433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590036 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-tmp-dir\") pod \"26762e2a-611d-4269-8014-aa397641e47c\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " Nov 04 05:03:05.590433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590230 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-home" pod "14fa9f1c-5b3e-4364-a533-001d9c32e6b0" (UID: "14fa9f1c-5b3e-4364-a533-001d9c32e6b0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:05.590433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590302 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-home\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-home\") pod \"26762e2a-611d-4269-8014-aa397641e47c\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " Nov 04 05:03:05.590433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590340 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/26762e2a-611d-4269-8014-aa397641e47c-kube-api-access-dshlt\" (UniqueName: \"kubernetes.io/projected/26762e2a-611d-4269-8014-aa397641e47c-kube-api-access-dshlt\") pod \"26762e2a-611d-4269-8014-aa397641e47c\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " Nov 04 05:03:05.590433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590382 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-dshm\") pod \"26762e2a-611d-4269-8014-aa397641e47c\" (UID: \"26762e2a-611d-4269-8014-aa397641e47c\") " Nov 04 05:03:05.590433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590299 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-tmp-dir" pod "26762e2a-611d-4269-8014-aa397641e47c" (UID: "26762e2a-611d-4269-8014-aa397641e47c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:05.590433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590318 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-model-cache" pod "26762e2a-611d-4269-8014-aa397641e47c" (UID: "26762e2a-611d-4269-8014-aa397641e47c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:05.590903 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590449 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-dshm\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-dshm\") pod \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " Nov 04 05:03:05.590903 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590490 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-home" pod "26762e2a-611d-4269-8014-aa397641e47c" (UID: "26762e2a-611d-4269-8014-aa397641e47c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:05.590903 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590517 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tmp-dir\") pod \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " Nov 04 05:03:05.590903 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590577 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-kube-api-access-4gdml\" (UniqueName: \"kubernetes.io/projected/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-kube-api-access-4gdml\") pod \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " Nov 04 05:03:05.590903 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590611 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-model-cache\") pod \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\" (UID: \"14fa9f1c-5b3e-4364-a533-001d9c32e6b0\") " Nov 04 05:03:05.591143 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.590983 4955 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-model-cache\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:05.591143 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.591002 4955 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-tmp-dir\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:05.591143 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.591017 4955 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-home\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:05.591143 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.591030 4955 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-home\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:05.591143 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.591091 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tmp-dir" pod "14fa9f1c-5b3e-4364-a533-001d9c32e6b0" (UID: "14fa9f1c-5b3e-4364-a533-001d9c32e6b0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:05.591490 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.591241 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-model-cache" pod "14fa9f1c-5b3e-4364-a533-001d9c32e6b0" (UID: "14fa9f1c-5b3e-4364-a533-001d9c32e6b0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:05.592989 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.592947 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26762e2a-611d-4269-8014-aa397641e47c-tls-certs" pod "26762e2a-611d-4269-8014-aa397641e47c" (UID: "26762e2a-611d-4269-8014-aa397641e47c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:03:05.593535 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.593395 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-dshm" pod "26762e2a-611d-4269-8014-aa397641e47c" (UID: "26762e2a-611d-4269-8014-aa397641e47c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:05.593535 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.593434 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26762e2a-611d-4269-8014-aa397641e47c-kube-api-access-dshlt" pod "26762e2a-611d-4269-8014-aa397641e47c" (UID: "26762e2a-611d-4269-8014-aa397641e47c"). InnerVolumeSpecName "kube-api-access-dshlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:05.593535 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.593510 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tls-certs" pod "14fa9f1c-5b3e-4364-a533-001d9c32e6b0" (UID: "14fa9f1c-5b3e-4364-a533-001d9c32e6b0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:03:05.593894 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.593870 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-dshm" pod "14fa9f1c-5b3e-4364-a533-001d9c32e6b0" (UID: "14fa9f1c-5b3e-4364-a533-001d9c32e6b0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:05.594822 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.594801 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-kube-api-access-4gdml" pod "14fa9f1c-5b3e-4364-a533-001d9c32e6b0" (UID: "14fa9f1c-5b3e-4364-a533-001d9c32e6b0"). InnerVolumeSpecName "kube-api-access-4gdml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:05.692337 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.692229 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dshlt\" (UniqueName: \"kubernetes.io/projected/26762e2a-611d-4269-8014-aa397641e47c-kube-api-access-dshlt\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:05.692337 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.692291 4955 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26762e2a-611d-4269-8014-aa397641e47c-dshm\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:05.692337 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.692307 4955 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-dshm\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:05.692337 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.692320 4955 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tmp-dir\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:05.692337 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.692333 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gdml\" (UniqueName: \"kubernetes.io/projected/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-kube-api-access-4gdml\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:05.692615 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.692347 4955 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-model-cache\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:05.692615 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.692363 4955 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26762e2a-611d-4269-8014-aa397641e47c-tls-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:05.692615 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.692376 4955 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14fa9f1c-5b3e-4364-a533-001d9c32e6b0-tls-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:05.733793 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.733679 4955 generic.go:356] "Generic (PLEG): container finished" podID="14fa9f1c-5b3e-4364-a533-001d9c32e6b0" containerID="5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd" exitCode=0 Nov 04 05:03:05.734092 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.733862 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" event={"ID":"14fa9f1c-5b3e-4364-a533-001d9c32e6b0","Type":"ContainerDied","Data":"5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd"} Nov 04 05:03:05.734197 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.734124 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" event={"ID":"14fa9f1c-5b3e-4364-a533-001d9c32e6b0","Type":"ContainerDied","Data":"2b736c1131a6cbf0d87dc29016647e2a1d1c0e9fbebe08f68102024f84a38b68"} Nov 04 05:03:05.734197 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.734154 4955 scope.go:122] "RemoveContainer" containerID="5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd" Nov 04 05:03:05.734197 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.733909 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz" Nov 04 05:03:05.737438 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.737409 4955 generic.go:356] "Generic (PLEG): container finished" podID="26762e2a-611d-4269-8014-aa397641e47c" containerID="460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91" exitCode=0 Nov 04 05:03:05.737540 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.737509 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" Nov 04 05:03:05.737790 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.737705 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" event={"ID":"26762e2a-611d-4269-8014-aa397641e47c","Type":"ContainerDied","Data":"460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91"} Nov 04 05:03:05.737790 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.737752 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" event={"ID":"26762e2a-611d-4269-8014-aa397641e47c","Type":"ContainerDied","Data":"dc2bc204bd4e081e8ab423b3f5a2c062b3435d988b7442220852438afeb1aac3"} Nov 04 05:03:05.747382 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.747338 4955 scope.go:122] "RemoveContainer" containerID="5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd" Nov 04 05:03:05.747732 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:03:05.747710 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd\": container with ID starting with 5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd not found: ID does not exist" containerID="5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd" Nov 04 05:03:05.747841 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.747750 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd"} err="failed to get container status \"5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd\": rpc error: code = NotFound desc = could not find container \"5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd\": container with ID starting with 5abf7f27fefa0705cebc6fc0a3cb3b83547f1e7a8504030bbdacdc89f5ba92cd not found: ID does not exist" Nov 04 05:03:05.747841 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.747771 4955 scope.go:122] "RemoveContainer" containerID="460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91" Nov 04 05:03:05.762474 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.759847 4955 scope.go:122] "RemoveContainer" containerID="460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91" Nov 04 05:03:05.762474 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:03:05.760311 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91\": container with ID starting with 460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91 not found: ID does not exist" containerID="460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91" Nov 04 05:03:05.762474 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.760349 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91"} err="failed to get container status \"460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91\": rpc error: code = NotFound desc = could not find container \"460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91\": container with ID starting with 460dbd8e13160e6b7612a0633d0daed2d06172d7293df8894c136168ee61df91 not found: ID does not exist" Nov 04 05:03:05.889823 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.889784 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9"] Nov 04 05:03:05.895800 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.895765 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9"] Nov 04 05:03:05.994985 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.994906 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz"] Nov 04 05:03:05.998951 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:05.998921 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-a48f7e/premium-w4-a48f7e-kserve-75869df4ff-477xz"] Nov 04 05:03:06.159669 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.159640 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:03:06.198103 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198064 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-socket\") pod \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " Nov 04 05:03:06.198286 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198127 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-kube-api-access-7dd24\" (UniqueName: \"kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-kube-api-access-7dd24\") pod \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " Nov 04 05:03:06.198286 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198168 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istiod-ca-cert\") pod \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " Nov 04 05:03:06.198286 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198208 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-data\") pod \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " Nov 04 05:03:06.198286 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198245 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-certs\") pod \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " Nov 04 05:03:06.198506 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198325 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-credential-socket\") pod \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " Nov 04 05:03:06.198506 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198361 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-token\" (UniqueName: \"kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-token\") pod \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " Nov 04 05:03:06.198506 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198399 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-envoy\") pod \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " Nov 04 05:03:06.198506 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198435 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-podinfo\") pod \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\" (UID: \"19b3c49c-844f-499d-bdae-d01b1e3eefe6\") " Nov 04 05:03:06.198506 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198431 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-socket" pod "19b3c49c-844f-499d-bdae-d01b1e3eefe6" (UID: "19b3c49c-844f-499d-bdae-d01b1e3eefe6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:06.198764 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198674 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-credential-socket" pod "19b3c49c-844f-499d-bdae-d01b1e3eefe6" (UID: "19b3c49c-844f-499d-bdae-d01b1e3eefe6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:06.198827 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198811 4955 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-credential-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:06.198882 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.198832 4955 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:06.199417 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.199186 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-certs" pod "19b3c49c-844f-499d-bdae-d01b1e3eefe6" (UID: "19b3c49c-844f-499d-bdae-d01b1e3eefe6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:06.199417 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.199288 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-data" pod "19b3c49c-844f-499d-bdae-d01b1e3eefe6" (UID: "19b3c49c-844f-499d-bdae-d01b1e3eefe6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:06.199417 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.199405 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istiod-ca-cert" pod "19b3c49c-844f-499d-bdae-d01b1e3eefe6" (UID: "19b3c49c-844f-499d-bdae-d01b1e3eefe6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:03:06.201410 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.201370 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-podinfo" pod "19b3c49c-844f-499d-bdae-d01b1e3eefe6" (UID: "19b3c49c-844f-499d-bdae-d01b1e3eefe6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:03:06.201681 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.201656 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-token" pod "19b3c49c-844f-499d-bdae-d01b1e3eefe6" (UID: "19b3c49c-844f-499d-bdae-d01b1e3eefe6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:06.201803 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.201688 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-kube-api-access-7dd24" pod "19b3c49c-844f-499d-bdae-d01b1e3eefe6" (UID: "19b3c49c-844f-499d-bdae-d01b1e3eefe6"). InnerVolumeSpecName "kube-api-access-7dd24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:06.201803 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.201769 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-envoy" pod "19b3c49c-844f-499d-bdae-d01b1e3eefe6" (UID: "19b3c49c-844f-499d-bdae-d01b1e3eefe6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:06.299871 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.299833 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dd24\" (UniqueName: \"kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-kube-api-access-7dd24\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:06.300023 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.299880 4955 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istiod-ca-cert\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:06.300023 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.299902 4955 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-data\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:06.300023 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.299918 4955 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-workload-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:06.300023 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.299932 4955 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-token\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:06.300023 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.299947 4955 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-envoy\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:06.300023 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.299962 4955 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b3c49c-844f-499d-bdae-d01b1e3eefe6-istio-podinfo\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:06.462802 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.462750 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-a48f7e/simulator-w4-a48f7e-kserve-6bc54d5f54-d9qc9" podUID="26762e2a-611d-4269-8014-aa397641e47c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 04 05:03:06.580561 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.580461 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 05:03:06.580730 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.580554 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 05:03:06.745043 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.745005 4955 generic.go:356] "Generic (PLEG): container finished" podID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" containerID="e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194" exitCode=0 Nov 04 05:03:06.745500 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.745060 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" Nov 04 05:03:06.745500 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.745089 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" event={"ID":"19b3c49c-844f-499d-bdae-d01b1e3eefe6","Type":"ContainerDied","Data":"e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194"} Nov 04 05:03:06.745500 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.745158 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9" event={"ID":"19b3c49c-844f-499d-bdae-d01b1e3eefe6","Type":"ContainerDied","Data":"0b6bc4ed52e3ed2e009db8a2cc367f536f50a391db098c2bfc22a856d76cc34b"} Nov 04 05:03:06.745500 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.745183 4955 scope.go:122] "RemoveContainer" containerID="e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194" Nov 04 05:03:06.756878 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.756852 4955 scope.go:122] "RemoveContainer" containerID="e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194" Nov 04 05:03:06.757234 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:03:06.757212 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194\": container with ID starting with e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194 not found: ID does not exist" containerID="e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194" Nov 04 05:03:06.757367 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.757241 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194"} err="failed to get container status \"e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194\": rpc error: code = NotFound desc = could not find container \"e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194\": container with ID starting with e38cbf4e7e4bb4bd28729acbbc841578d0d4b64c03a8112f6cb0678af56f5194 not found: ID does not exist" Nov 04 05:03:06.812128 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.812099 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:03:06.812512 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.812480 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:03:06.813415 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.813395 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:03:06.899469 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.899384 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9"] Nov 04 05:03:06.903232 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:06.903203 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-204e38-openshift-default-6d488f5d7f-vqbm9"] Nov 04 05:03:07.654640 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:07.654605 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14fa9f1c-5b3e-4364-a533-001d9c32e6b0" path="/var/lib/kubelet/pods/14fa9f1c-5b3e-4364-a533-001d9c32e6b0/volumes" Nov 04 05:03:07.655039 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:07.655025 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" path="/var/lib/kubelet/pods/19b3c49c-844f-499d-bdae-d01b1e3eefe6/volumes" Nov 04 05:03:07.655416 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:07.655402 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="26762e2a-611d-4269-8014-aa397641e47c" path="/var/lib/kubelet/pods/26762e2a-611d-4269-8014-aa397641e47c/volumes" Nov 04 05:03:08.150295 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.150236 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" podUID="d5d68c8f-6a26-4947-a8e4-90c7f8fcd744" containerName="payload-processing" containerID="cri-o://106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2" gracePeriod=25 Nov 04 05:03:08.284702 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.284659 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" podUID="cb14d4d7-9502-4c94-90fc-0f324135c227" containerName="payload-pre-processing" containerID="cri-o://75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3" gracePeriod=25 Nov 04 05:03:08.414459 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.414431 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" Nov 04 05:03:08.522238 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.522201 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-plugins-config-volume\") pod \"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744\" (UID: \"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744\") " Nov 04 05:03:08.522512 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.522322 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-kube-api-access-xzbjg\" (UniqueName: \"kubernetes.io/projected/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-kube-api-access-xzbjg\") pod \"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744\" (UID: \"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744\") " Nov 04 05:03:08.522692 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.522651 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-plugins-config-volume" pod "d5d68c8f-6a26-4947-a8e4-90c7f8fcd744" (UID: "d5d68c8f-6a26-4947-a8e4-90c7f8fcd744"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:03:08.525199 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.525152 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-kube-api-access-xzbjg" pod "d5d68c8f-6a26-4947-a8e4-90c7f8fcd744" (UID: "d5d68c8f-6a26-4947-a8e4-90c7f8fcd744"). InnerVolumeSpecName "kube-api-access-xzbjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:08.545753 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.545720 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" Nov 04 05:03:08.623506 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.623469 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cb14d4d7-9502-4c94-90fc-0f324135c227-kube-api-access-jjnnl\" (UniqueName: \"kubernetes.io/projected/cb14d4d7-9502-4c94-90fc-0f324135c227-kube-api-access-jjnnl\") pod \"cb14d4d7-9502-4c94-90fc-0f324135c227\" (UID: \"cb14d4d7-9502-4c94-90fc-0f324135c227\") " Nov 04 05:03:08.623682 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.623528 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cb14d4d7-9502-4c94-90fc-0f324135c227-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb14d4d7-9502-4c94-90fc-0f324135c227-plugins-config-volume\") pod \"cb14d4d7-9502-4c94-90fc-0f324135c227\" (UID: \"cb14d4d7-9502-4c94-90fc-0f324135c227\") " Nov 04 05:03:08.623909 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.623874 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb14d4d7-9502-4c94-90fc-0f324135c227-plugins-config-volume" pod "cb14d4d7-9502-4c94-90fc-0f324135c227" (UID: "cb14d4d7-9502-4c94-90fc-0f324135c227"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:03:08.623909 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.623884 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzbjg\" (UniqueName: \"kubernetes.io/projected/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-kube-api-access-xzbjg\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:08.624076 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.623927 4955 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744-plugins-config-volume\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:08.625632 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.625608 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb14d4d7-9502-4c94-90fc-0f324135c227-kube-api-access-jjnnl" pod "cb14d4d7-9502-4c94-90fc-0f324135c227" (UID: "cb14d4d7-9502-4c94-90fc-0f324135c227"). InnerVolumeSpecName "kube-api-access-jjnnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:08.724688 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.724590 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjnnl\" (UniqueName: \"kubernetes.io/projected/cb14d4d7-9502-4c94-90fc-0f324135c227-kube-api-access-jjnnl\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:08.724688 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.724625 4955 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb14d4d7-9502-4c94-90fc-0f324135c227-plugins-config-volume\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:08.766768 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.766732 4955 generic.go:356] "Generic (PLEG): container finished" podID="d5d68c8f-6a26-4947-a8e4-90c7f8fcd744" containerID="106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2" exitCode=0 Nov 04 05:03:08.766964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.766785 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" Nov 04 05:03:08.766964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.766808 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" event={"ID":"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744","Type":"ContainerDied","Data":"106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2"} Nov 04 05:03:08.766964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.766903 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6" event={"ID":"d5d68c8f-6a26-4947-a8e4-90c7f8fcd744","Type":"ContainerDied","Data":"d9a13549bc28d56b7d8403451f910f9e0ea14afcf5e797d87d32e0af66aad6c5"} Nov 04 05:03:08.766964 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.766941 4955 scope.go:122] "RemoveContainer" containerID="106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2" Nov 04 05:03:08.768435 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.768413 4955 generic.go:356] "Generic (PLEG): container finished" podID="cb14d4d7-9502-4c94-90fc-0f324135c227" containerID="75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3" exitCode=0 Nov 04 05:03:08.768547 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.768469 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" Nov 04 05:03:08.768547 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.768507 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" event={"ID":"cb14d4d7-9502-4c94-90fc-0f324135c227","Type":"ContainerDied","Data":"75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3"} Nov 04 05:03:08.768637 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.768555 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg" event={"ID":"cb14d4d7-9502-4c94-90fc-0f324135c227","Type":"ContainerDied","Data":"5ced38de268bed1a320852a8d88c76ae66d114ccccca8b357a5eec47dd440978"} Nov 04 05:03:08.776939 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.776919 4955 scope.go:122] "RemoveContainer" containerID="106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2" Nov 04 05:03:08.777210 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:03:08.777191 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2\": container with ID starting with 106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2 not found: ID does not exist" containerID="106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2" Nov 04 05:03:08.777346 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.777221 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2"} err="failed to get container status \"106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2\": rpc error: code = NotFound desc = could not find container \"106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2\": container with ID starting with 106072743edf38e1b3ad5f62a4a95b8904cb558a6b6493383e70dcceab8500f2 not found: ID does not exist" Nov 04 05:03:08.777346 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.777244 4955 scope.go:122] "RemoveContainer" containerID="75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3" Nov 04 05:03:08.785773 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.785757 4955 scope.go:122] "RemoveContainer" containerID="75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3" Nov 04 05:03:08.786047 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:03:08.786028 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3\": container with ID starting with 75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3 not found: ID does not exist" containerID="75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3" Nov 04 05:03:08.786093 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.786053 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3"} err="failed to get container status \"75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3\": rpc error: code = NotFound desc = could not find container \"75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3\": container with ID starting with 75e6eeb1adc96ba6dd93d50c9b66e1c83361bcf4e6e1063d20fd45b8cd6749d3 not found: ID does not exist" Nov 04 05:03:08.924629 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.924589 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg"] Nov 04 05:03:08.930733 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:08.929215 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-a48f7e-75b85b8bdc-cwfkg"] Nov 04 05:03:09.029253 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:09.029161 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6"] Nov 04 05:03:09.035494 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:09.035464 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-a48f7e-5bd88dbd4d-w4dr6"] Nov 04 05:03:09.657467 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:09.657432 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cb14d4d7-9502-4c94-90fc-0f324135c227" path="/var/lib/kubelet/pods/cb14d4d7-9502-4c94-90fc-0f324135c227/volumes" Nov 04 05:03:09.657988 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:09.657966 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d5d68c8f-6a26-4947-a8e4-90c7f8fcd744" path="/var/lib/kubelet/pods/d5d68c8f-6a26-4947-a8e4-90c7f8fcd744/volumes" Nov 04 05:03:10.507299 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:10.507255 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj"] Nov 04 05:03:10.507494 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:10.507478 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerName="istio-proxy" containerID="cri-o://0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9" gracePeriod=30 Nov 04 05:03:12.046604 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.046569 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4"] Nov 04 05:03:12.047014 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.046972 4955 cpu_manager.go:414] "containerMap: removing container" podUID="26762e2a-611d-4269-8014-aa397641e47c" containerName="main" Nov 04 05:03:12.047014 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.046982 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26762e2a-611d-4269-8014-aa397641e47c" containerName="main" Nov 04 05:03:12.047014 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.046997 4955 cpu_manager.go:414] "containerMap: removing container" podUID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" containerName="istio-proxy" Nov 04 05:03:12.047014 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.047003 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" containerName="istio-proxy" Nov 04 05:03:12.047157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.047024 4955 cpu_manager.go:414] "containerMap: removing container" podUID="14fa9f1c-5b3e-4364-a533-001d9c32e6b0" containerName="main" Nov 04 05:03:12.047157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.047030 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14fa9f1c-5b3e-4364-a533-001d9c32e6b0" containerName="main" Nov 04 05:03:12.047157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.047041 4955 cpu_manager.go:414] "containerMap: removing container" podUID="d5d68c8f-6a26-4947-a8e4-90c7f8fcd744" containerName="payload-processing" Nov 04 05:03:12.047157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.047046 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5d68c8f-6a26-4947-a8e4-90c7f8fcd744" containerName="payload-processing" Nov 04 05:03:12.047157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.047061 4955 cpu_manager.go:414] "containerMap: removing container" podUID="cb14d4d7-9502-4c94-90fc-0f324135c227" containerName="payload-pre-processing" Nov 04 05:03:12.047157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.047066 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cb14d4d7-9502-4c94-90fc-0f324135c227" containerName="payload-pre-processing" Nov 04 05:03:12.047157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.047122 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="cb14d4d7-9502-4c94-90fc-0f324135c227" containerName="payload-pre-processing" Nov 04 05:03:12.047157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.047130 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="26762e2a-611d-4269-8014-aa397641e47c" containerName="main" Nov 04 05:03:12.047157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.047139 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="19b3c49c-844f-499d-bdae-d01b1e3eefe6" containerName="istio-proxy" Nov 04 05:03:12.047157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.047144 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="14fa9f1c-5b3e-4364-a533-001d9c32e6b0" containerName="main" Nov 04 05:03:12.047157 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.047151 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5d68c8f-6a26-4947-a8e4-90c7f8fcd744" containerName="payload-processing" Nov 04 05:03:12.052042 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.052022 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.161929 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.161895 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-envoy\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.162092 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.161948 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-podinfo\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.162092 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.161971 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.162166 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.162110 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-data\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.162166 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.162147 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5x2p\" (UniqueName: \"kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-kube-api-access-m5x2p\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.162232 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.162175 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-credential-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.162324 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.162299 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-certs\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.162405 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.162386 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-token\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.162437 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.162426 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1945091-d4cc-43e4-967c-9f5101284d6e-istiod-ca-cert\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.247209 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.247174 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4"] Nov 04 05:03:12.263761 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.263715 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-envoy\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.263955 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.263819 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-podinfo\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.263955 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.263858 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.263955 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.263916 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-data\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.263955 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.263952 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5x2p\" (UniqueName: \"kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-kube-api-access-m5x2p\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.264175 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.264069 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-credential-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.264175 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.264114 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-certs\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.264324 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.264189 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-token\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.264324 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.264223 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1945091-d4cc-43e4-967c-9f5101284d6e-istiod-ca-cert\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.264324 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.264287 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.264466 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.264349 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-data\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.264662 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.264637 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-certs\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.264801 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.264776 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-credential-socket\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.264877 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.264860 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1945091-d4cc-43e4-967c-9f5101284d6e-istiod-ca-cert\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.266200 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.266170 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-envoy\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.266395 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.266377 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-podinfo\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.321517 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.321484 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-token\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.321633 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.321570 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5x2p\" (UniqueName: \"kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-kube-api-access-m5x2p\") pod \"e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.365128 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.365101 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:12.791521 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.791444 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4"] Nov 04 05:03:12.797702 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:03:12.797669 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1945091_d4cc_43e4_967c_9f5101284d6e.slice/crio-0250081bbbb17c97b99526421804a9d70e9057004fe427ab3ec6f000fb988781 WatchSource:0}: Error finding container 0250081bbbb17c97b99526421804a9d70e9057004fe427ab3ec6f000fb988781: Status 404 returned error can't find the container with id 0250081bbbb17c97b99526421804a9d70e9057004fe427ab3ec6f000fb988781 Nov 04 05:03:12.799828 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.799796 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:03:12.799933 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.799864 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:03:12.799933 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:12.799892 4955 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Nov 04 05:03:13.806150 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:13.806110 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" event={"ID":"a1945091-d4cc-43e4-967c-9f5101284d6e","Type":"ContainerStarted","Data":"28831ee48533f3e0f9833981dfa8bd67b7753e8b2ffbb8ca209e3a43531f4577"} Nov 04 05:03:13.806571 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:13.806175 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" event={"ID":"a1945091-d4cc-43e4-967c-9f5101284d6e","Type":"ContainerStarted","Data":"0250081bbbb17c97b99526421804a9d70e9057004fe427ab3ec6f000fb988781"} Nov 04 05:03:13.976288 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:13.968738 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" podStartSLOduration=2.968707071 podStartE2EDuration="2.968707071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:03:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:03:13.968178395 +0000 UTC m=+1044.438004534" watchObservedRunningTime="2026-11-04 05:03:13.968707071 +0000 UTC m=+1044.438533211" Nov 04 05:03:14.371995 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:14.369606 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:14.372334 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:14.372307 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Nov 04 05:03:14.372519 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:14.372494 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Nov 04 05:03:14.790446 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:14.790365 4955 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-57f78bcd55-vzbwj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 05:03:14.790446 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:14.790416 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 05:03:15.371286 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.365708 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Nov 04 05:03:15.371286 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.365769 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Nov 04 05:03:15.804405 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.804370 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 05:03:15.818572 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.818209 4955 generic.go:356] "Generic (PLEG): container finished" podID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerID="0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9" exitCode=0 Nov 04 05:03:15.818572 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.818289 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" Nov 04 05:03:15.818572 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.818308 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" event={"ID":"a82072ea-d34d-4485-bccf-dd82d8dc1768","Type":"ContainerDied","Data":"0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9"} Nov 04 05:03:15.818572 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.818382 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj" event={"ID":"a82072ea-d34d-4485-bccf-dd82d8dc1768","Type":"ContainerDied","Data":"0d93c8a37d27208474a543d8f0108a0fd1efbf7a74b1c82efbb95ac4d1408a62"} Nov 04 05:03:15.818572 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.818396 4955 scope.go:122] "RemoveContainer" containerID="0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9" Nov 04 05:03:15.827807 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.827790 4955 scope.go:122] "RemoveContainer" containerID="0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9" Nov 04 05:03:15.828116 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:03:15.828097 4955 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9\": container with ID starting with 0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9 not found: ID does not exist" containerID="0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9" Nov 04 05:03:15.828168 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.828127 4955 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9"} err="failed to get container status \"0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9\": rpc error: code = NotFound desc = could not find container \"0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9\": container with ID starting with 0f073382d70ee228931e9ce5bc8a5bd4812e1156172614a23c6e9725ede2ecd9 not found: ID does not exist" Nov 04 05:03:15.904090 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904052 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-socket\") pod \"a82072ea-d34d-4485-bccf-dd82d8dc1768\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " Nov 04 05:03:15.904297 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904103 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-certs\") pod \"a82072ea-d34d-4485-bccf-dd82d8dc1768\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " Nov 04 05:03:15.904297 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904165 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-kube-api-access-vfd6n\" (UniqueName: \"kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-kube-api-access-vfd6n\") pod \"a82072ea-d34d-4485-bccf-dd82d8dc1768\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " Nov 04 05:03:15.904297 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904188 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a82072ea-d34d-4485-bccf-dd82d8dc1768-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82072ea-d34d-4485-bccf-dd82d8dc1768-istiod-ca-cert\") pod \"a82072ea-d34d-4485-bccf-dd82d8dc1768\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " Nov 04 05:03:15.904297 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904207 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-credential-socket\") pod \"a82072ea-d34d-4485-bccf-dd82d8dc1768\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " Nov 04 05:03:15.904466 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904340 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-podinfo\") pod \"a82072ea-d34d-4485-bccf-dd82d8dc1768\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " Nov 04 05:03:15.904466 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904372 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-socket" pod "a82072ea-d34d-4485-bccf-dd82d8dc1768" (UID: "a82072ea-d34d-4485-bccf-dd82d8dc1768"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:15.904466 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904400 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-data\") pod \"a82072ea-d34d-4485-bccf-dd82d8dc1768\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " Nov 04 05:03:15.904466 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904432 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-envoy\") pod \"a82072ea-d34d-4485-bccf-dd82d8dc1768\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " Nov 04 05:03:15.904661 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904476 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-token\" (UniqueName: \"kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-token\") pod \"a82072ea-d34d-4485-bccf-dd82d8dc1768\" (UID: \"a82072ea-d34d-4485-bccf-dd82d8dc1768\") " Nov 04 05:03:15.904661 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904559 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-credential-socket" pod "a82072ea-d34d-4485-bccf-dd82d8dc1768" (UID: "a82072ea-d34d-4485-bccf-dd82d8dc1768"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:15.904661 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904602 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-data" pod "a82072ea-d34d-4485-bccf-dd82d8dc1768" (UID: "a82072ea-d34d-4485-bccf-dd82d8dc1768"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:15.904661 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904631 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a82072ea-d34d-4485-bccf-dd82d8dc1768-istiod-ca-cert" pod "a82072ea-d34d-4485-bccf-dd82d8dc1768" (UID: "a82072ea-d34d-4485-bccf-dd82d8dc1768"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:03:15.904903 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.904879 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-certs" pod "a82072ea-d34d-4485-bccf-dd82d8dc1768" (UID: "a82072ea-d34d-4485-bccf-dd82d8dc1768"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:15.905132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.905058 4955 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:15.905132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.905076 4955 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-workload-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:15.905132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.905088 4955 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82072ea-d34d-4485-bccf-dd82d8dc1768-istiod-ca-cert\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:15.905132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.905103 4955 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-credential-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:15.905132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.905116 4955 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-data\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:15.906753 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.906724 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-token" pod "a82072ea-d34d-4485-bccf-dd82d8dc1768" (UID: "a82072ea-d34d-4485-bccf-dd82d8dc1768"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:15.906753 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.906733 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-envoy" pod "a82072ea-d34d-4485-bccf-dd82d8dc1768" (UID: "a82072ea-d34d-4485-bccf-dd82d8dc1768"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:15.906988 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.906953 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-podinfo" pod "a82072ea-d34d-4485-bccf-dd82d8dc1768" (UID: "a82072ea-d34d-4485-bccf-dd82d8dc1768"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:03:15.907073 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:15.907048 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-kube-api-access-vfd6n" pod "a82072ea-d34d-4485-bccf-dd82d8dc1768" (UID: "a82072ea-d34d-4485-bccf-dd82d8dc1768"). InnerVolumeSpecName "kube-api-access-vfd6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:16.006233 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:16.006147 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfd6n\" (UniqueName: \"kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-kube-api-access-vfd6n\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:16.006233 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:16.006185 4955 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-podinfo\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:16.006233 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:16.006200 4955 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-envoy\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:16.006233 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:16.006217 4955 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a82072ea-d34d-4485-bccf-dd82d8dc1768-istio-token\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:16.233464 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:16.233428 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj"] Nov 04 05:03:16.237621 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:16.237587 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-57f78bcd55-vzbwj"] Nov 04 05:03:16.375287 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:16.371665 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Nov 04 05:03:16.375287 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:16.371728 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Nov 04 05:03:17.378287 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:17.377690 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Nov 04 05:03:17.378287 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:17.377753 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Nov 04 05:03:17.678338 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:17.678209 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" path="/var/lib/kubelet/pods/a82072ea-d34d-4485-bccf-dd82d8dc1768/volumes" Nov 04 05:03:18.373288 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:18.367632 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Nov 04 05:03:18.373288 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:18.367699 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Nov 04 05:03:19.365916 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:19.365871 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body= Nov 04 05:03:19.366321 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:19.365959 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" Nov 04 05:03:21.367371 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:21.367335 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 05:03:21.367774 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:21.367421 4955 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 05:03:21.431041 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:21.431011 4955 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:21.431314 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:21.431293 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:21.432882 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:21.432861 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:28.191373 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:03:28.191336 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:03:31.758837 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:31.758788 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4"] Nov 04 05:03:31.759539 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:31.759021 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerName="istio-proxy" containerID="cri-o://28831ee48533f3e0f9833981dfa8bd67b7753e8b2ffbb8ca209e3a43531f4577" gracePeriod=30 Nov 04 05:03:31.769603 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:31.769573 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz"] Nov 04 05:03:31.769804 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:31.769783 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerName="istio-proxy" containerID="cri-o://f7137004cb03a20b93840414d3e963824fdb3894ea5573d2dddce888d01ea50a" gracePeriod=30 Nov 04 05:03:31.779188 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:31.779163 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj"] Nov 04 05:03:31.779448 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:31.779406 4955 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" podUID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" containerName="istio-proxy" containerID="cri-o://54e3b279ea61e1051935c78b7c511fb4f0b5fb03bf089ba3aa541e96a5fc421c" gracePeriod=30 Nov 04 05:03:34.556839 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:34.556803 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 05:03:34.557248 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:34.556872 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" podUID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 05:03:36.433547 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:36.433512 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 05:03:36.433956 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:36.433570 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 05:03:36.813997 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:36.813966 4955 patch_prober.go:29] interesting pod/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 04 05:03:36.814144 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:36.814022 4955 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 04 05:03:36.979480 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:36.979448 4955 generic.go:356] "Generic (PLEG): container finished" podID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" containerID="54e3b279ea61e1051935c78b7c511fb4f0b5fb03bf089ba3aa541e96a5fc421c" exitCode=0 Nov 04 05:03:36.979629 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:36.979515 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" event={"ID":"76b343b5-e9cc-4ea5-94b7-18797d9a6052","Type":"ContainerDied","Data":"54e3b279ea61e1051935c78b7c511fb4f0b5fb03bf089ba3aa541e96a5fc421c"} Nov 04 05:03:36.981514 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:36.981489 4955 generic.go:356] "Generic (PLEG): container finished" podID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerID="28831ee48533f3e0f9833981dfa8bd67b7753e8b2ffbb8ca209e3a43531f4577" exitCode=0 Nov 04 05:03:36.981633 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:36.981592 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" event={"ID":"a1945091-d4cc-43e4-967c-9f5101284d6e","Type":"ContainerDied","Data":"28831ee48533f3e0f9833981dfa8bd67b7753e8b2ffbb8ca209e3a43531f4577"} Nov 04 05:03:36.983589 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:36.983558 4955 generic.go:356] "Generic (PLEG): container finished" podID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerID="f7137004cb03a20b93840414d3e963824fdb3894ea5573d2dddce888d01ea50a" exitCode=0 Nov 04 05:03:36.983705 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:36.983688 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" event={"ID":"9a1fcf66-5ccb-45f7-b555-bc9879f088aa","Type":"ContainerDied","Data":"f7137004cb03a20b93840414d3e963824fdb3894ea5573d2dddce888d01ea50a"} Nov 04 05:03:37.047117 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.047090 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:37.069455 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.069430 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:03:37.072566 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.072544 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:03:37.219621 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219592 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-socket\") pod \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " Nov 04 05:03:37.219621 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219626 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-credential-socket\") pod \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " Nov 04 05:03:37.219861 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219647 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-podinfo\") pod \"a1945091-d4cc-43e4-967c-9f5101284d6e\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " Nov 04 05:03:37.219861 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219664 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istiod-ca-cert\") pod \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " Nov 04 05:03:37.219861 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219691 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-data\") pod \"a1945091-d4cc-43e4-967c-9f5101284d6e\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " Nov 04 05:03:37.219861 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219731 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-kube-api-access-9xr4k\" (UniqueName: \"kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-kube-api-access-9xr4k\") pod \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " Nov 04 05:03:37.219861 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219764 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-token\" (UniqueName: \"kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-token\") pod \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " Nov 04 05:03:37.219861 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219796 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-envoy\") pod \"a1945091-d4cc-43e4-967c-9f5101284d6e\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " Nov 04 05:03:37.219861 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219833 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-certs\") pod \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " Nov 04 05:03:37.220204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219870 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-socket\") pod \"a1945091-d4cc-43e4-967c-9f5101284d6e\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " Nov 04 05:03:37.220204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219895 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-podinfo\") pod \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " Nov 04 05:03:37.220204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219962 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-credential-socket" pod "76b343b5-e9cc-4ea5-94b7-18797d9a6052" (UID: "76b343b5-e9cc-4ea5-94b7-18797d9a6052"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.220204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219979 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-socket" pod "9a1fcf66-5ccb-45f7-b555-bc9879f088aa" (UID: "9a1fcf66-5ccb-45f7-b555-bc9879f088aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.220204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219991 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-data" pod "a1945091-d4cc-43e4-967c-9f5101284d6e" (UID: "a1945091-d4cc-43e4-967c-9f5101284d6e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.220204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.219928 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-certs\") pod \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " Nov 04 05:03:37.220204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220086 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a1945091-d4cc-43e4-967c-9f5101284d6e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1945091-d4cc-43e4-967c-9f5101284d6e-istiod-ca-cert\") pod \"a1945091-d4cc-43e4-967c-9f5101284d6e\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " Nov 04 05:03:37.220204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220098 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istiod-ca-cert" pod "76b343b5-e9cc-4ea5-94b7-18797d9a6052" (UID: "76b343b5-e9cc-4ea5-94b7-18797d9a6052"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:03:37.220204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220118 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-data\") pod \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " Nov 04 05:03:37.220204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220126 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-certs" pod "76b343b5-e9cc-4ea5-94b7-18797d9a6052" (UID: "76b343b5-e9cc-4ea5-94b7-18797d9a6052"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.220204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220171 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-token\" (UniqueName: \"kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-token\") pod \"a1945091-d4cc-43e4-967c-9f5101284d6e\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " Nov 04 05:03:37.220204 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220200 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-token\" (UniqueName: \"kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-token\") pod \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220216 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-socket" pod "a1945091-d4cc-43e4-967c-9f5101284d6e" (UID: "a1945091-d4cc-43e4-967c-9f5101284d6e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220244 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-envoy\") pod \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220307 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-credential-socket\") pod \"a1945091-d4cc-43e4-967c-9f5101284d6e\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220339 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-podinfo\") pod \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220371 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-credential-socket\") pod \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220411 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-kube-api-access-m5x2p\" (UniqueName: \"kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-kube-api-access-m5x2p\") pod \"a1945091-d4cc-43e4-967c-9f5101284d6e\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220487 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-data\") pod \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220501 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1945091-d4cc-43e4-967c-9f5101284d6e-istiod-ca-cert" pod "a1945091-d4cc-43e4-967c-9f5101284d6e" (UID: "a1945091-d4cc-43e4-967c-9f5101284d6e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220506 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-certs" pod "9a1fcf66-5ccb-45f7-b555-bc9879f088aa" (UID: "9a1fcf66-5ccb-45f7-b555-bc9879f088aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220521 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-certs\") pod \"a1945091-d4cc-43e4-967c-9f5101284d6e\" (UID: \"a1945091-d4cc-43e4-967c-9f5101284d6e\") " Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220553 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-kube-api-access-7rcvq\" (UniqueName: \"kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-kube-api-access-7rcvq\") pod \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220597 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-socket\") pod \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\" (UID: \"76b343b5-e9cc-4ea5-94b7-18797d9a6052\") " Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220631 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istiod-ca-cert\") pod \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220660 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-envoy\") pod \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\" (UID: \"9a1fcf66-5ccb-45f7-b555-bc9879f088aa\") " Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220715 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-data" pod "76b343b5-e9cc-4ea5-94b7-18797d9a6052" (UID: "76b343b5-e9cc-4ea5-94b7-18797d9a6052"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.220843 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220724 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-credential-socket" pod "9a1fcf66-5ccb-45f7-b555-bc9879f088aa" (UID: "9a1fcf66-5ccb-45f7-b555-bc9879f088aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.222472 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.220915 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-credential-socket" pod "a1945091-d4cc-43e4-967c-9f5101284d6e" (UID: "a1945091-d4cc-43e4-967c-9f5101284d6e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.222472 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.221011 4955 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.222472 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.221031 4955 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-credential-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.222472 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.221046 4955 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istiod-ca-cert\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.222472 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.221060 4955 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-data\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.222472 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.221074 4955 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-workload-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.222472 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.221088 4955 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.222472 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.221102 4955 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.222472 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.221117 4955 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1945091-d4cc-43e4-967c-9f5101284d6e-istiod-ca-cert\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.222472 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.221131 4955 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-data\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.222472 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.221146 4955 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-credential-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.222472 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.221160 4955 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-credential-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.223077 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.222489 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-socket" pod "76b343b5-e9cc-4ea5-94b7-18797d9a6052" (UID: "76b343b5-e9cc-4ea5-94b7-18797d9a6052"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.223077 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.222525 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-envoy" pod "a1945091-d4cc-43e4-967c-9f5101284d6e" (UID: "a1945091-d4cc-43e4-967c-9f5101284d6e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.223077 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.222564 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-podinfo" pod "a1945091-d4cc-43e4-967c-9f5101284d6e" (UID: "a1945091-d4cc-43e4-967c-9f5101284d6e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:03:37.223077 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.222599 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istiod-ca-cert" pod "9a1fcf66-5ccb-45f7-b555-bc9879f088aa" (UID: "9a1fcf66-5ccb-45f7-b555-bc9879f088aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:03:37.223077 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.222861 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-data" pod "9a1fcf66-5ccb-45f7-b555-bc9879f088aa" (UID: "9a1fcf66-5ccb-45f7-b555-bc9879f088aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.223407 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.223076 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-certs" pod "a1945091-d4cc-43e4-967c-9f5101284d6e" (UID: "a1945091-d4cc-43e4-967c-9f5101284d6e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.223407 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.223106 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-podinfo" pod "76b343b5-e9cc-4ea5-94b7-18797d9a6052" (UID: "76b343b5-e9cc-4ea5-94b7-18797d9a6052"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:03:37.223720 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.223695 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-token" pod "a1945091-d4cc-43e4-967c-9f5101284d6e" (UID: "a1945091-d4cc-43e4-967c-9f5101284d6e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:37.223996 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.223972 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-kube-api-access-m5x2p" pod "a1945091-d4cc-43e4-967c-9f5101284d6e" (UID: "a1945091-d4cc-43e4-967c-9f5101284d6e"). InnerVolumeSpecName "kube-api-access-m5x2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:37.224309 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.224284 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-podinfo" pod "9a1fcf66-5ccb-45f7-b555-bc9879f088aa" (UID: "9a1fcf66-5ccb-45f7-b555-bc9879f088aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:03:37.224683 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.224647 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-envoy" pod "76b343b5-e9cc-4ea5-94b7-18797d9a6052" (UID: "76b343b5-e9cc-4ea5-94b7-18797d9a6052"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.224783 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.224707 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-token" pod "76b343b5-e9cc-4ea5-94b7-18797d9a6052" (UID: "76b343b5-e9cc-4ea5-94b7-18797d9a6052"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:37.225068 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.225051 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-token" pod "9a1fcf66-5ccb-45f7-b555-bc9879f088aa" (UID: "9a1fcf66-5ccb-45f7-b555-bc9879f088aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:37.225932 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.225902 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-kube-api-access-7rcvq" pod "9a1fcf66-5ccb-45f7-b555-bc9879f088aa" (UID: "9a1fcf66-5ccb-45f7-b555-bc9879f088aa"). InnerVolumeSpecName "kube-api-access-7rcvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:37.226039 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.225986 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-envoy" pod "9a1fcf66-5ccb-45f7-b555-bc9879f088aa" (UID: "9a1fcf66-5ccb-45f7-b555-bc9879f088aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:37.226201 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.226187 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-kube-api-access-9xr4k" pod "76b343b5-e9cc-4ea5-94b7-18797d9a6052" (UID: "76b343b5-e9cc-4ea5-94b7-18797d9a6052"). InnerVolumeSpecName "kube-api-access-9xr4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:37.321832 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321796 4955 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-token\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.321832 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321831 4955 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-token\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321845 4955 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-envoy\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321860 4955 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-podinfo\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321874 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5x2p\" (UniqueName: \"kubernetes.io/projected/a1945091-d4cc-43e4-967c-9f5101284d6e-kube-api-access-m5x2p\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321889 4955 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-data\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321901 4955 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-workload-certs\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321914 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rcvq\" (UniqueName: \"kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-kube-api-access-7rcvq\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321927 4955 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76b343b5-e9cc-4ea5-94b7-18797d9a6052-workload-socket\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321940 4955 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istiod-ca-cert\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321952 4955 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-envoy\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321964 4955 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-podinfo\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321977 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xr4k\" (UniqueName: \"kubernetes.io/projected/76b343b5-e9cc-4ea5-94b7-18797d9a6052-kube-api-access-9xr4k\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.321990 4955 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a1fcf66-5ccb-45f7-b555-bc9879f088aa-istio-token\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.322002 4955 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1945091-d4cc-43e4-967c-9f5101284d6e-istio-envoy\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.322079 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.322015 4955 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76b343b5-e9cc-4ea5-94b7-18797d9a6052-istio-podinfo\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:03:37.990943 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.990855 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" Nov 04 05:03:37.990943 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.990880 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj" event={"ID":"76b343b5-e9cc-4ea5-94b7-18797d9a6052","Type":"ContainerDied","Data":"8261ddd587a3fd55dfa25ec7c7fe0a0452a5df31cb9afee205b81b11e73169e2"} Nov 04 05:03:37.991474 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.990951 4955 scope.go:122] "RemoveContainer" containerID="54e3b279ea61e1051935c78b7c511fb4f0b5fb03bf089ba3aa541e96a5fc421c" Nov 04 05:03:37.992381 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.992363 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" Nov 04 05:03:37.992506 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.992408 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4" event={"ID":"a1945091-d4cc-43e4-967c-9f5101284d6e","Type":"ContainerDied","Data":"0250081bbbb17c97b99526421804a9d70e9057004fe427ab3ec6f000fb988781"} Nov 04 05:03:37.993914 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.993886 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" Nov 04 05:03:37.993914 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:37.993904 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz" event={"ID":"9a1fcf66-5ccb-45f7-b555-bc9879f088aa","Type":"ContainerDied","Data":"655e797d39a43a91d21e71cf27462c30f27bce50e5be6eafae243c62053e8170"} Nov 04 05:03:38.003910 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:38.003887 4955 scope.go:122] "RemoveContainer" containerID="28831ee48533f3e0f9833981dfa8bd67b7753e8b2ffbb8ca209e3a43531f4577" Nov 04 05:03:38.012201 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:38.012184 4955 scope.go:122] "RemoveContainer" containerID="f7137004cb03a20b93840414d3e963824fdb3894ea5573d2dddce888d01ea50a" Nov 04 05:03:38.147241 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:38.147206 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz"] Nov 04 05:03:38.193298 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:38.193247 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-lzptz"] Nov 04 05:03:38.256812 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:38.256721 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4"] Nov 04 05:03:38.263395 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:38.263369 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-z7ks4"] Nov 04 05:03:38.365441 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:38.365410 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj"] Nov 04 05:03:38.371706 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:38.371680 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-a48f7e-openshift-default-b5476c79-k7ndj"] Nov 04 05:03:39.654419 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:39.654390 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" path="/var/lib/kubelet/pods/76b343b5-e9cc-4ea5-94b7-18797d9a6052/volumes" Nov 04 05:03:39.654812 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:39.654799 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" path="/var/lib/kubelet/pods/9a1fcf66-5ccb-45f7-b555-bc9879f088aa/volumes" Nov 04 05:03:39.655168 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:39.655155 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" path="/var/lib/kubelet/pods/a1945091-d4cc-43e4-967c-9f5101284d6e/volumes" Nov 04 05:03:45.913407 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:45.913380 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-b9psb_cb3daeaf-3618-4b33-ba7e-4d5a0d06456c/manager/0.log" Nov 04 05:03:46.574618 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:46.574591 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-8xwq5_476fd3e7-e09b-41ff-91a7-803eed68bc42/manager/0.log" Nov 04 05:03:47.406125 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:47.406099 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-b6zvb_d8d4b611-b50f-41d1-887d-dd21f272681d/server/0.log" Nov 04 05:03:47.904130 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:47.904099 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-kphlq_bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a/proxy/0.log" Nov 04 05:03:49.992462 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:49.992420 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-24f46344-qswd8_674f0068-5f4c-4635-b332-07c9f352f59d/revoke-keys/0.log" Nov 04 05:03:50.211871 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:50.211796 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-46105daa-7vh9d_2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee/revoke-keys/0.log" Nov 04 05:03:50.680941 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:50.680913 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-7a85b2c9-tlxph_ae9bed1d-03e7-4dd1-a553-76698a6cbadc/revoke-keys/0.log" Nov 04 05:03:50.905700 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:50.905666 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-8ab5c526-hhx26_2d1653d8-a6dd-4505-8fcf-b2948d3a79be/revoke-keys/0.log" Nov 04 05:03:51.339349 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:51.339315 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-93d9d2ec-znrf2_7c40c646-e87a-4c02-9bd4-36d28c0be184/revoke-keys/0.log" Nov 04 05:03:51.781365 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:51.781256 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-c15a6fe1-5xhcz_e65020ec-12d9-4bd4-8966-a8142208be4d/revoke-keys/0.log" Nov 04 05:03:51.996759 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:51.996734 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f0b92fe9-th7zc_3ad4b541-0175-42e9-a906-98db680a8920/revoke-keys/0.log" Nov 04 05:03:52.421200 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:52.421167 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-9zppv_c6aada15-f762-42f6-bb97-f32044633262/postgres/0.log" Nov 04 05:03:54.749459 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:54.749428 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-tsjpd_1645650e-6b70-4490-afc7-c0a5a01cb0a2/manager/0.log" Nov 04 05:03:55.203062 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:55.203037 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-4bcz7_0f6fb1ad-822f-4305-8321-fc6c580014bf/kuadrant-console-plugin/0.log" Nov 04 05:03:56.399056 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:56.399033 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-fmp4l_33799f24-67f2-4fdc-b095-849edfb41a91/manager/0.log" Nov 04 05:03:57.380151 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:57.380121 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-669569fcd5t6vk7_28edcd93-5c3d-4846-947c-77e9f61e5bf6/istio-proxy/0.log" Nov 04 05:03:58.189007 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:03:58.188970 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:03:58.882765 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:58.882735 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw_ca29bf28-a780-418a-ba50-9ff80af7d04c/istio-proxy/0.log" Nov 04 05:03:59.505300 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:03:59.505258 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d56d655f9-pdqrc_0f55afb7-c026-4ad5-afe1-6c133692689e/router/0.log" Nov 04 05:04:12.901216 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:12.901184 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-b9psb_cb3daeaf-3618-4b33-ba7e-4d5a0d06456c/manager/0.log" Nov 04 05:04:13.483737 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:13.483703 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-8xwq5_476fd3e7-e09b-41ff-91a7-803eed68bc42/manager/0.log" Nov 04 05:04:14.186634 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:14.186607 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-b6zvb_d8d4b611-b50f-41d1-887d-dd21f272681d/server/0.log" Nov 04 05:04:14.692780 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:14.692750 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-kphlq_bbba4dfb-6125-4764-9f9d-d31ce6fb4e2a/proxy/0.log" Nov 04 05:04:16.335616 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:16.335589 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-24f46344-qswd8_674f0068-5f4c-4635-b332-07c9f352f59d/revoke-keys/0.log" Nov 04 05:04:16.552344 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:16.552310 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-46105daa-7vh9d_2a5e91cf-e239-4fa4-9bb1-34c9b6d58fee/revoke-keys/0.log" Nov 04 05:04:17.004779 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.004752 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-7a85b2c9-tlxph_ae9bed1d-03e7-4dd1-a553-76698a6cbadc/revoke-keys/0.log" Nov 04 05:04:17.226621 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.226594 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-8ab5c526-hhx26_2d1653d8-a6dd-4505-8fcf-b2948d3a79be/revoke-keys/0.log" Nov 04 05:04:17.687164 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.687134 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-93d9d2ec-znrf2_7c40c646-e87a-4c02-9bd4-36d28c0be184/revoke-keys/0.log" Nov 04 05:04:17.789478 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789443 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-h4hsc-jnpqh"] Nov 04 05:04:17.789831 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789813 4955 cpu_manager.go:414] "containerMap: removing container" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerName="istio-proxy" Nov 04 05:04:17.789872 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789832 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerName="istio-proxy" Nov 04 05:04:17.789872 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789849 4955 cpu_manager.go:414] "containerMap: removing container" podUID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" containerName="istio-proxy" Nov 04 05:04:17.789872 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789854 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" containerName="istio-proxy" Nov 04 05:04:17.789872 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789870 4955 cpu_manager.go:414] "containerMap: removing container" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerName="istio-proxy" Nov 04 05:04:17.789993 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789876 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerName="istio-proxy" Nov 04 05:04:17.789993 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789891 4955 cpu_manager.go:414] "containerMap: removing container" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerName="istio-proxy" Nov 04 05:04:17.789993 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789896 4955 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerName="istio-proxy" Nov 04 05:04:17.789993 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789970 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a1fcf66-5ccb-45f7-b555-bc9879f088aa" containerName="istio-proxy" Nov 04 05:04:17.789993 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789979 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="a82072ea-d34d-4485-bccf-dd82d8dc1768" containerName="istio-proxy" Nov 04 05:04:17.789993 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789988 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1945091-d4cc-43e4-967c-9f5101284d6e" containerName="istio-proxy" Nov 04 05:04:17.789993 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.789994 4955 memory_manager.go:365] "RemoveStaleState removing state" podUID="76b343b5-e9cc-4ea5-94b7-18797d9a6052" containerName="istio-proxy" Nov 04 05:04:17.792945 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.792925 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:17.846356 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.846325 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-h4hsc-jnpqh"] Nov 04 05:04:17.888878 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.888835 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/66d00d82-e56e-4856-a413-c4ca3974eaab-archives-path\") pod \"periodic-gathering-h4hsc-jnpqh\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:17.889049 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.888907 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q648\" (UniqueName: \"kubernetes.io/projected/66d00d82-e56e-4856-a413-c4ca3974eaab-kube-api-access-2q648\") pod \"periodic-gathering-h4hsc-jnpqh\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:17.889049 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.889008 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-trusted-ca-bundle\") pod \"periodic-gathering-h4hsc-jnpqh\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:17.889132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.889047 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-service-ca-bundle\") pod \"periodic-gathering-h4hsc-jnpqh\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:17.889784 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.889767 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xq7xw\"" Nov 04 05:04:17.989620 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.989530 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-service-ca-bundle\") pod \"periodic-gathering-h4hsc-jnpqh\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:17.989620 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.989607 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/66d00d82-e56e-4856-a413-c4ca3974eaab-archives-path\") pod \"periodic-gathering-h4hsc-jnpqh\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:17.989863 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.989643 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q648\" (UniqueName: \"kubernetes.io/projected/66d00d82-e56e-4856-a413-c4ca3974eaab-kube-api-access-2q648\") pod \"periodic-gathering-h4hsc-jnpqh\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:17.989863 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.989672 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-trusted-ca-bundle\") pod \"periodic-gathering-h4hsc-jnpqh\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:17.990056 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.990033 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/66d00d82-e56e-4856-a413-c4ca3974eaab-archives-path\") pod \"periodic-gathering-h4hsc-jnpqh\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:17.990187 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.990168 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-service-ca-bundle\") pod \"periodic-gathering-h4hsc-jnpqh\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:17.990358 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:17.990342 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-trusted-ca-bundle\") pod \"periodic-gathering-h4hsc-jnpqh\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:18.047159 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:18.047120 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q648\" (UniqueName: \"kubernetes.io/projected/66d00d82-e56e-4856-a413-c4ca3974eaab-kube-api-access-2q648\") pod \"periodic-gathering-h4hsc-jnpqh\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:18.104455 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:18.104415 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:04:18.155652 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:18.154957 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-c15a6fe1-5xhcz_e65020ec-12d9-4bd4-8966-a8142208be4d/revoke-keys/0.log" Nov 04 05:04:18.383130 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:18.383101 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f0b92fe9-th7zc_3ad4b541-0175-42e9-a906-98db680a8920/revoke-keys/0.log" Nov 04 05:04:18.477244 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:18.477210 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-h4hsc-jnpqh"] Nov 04 05:04:18.485726 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:04:18.485695 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d00d82_e56e_4856_a413_c4ca3974eaab.slice/crio-b91b4742f4ce4623c18fbbe6c57778145e2750e084fe4edb0eb88c4d15dcd1ec WatchSource:0}: Error finding container b91b4742f4ce4623c18fbbe6c57778145e2750e084fe4edb0eb88c4d15dcd1ec: Status 404 returned error can't find the container with id b91b4742f4ce4623c18fbbe6c57778145e2750e084fe4edb0eb88c4d15dcd1ec Nov 04 05:04:18.815408 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:18.815363 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-9zppv_c6aada15-f762-42f6-bb97-f32044633262/postgres/0.log" Nov 04 05:04:19.214296 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:19.214195 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" event={"ID":"66d00d82-e56e-4856-a413-c4ca3974eaab","Type":"ContainerStarted","Data":"52ef05421e908362ace236d948ced21c6c95f1b073f5668d4e94412149e7e1ee"} Nov 04 05:04:19.214296 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:19.214245 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" event={"ID":"66d00d82-e56e-4856-a413-c4ca3974eaab","Type":"ContainerStarted","Data":"b91b4742f4ce4623c18fbbe6c57778145e2750e084fe4edb0eb88c4d15dcd1ec"} Nov 04 05:04:19.322103 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:19.322053 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" podStartSLOduration=2.3220385009999998 podStartE2EDuration="2.322038501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:04:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:04:19.321583245 +0000 UTC m=+1109.791409385" watchObservedRunningTime="2026-11-04 05:04:19.322038501 +0000 UTC m=+1109.791864640" Nov 04 05:04:20.354809 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:20.354778 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-tsjpd_1645650e-6b70-4490-afc7-c0a5a01cb0a2/manager/0.log" Nov 04 05:04:20.838370 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:20.838343 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-4bcz7_0f6fb1ad-822f-4305-8321-fc6c580014bf/kuadrant-console-plugin/0.log" Nov 04 05:04:21.704749 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:21.704709 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-fmp4l_33799f24-67f2-4fdc-b095-849edfb41a91/manager/0.log" Nov 04 05:04:22.291329 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:22.291286 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-669569fcd5t6vk7_28edcd93-5c3d-4846-947c-77e9f61e5bf6/istio-proxy/0.log" Nov 04 05:04:23.864601 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:23.864572 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-749f59598c-hpcfw_ca29bf28-a780-418a-ba50-9ff80af7d04c/istio-proxy/0.log" Nov 04 05:04:24.550193 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:04:24.550160 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d56d655f9-pdqrc_0f55afb7-c026-4ad5-afe1-6c133692689e/router/0.log" Nov 04 05:04:28.188877 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:04:28.188841 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:04:58.188738 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:04:58.188705 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:05:25.346777 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.346740 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f7wrj/must-gather-x2vfr"] Nov 04 05:05:25.351067 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.351044 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f7wrj/must-gather-x2vfr" Nov 04 05:05:25.404088 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.404050 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f7wrj/must-gather-x2vfr"] Nov 04 05:05:25.447144 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.447111 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f7wrj\"/\"openshift-service-ca.crt\"" Nov 04 05:05:25.447144 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.447119 4955 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f7wrj\"/\"default-dockercfg-kt2w6\"" Nov 04 05:05:25.447385 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.447159 4955 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f7wrj\"/\"kube-root-ca.crt\"" Nov 04 05:05:25.483125 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.483088 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgcfb\" (UniqueName: \"kubernetes.io/projected/966ae6b8-3fbb-4f6e-a821-6b345f8aecb7-kube-api-access-zgcfb\") pod \"must-gather-x2vfr\" (UID: \"966ae6b8-3fbb-4f6e-a821-6b345f8aecb7\") " pod="openshift-must-gather-f7wrj/must-gather-x2vfr" Nov 04 05:05:25.483307 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.483162 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/966ae6b8-3fbb-4f6e-a821-6b345f8aecb7-must-gather-output\") pod \"must-gather-x2vfr\" (UID: \"966ae6b8-3fbb-4f6e-a821-6b345f8aecb7\") " pod="openshift-must-gather-f7wrj/must-gather-x2vfr" Nov 04 05:05:25.583837 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.583798 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/966ae6b8-3fbb-4f6e-a821-6b345f8aecb7-must-gather-output\") pod \"must-gather-x2vfr\" (UID: \"966ae6b8-3fbb-4f6e-a821-6b345f8aecb7\") " pod="openshift-must-gather-f7wrj/must-gather-x2vfr" Nov 04 05:05:25.584025 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.583869 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgcfb\" (UniqueName: \"kubernetes.io/projected/966ae6b8-3fbb-4f6e-a821-6b345f8aecb7-kube-api-access-zgcfb\") pod \"must-gather-x2vfr\" (UID: \"966ae6b8-3fbb-4f6e-a821-6b345f8aecb7\") " pod="openshift-must-gather-f7wrj/must-gather-x2vfr" Nov 04 05:05:25.584165 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.584144 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/966ae6b8-3fbb-4f6e-a821-6b345f8aecb7-must-gather-output\") pod \"must-gather-x2vfr\" (UID: \"966ae6b8-3fbb-4f6e-a821-6b345f8aecb7\") " pod="openshift-must-gather-f7wrj/must-gather-x2vfr" Nov 04 05:05:25.640938 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.640870 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgcfb\" (UniqueName: \"kubernetes.io/projected/966ae6b8-3fbb-4f6e-a821-6b345f8aecb7-kube-api-access-zgcfb\") pod \"must-gather-x2vfr\" (UID: \"966ae6b8-3fbb-4f6e-a821-6b345f8aecb7\") " pod="openshift-must-gather-f7wrj/must-gather-x2vfr" Nov 04 05:05:25.664732 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:25.664707 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f7wrj/must-gather-x2vfr" Nov 04 05:05:26.035171 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:26.035092 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f7wrj/must-gather-x2vfr"] Nov 04 05:05:26.042143 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:05:26.042120 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod966ae6b8_3fbb_4f6e_a821_6b345f8aecb7.slice/crio-b88292284c890f7066be3014fc0aa8896a3352f2b464fab77da1a80dc80a2a32 WatchSource:0}: Error finding container b88292284c890f7066be3014fc0aa8896a3352f2b464fab77da1a80dc80a2a32: Status 404 returned error can't find the container with id b88292284c890f7066be3014fc0aa8896a3352f2b464fab77da1a80dc80a2a32 Nov 04 05:05:26.044359 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:26.044341 4955 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 05:05:26.569855 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:26.569820 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7wrj/must-gather-x2vfr" event={"ID":"966ae6b8-3fbb-4f6e-a821-6b345f8aecb7","Type":"ContainerStarted","Data":"b88292284c890f7066be3014fc0aa8896a3352f2b464fab77da1a80dc80a2a32"} Nov 04 05:05:28.188819 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:05:28.188784 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:05:28.581919 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:28.581876 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7wrj/must-gather-x2vfr" event={"ID":"966ae6b8-3fbb-4f6e-a821-6b345f8aecb7","Type":"ContainerStarted","Data":"96a64140bc5764e83a682f22170bbc6de772158d3fa6b69791f065c70fc8ae6c"} Nov 04 05:05:28.582117 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:28.581926 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7wrj/must-gather-x2vfr" event={"ID":"966ae6b8-3fbb-4f6e-a821-6b345f8aecb7","Type":"ContainerStarted","Data":"b28fd77357e81b7c193c930990a9375421a337d0184a021a0e29d46a45a604e7"} Nov 04 05:05:28.689386 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:28.689321 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-f7wrj/must-gather-x2vfr" podStartSLOduration=2.234187121 podStartE2EDuration="3.689300646s" totalImagesPullingTime="1.455113525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:05:28.688948915 +0000 UTC m=+1179.158775054" watchObservedRunningTime="2026-11-04 05:05:28.689300646 +0000 UTC m=+1179.159126787" Nov 04 05:05:34.388855 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:34.388827 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cnvdz_ebdb1c71-e1a0-4b8e-ad09-569ca1e6e70b/global-pull-secret-syncer/0.log" Nov 04 05:05:36.172153 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:36.172114 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-blxqr_e3dc8d87-0f90-48cc-9aec-f40a2fe78ba1/connection-checker/0.log" Nov 04 05:05:36.648280 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:36.647373 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-trz8n_d035486c-ba72-485c-88f9-0733ea426168/connection-checker/0.log" Nov 04 05:05:37.094166 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:37.094135 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-vc88q_70407c80-19ed-467f-a4a4-8ff150518aef/connection-checker/0.log" Nov 04 05:05:38.450178 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:38.450151 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qkwm9_fd26b2a0-3960-49b0-8d68-034665741c8a/konnectivity-agent/0.log" Nov 04 05:05:38.859844 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:38.859810 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-197.us-west-2.compute.internal_c77202defc6f17821d20368d232c24c4/haproxy/0.log" Nov 04 05:05:44.381713 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.381681 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-tsjpd_1645650e-6b70-4490-afc7-c0a5a01cb0a2/manager/0.log" Nov 04 05:05:44.397179 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.397147 4955 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9"] Nov 04 05:05:44.402725 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.402704 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.481414 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.481381 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-lib-modules\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.481610 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.481429 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-sys\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.481610 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.481524 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-proc\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.481707 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.481643 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px2xf\" (UniqueName: \"kubernetes.io/projected/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-kube-api-access-px2xf\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.481707 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.481686 4955 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-podres\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.483040 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.483016 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9"] Nov 04 05:05:44.582879 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.582837 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-proc\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.582879 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.582882 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px2xf\" (UniqueName: \"kubernetes.io/projected/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-kube-api-access-px2xf\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.583132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.582907 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-podres\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.583132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.582965 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-proc\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.583132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.582966 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-lib-modules\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.583132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.583034 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-lib-modules\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.583132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.583044 4955 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-sys\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.583132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.583041 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-podres\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.583132 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.583097 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-sys\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.640418 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.640334 4955 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px2xf\" (UniqueName: \"kubernetes.io/projected/9e2510f7-a4b6-4f4d-a5f5-8405aae468be-kube-api-access-px2xf\") pod \"perf-node-gather-daemonset-9fvd9\" (UID: \"9e2510f7-a4b6-4f4d-a5f5-8405aae468be\") " pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:44.715584 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:44.715550 4955 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:45.086121 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:45.086088 4955 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9"] Nov 04 05:05:45.093564 ip-10-0-132-197 kubenswrapper[4955]: W1104 05:05:45.093533 4955 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9e2510f7_a4b6_4f4d_a5f5_8405aae468be.slice/crio-0569145af3d66d10260285c74b91a271a0e691a024c52e7afd390750ae4355fa WatchSource:0}: Error finding container 0569145af3d66d10260285c74b91a271a0e691a024c52e7afd390750ae4355fa: Status 404 returned error can't find the container with id 0569145af3d66d10260285c74b91a271a0e691a024c52e7afd390750ae4355fa Nov 04 05:05:45.223565 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:45.223538 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-4bcz7_0f6fb1ad-822f-4305-8321-fc6c580014bf/kuadrant-console-plugin/0.log" Nov 04 05:05:45.739459 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:45.739426 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" event={"ID":"9e2510f7-a4b6-4f4d-a5f5-8405aae468be","Type":"ContainerStarted","Data":"0ccbca58f88abc56e362a70def9f1680871fe425a305f027169f24d734623e52"} Nov 04 05:05:45.739946 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:45.739486 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" event={"ID":"9e2510f7-a4b6-4f4d-a5f5-8405aae468be","Type":"ContainerStarted","Data":"0569145af3d66d10260285c74b91a271a0e691a024c52e7afd390750ae4355fa"} Nov 04 05:05:45.739946 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:45.739598 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:45.849420 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:45.849369 4955 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" podStartSLOduration=1.849352663 podStartE2EDuration="1.849352663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:05:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:05:45.84741789 +0000 UTC m=+1196.317244031" watchObservedRunningTime="2026-11-04 05:05:45.849352663 +0000 UTC m=+1196.319178818" Nov 04 05:05:46.633545 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:46.633509 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-fmp4l_33799f24-67f2-4fdc-b095-849edfb41a91/manager/0.log" Nov 04 05:05:49.791974 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:49.791948 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/2.log" Nov 04 05:05:49.795433 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:49.795406 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-tqfqb_6e75df29-4521-44fa-babe-a45b73155b91/console-operator/2.log" Nov 04 05:05:51.755894 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:51.755864 4955 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f7wrj/perf-node-gather-daemonset-9fvd9" Nov 04 05:05:52.094147 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:52.094123 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-fzt9v_d49dda15-d5d9-414e-b552-0d9bcab7bba0/cluster-monitoring-operator/0.log" Nov 04 05:05:54.607741 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:54.607708 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dqksz_7258d89b-22db-4890-9f48-dd1d80020143/node-exporter/0.log" Nov 04 05:05:54.803738 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:54.803698 4955 generic.go:356] "Generic (PLEG): container finished" podID="66d00d82-e56e-4856-a413-c4ca3974eaab" containerID="52ef05421e908362ace236d948ced21c6c95f1b073f5668d4e94412149e7e1ee" exitCode=0 Nov 04 05:05:54.803923 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:54.803767 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" event={"ID":"66d00d82-e56e-4856-a413-c4ca3974eaab","Type":"ContainerDied","Data":"52ef05421e908362ace236d948ced21c6c95f1b073f5668d4e94412149e7e1ee"} Nov 04 05:05:55.027053 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:55.026977 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dqksz_7258d89b-22db-4890-9f48-dd1d80020143/kube-rbac-proxy/0.log" Nov 04 05:05:55.446562 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:55.446531 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dqksz_7258d89b-22db-4890-9f48-dd1d80020143/init-textfile/0.log" Nov 04 05:05:55.969631 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:55.969607 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:05:56.102307 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.102223 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66d00d82-e56e-4856-a413-c4ca3974eaab-kube-api-access-2q648\" (UniqueName: \"kubernetes.io/projected/66d00d82-e56e-4856-a413-c4ca3974eaab-kube-api-access-2q648\") pod \"66d00d82-e56e-4856-a413-c4ca3974eaab\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " Nov 04 05:05:56.102470 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.102334 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-trusted-ca-bundle\") pod \"66d00d82-e56e-4856-a413-c4ca3974eaab\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " Nov 04 05:05:56.102470 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.102362 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-service-ca-bundle\") pod \"66d00d82-e56e-4856-a413-c4ca3974eaab\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " Nov 04 05:05:56.102470 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.102460 4955 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66d00d82-e56e-4856-a413-c4ca3974eaab-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/66d00d82-e56e-4856-a413-c4ca3974eaab-archives-path\") pod \"66d00d82-e56e-4856-a413-c4ca3974eaab\" (UID: \"66d00d82-e56e-4856-a413-c4ca3974eaab\") " Nov 04 05:05:56.102812 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.102774 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-trusted-ca-bundle" pod "66d00d82-e56e-4856-a413-c4ca3974eaab" (UID: "66d00d82-e56e-4856-a413-c4ca3974eaab"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:05:56.102812 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.102788 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-service-ca-bundle" pod "66d00d82-e56e-4856-a413-c4ca3974eaab" (UID: "66d00d82-e56e-4856-a413-c4ca3974eaab"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:05:56.102961 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.102787 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66d00d82-e56e-4856-a413-c4ca3974eaab-archives-path" pod "66d00d82-e56e-4856-a413-c4ca3974eaab" (UID: "66d00d82-e56e-4856-a413-c4ca3974eaab"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:56.104358 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.104336 4955 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66d00d82-e56e-4856-a413-c4ca3974eaab-kube-api-access-2q648" pod "66d00d82-e56e-4856-a413-c4ca3974eaab" (UID: "66d00d82-e56e-4856-a413-c4ca3974eaab"). InnerVolumeSpecName "kube-api-access-2q648". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:56.203937 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.203901 4955 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/66d00d82-e56e-4856-a413-c4ca3974eaab-archives-path\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:05:56.203937 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.203937 4955 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q648\" (UniqueName: \"kubernetes.io/projected/66d00d82-e56e-4856-a413-c4ca3974eaab-kube-api-access-2q648\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:05:56.204150 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.203951 4955 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-trusted-ca-bundle\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:05:56.204150 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.203964 4955 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66d00d82-e56e-4856-a413-c4ca3974eaab-service-ca-bundle\") on node \"ip-10-0-132-197.us-west-2.compute.internal\" DevicePath \"\"" Nov 04 05:05:56.816085 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.816060 4955 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" Nov 04 05:05:56.816305 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.816083 4955 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-h4hsc-jnpqh" event={"ID":"66d00d82-e56e-4856-a413-c4ca3974eaab","Type":"ContainerDied","Data":"b91b4742f4ce4623c18fbbe6c57778145e2750e084fe4edb0eb88c4d15dcd1ec"} Nov 04 05:05:56.816305 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:05:56.816140 4955 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b91b4742f4ce4623c18fbbe6c57778145e2750e084fe4edb0eb88c4d15dcd1ec" Nov 04 05:05:58.190999 ip-10-0-132-197 kubenswrapper[4955]: E1104 05:05:58.190963 4955 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-zwkrf" containerName="extractor" Nov 04 05:06:03.428123 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:06:03.428043 4955 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-jm58m_11f7f6b8-7884-4f43-ae05-eb294e4d3283/prometheus-operator-admission-webhook/0.log" Nov 04 05:06:05.054492 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:06:05.054420 4955 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz"] Nov 04 05:06:05.100301 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:06:05.100250 4955 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c15a6fe1-5xhcz"] Nov 04 05:06:05.654050 ip-10-0-132-197 kubenswrapper[4955]: I1104 05:06:05.654014 4955 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e65020ec-12d9-4bd4-8966-a8142208be4d" path="/var/lib/kubelet/pods/e65020ec-12d9-4bd4-8966-a8142208be4d/volumes"