Oct 30 23:34:39.895449 ip-10-0-138-47 systemd[1]: Starting Kubernetes Kubelet... Oct 30 23:34:40.312803 ip-10-0-138-47 kubenswrapper[2634]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 23:34:40.312803 ip-10-0-138-47 kubenswrapper[2634]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 23:34:40.312803 ip-10-0-138-47 kubenswrapper[2634]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 23:34:40.312803 ip-10-0-138-47 kubenswrapper[2634]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 23:34:40.317191 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317096 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:40.317191 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317190 2634 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:40.317191 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317193 2634 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:40.317191 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317197 2634 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317201 2634 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317204 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317206 2634 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317209 2634 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317212 2634 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317215 2634 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317217 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317220 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317223 2634 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317226 2634 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317228 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317231 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317233 2634 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317236 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317239 2634 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317241 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317244 2634 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317246 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:40.317312 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317249 2634 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317252 2634 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317262 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317265 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317269 2634 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317274 2634 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317277 2634 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317279 2634 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317282 2634 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317285 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317288 2634 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317290 2634 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317294 2634 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317296 2634 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317299 2634 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317303 2634 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317307 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317311 2634 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317314 2634 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:40.317757 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317318 2634 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317321 2634 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317324 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317328 2634 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317330 2634 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317335 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317338 2634 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317341 2634 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317344 2634 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317346 2634 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317349 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317352 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317354 2634 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317357 2634 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317359 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317362 2634 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317364 2634 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317367 2634 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317369 2634 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317372 2634 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:40.318218 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317374 2634 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317377 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317379 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317382 2634 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317385 2634 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317388 2634 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317390 2634 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317393 2634 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317396 2634 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317399 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317401 2634 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317404 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317406 2634 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317409 2634 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317411 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317414 2634 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317417 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317419 2634 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317422 2634 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317424 2634 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:40.318677 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317428 2634 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317430 2634 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317434 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317437 2634 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317439 2634 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317442 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317445 2634 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317447 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317450 2634 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317452 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317455 2634 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317457 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317461 2634 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317463 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317466 2634 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317468 2634 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317471 2634 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317473 2634 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317476 2634 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:40.319169 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317478 2634 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317481 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317484 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317487 2634 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317490 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.317492 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318265 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318273 2634 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318275 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318278 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318281 2634 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318283 2634 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318286 2634 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318289 2634 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318292 2634 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318295 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318298 2634 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318300 2634 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318303 2634 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318306 2634 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:40.319639 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318309 2634 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318311 2634 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318314 2634 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318316 2634 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318319 2634 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318323 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318325 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318328 2634 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318330 2634 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318333 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318336 2634 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318338 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318341 2634 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318344 2634 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318346 2634 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318349 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318351 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318354 2634 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318356 2634 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318359 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:40.320148 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318361 2634 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318364 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318366 2634 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318369 2634 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318371 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318374 2634 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318377 2634 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318381 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318384 2634 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318386 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318389 2634 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318392 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318394 2634 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318396 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318399 2634 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318401 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318404 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318407 2634 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318409 2634 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:40.320640 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318413 2634 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318416 2634 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318418 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318421 2634 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318424 2634 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318426 2634 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318430 2634 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318434 2634 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318437 2634 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318440 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318443 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318446 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318448 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318452 2634 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318455 2634 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318458 2634 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318461 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318464 2634 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318470 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:40.321093 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318472 2634 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318475 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318478 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318481 2634 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318484 2634 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318486 2634 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318489 2634 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318491 2634 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318494 2634 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318496 2634 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318499 2634 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318502 2634 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318504 2634 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318508 2634 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318511 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318514 2634 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318516 2634 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318519 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318521 2634 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318524 2634 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:40.321569 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318527 2634 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318529 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318532 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318534 2634 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318537 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318539 2634 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318542 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318544 2634 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318547 2634 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318549 2634 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318552 2634 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318557 2634 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318560 2634 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.318563 2634 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319044 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319049 2634 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319052 2634 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319055 2634 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319058 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:40.323037 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319060 2634 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319063 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319065 2634 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319068 2634 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319073 2634 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319076 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319079 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319081 2634 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319084 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319086 2634 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319089 2634 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319092 2634 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319094 2634 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319097 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319100 2634 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319102 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319105 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319108 2634 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319110 2634 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:40.323507 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319113 2634 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319116 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319119 2634 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319121 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319124 2634 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319128 2634 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319130 2634 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319132 2634 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319135 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319138 2634 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319141 2634 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319143 2634 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319146 2634 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319149 2634 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319151 2634 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319167 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319170 2634 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319174 2634 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319177 2634 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319180 2634 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:40.323964 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319182 2634 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319185 2634 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319188 2634 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319191 2634 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319193 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319196 2634 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319198 2634 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319201 2634 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319204 2634 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319206 2634 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319209 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319211 2634 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319214 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319216 2634 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319219 2634 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319221 2634 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319224 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319228 2634 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319230 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319233 2634 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:40.324467 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319236 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319238 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319241 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319244 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319246 2634 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319249 2634 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319251 2634 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319254 2634 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319256 2634 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319260 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319262 2634 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319265 2634 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319268 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319270 2634 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319274 2634 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319278 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319280 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319283 2634 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319286 2634 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319288 2634 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:40.324939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319291 2634 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319294 2634 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319296 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319298 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319302 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319305 2634 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319307 2634 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319309 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319312 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319316 2634 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319318 2634 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319321 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319323 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319327 2634 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319332 2634 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319335 2634 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319337 2634 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319340 2634 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319343 2634 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:40.325454 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319345 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319348 2634 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.319350 2634 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319443 2634 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319451 2634 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319457 2634 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319462 2634 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319467 2634 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319470 2634 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319474 2634 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319478 2634 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319482 2634 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319485 2634 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319488 2634 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319491 2634 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319494 2634 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319498 2634 flags.go:64] FLAG: --cgroup-root="" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319500 2634 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319504 2634 flags.go:64] FLAG: --client-ca-file="" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319506 2634 flags.go:64] FLAG: --cloud-provider="external" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319510 2634 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319515 2634 flags.go:64] FLAG: --cluster-domain="" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319519 2634 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319523 2634 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 23:34:40.325971 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319526 2634 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319529 2634 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319533 2634 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319536 2634 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319539 2634 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319543 2634 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319546 2634 flags.go:64] FLAG: --contention-profiling="false" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319549 2634 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319552 2634 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319556 2634 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319558 2634 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319563 2634 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319566 2634 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319569 2634 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319571 2634 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319574 2634 flags.go:64] FLAG: --enable-server="true" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319577 2634 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319581 2634 flags.go:64] FLAG: --event-burst="100" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319584 2634 flags.go:64] FLAG: --event-qps="50" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319587 2634 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319590 2634 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319593 2634 flags.go:64] FLAG: --eviction-hard="" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319597 2634 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319600 2634 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319603 2634 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 23:34:40.326569 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319606 2634 flags.go:64] FLAG: --eviction-soft="" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319609 2634 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319612 2634 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319615 2634 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319618 2634 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319622 2634 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319625 2634 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319628 2634 flags.go:64] FLAG: --feature-gates="" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319632 2634 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319636 2634 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319639 2634 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319642 2634 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319645 2634 flags.go:64] FLAG: --healthz-port="10248" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319649 2634 flags.go:64] FLAG: --help="false" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319652 2634 flags.go:64] FLAG: --hostname-override="ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319655 2634 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319658 2634 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319661 2634 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319665 2634 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319668 2634 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319671 2634 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319674 2634 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319677 2634 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 23:34:40.327209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319680 2634 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319683 2634 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319686 2634 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319689 2634 flags.go:64] FLAG: --kube-reserved="" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319691 2634 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319694 2634 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319697 2634 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319700 2634 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319703 2634 flags.go:64] FLAG: --lock-file="" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319706 2634 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319710 2634 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319714 2634 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319719 2634 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319722 2634 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319726 2634 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319729 2634 flags.go:64] FLAG: --logging-format="text" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319732 2634 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319735 2634 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319738 2634 flags.go:64] FLAG: --manifest-url="" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319741 2634 flags.go:64] FLAG: --manifest-url-header="" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319745 2634 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319749 2634 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319752 2634 flags.go:64] FLAG: --max-pods="110" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319756 2634 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319759 2634 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 23:34:40.327752 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319762 2634 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319765 2634 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319768 2634 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319770 2634 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319773 2634 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319780 2634 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319783 2634 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319786 2634 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319789 2634 flags.go:64] FLAG: --pod-cidr="" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319792 2634 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319794 2634 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319797 2634 flags.go:64] FLAG: --pods-per-core="0" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319800 2634 flags.go:64] FLAG: --port="10250" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319803 2634 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319806 2634 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0196086e017f8c9e7" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319809 2634 flags.go:64] FLAG: --qos-reserved="" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319812 2634 flags.go:64] FLAG: --read-only-port="10255" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319816 2634 flags.go:64] FLAG: --register-node="true" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319819 2634 flags.go:64] FLAG: --register-with-taints="" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319823 2634 flags.go:64] FLAG: --registry-burst="10" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319826 2634 flags.go:64] FLAG: --registry-qps="5" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319829 2634 flags.go:64] FLAG: --reserved-cpus="" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319832 2634 flags.go:64] FLAG: --reserved-memory="" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319836 2634 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319839 2634 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319842 2634 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 23:34:40.328353 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319844 2634 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319847 2634 flags.go:64] FLAG: --runonce="false" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319850 2634 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319853 2634 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319856 2634 flags.go:64] FLAG: --seccomp-default="false" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319860 2634 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319863 2634 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319866 2634 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319869 2634 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319872 2634 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319875 2634 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319878 2634 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319881 2634 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319883 2634 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319886 2634 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319889 2634 flags.go:64] FLAG: --system-cgroups="" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319892 2634 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319897 2634 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319900 2634 flags.go:64] FLAG: --tls-cert-file="" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319903 2634 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319907 2634 flags.go:64] FLAG: --tls-min-version="" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319910 2634 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319913 2634 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319917 2634 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319920 2634 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 23:34:40.329008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319923 2634 flags.go:64] FLAG: --v="2" Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319926 2634 flags.go:64] FLAG: --version="false" Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319931 2634 flags.go:64] FLAG: --vmodule="" Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319934 2634 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.319938 2634 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320061 2634 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320065 2634 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320068 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320070 2634 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320073 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320076 2634 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320078 2634 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320081 2634 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320084 2634 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320087 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320090 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320092 2634 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320095 2634 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320097 2634 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320100 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320102 2634 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:40.329616 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320105 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320107 2634 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320110 2634 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320112 2634 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320115 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320117 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320119 2634 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320122 2634 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320125 2634 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320128 2634 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320131 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320134 2634 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320136 2634 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320139 2634 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320141 2634 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320144 2634 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320147 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320149 2634 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320152 2634 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320166 2634 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:40.330116 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320169 2634 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320172 2634 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320175 2634 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320178 2634 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320180 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320184 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320187 2634 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320191 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320193 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320196 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320199 2634 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320202 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320204 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320206 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320209 2634 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320212 2634 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320214 2634 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320217 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320219 2634 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:40.330591 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320222 2634 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320224 2634 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320228 2634 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320232 2634 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320236 2634 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320239 2634 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320242 2634 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320245 2634 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320247 2634 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320250 2634 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320252 2634 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320255 2634 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320257 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320260 2634 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320262 2634 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320265 2634 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320268 2634 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320270 2634 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320273 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:40.331046 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320276 2634 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320279 2634 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320282 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320285 2634 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320287 2634 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320290 2634 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320292 2634 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320295 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320297 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320300 2634 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320302 2634 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320305 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320307 2634 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320310 2634 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320312 2634 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320316 2634 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320319 2634 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320321 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320324 2634 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320326 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:40.331558 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320329 2634 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320331 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320334 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320336 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320339 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320342 2634 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320346 2634 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320349 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320351 2634 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320354 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320357 2634 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320359 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.320384 2634 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320421 2634 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320427 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320431 2634 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:40.332023 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320433 2634 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320436 2634 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320439 2634 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320441 2634 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320444 2634 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320446 2634 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320449 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320451 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320453 2634 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320456 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320459 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320463 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320465 2634 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320468 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320471 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320473 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320476 2634 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320479 2634 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320481 2634 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:40.332446 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320484 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320486 2634 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320489 2634 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320491 2634 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320493 2634 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320498 2634 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320501 2634 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320504 2634 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320506 2634 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320509 2634 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320511 2634 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320516 2634 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320519 2634 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320521 2634 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320524 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320526 2634 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320529 2634 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320532 2634 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320534 2634 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:40.332916 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320536 2634 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320539 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320542 2634 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320544 2634 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320547 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320551 2634 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320554 2634 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320557 2634 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320559 2634 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320562 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320564 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320567 2634 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320569 2634 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320572 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320575 2634 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320577 2634 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320580 2634 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320582 2634 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320585 2634 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:40.333381 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320587 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320590 2634 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320592 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320595 2634 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320597 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320601 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320604 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320607 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320611 2634 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320615 2634 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320618 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320620 2634 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320624 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320626 2634 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320629 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320632 2634 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320634 2634 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320637 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320641 2634 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320644 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:40.333842 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320647 2634 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320649 2634 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320652 2634 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320655 2634 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320657 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320660 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320663 2634 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320665 2634 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320668 2634 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320670 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320673 2634 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320675 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320678 2634 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320680 2634 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320683 2634 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320686 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320688 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320692 2634 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320695 2634 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320698 2634 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:40.334373 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320701 2634 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320704 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320706 2634 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320709 2634 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320712 2634 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.320715 2634 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.328396 2634 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.328414 2634 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.328426 2634 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.328434 2634 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328499 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328505 2634 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328510 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328514 2634 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328518 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328520 2634 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328523 2634 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328526 2634 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328529 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:40.334872 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328531 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328534 2634 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328537 2634 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328539 2634 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328542 2634 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328544 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328547 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328550 2634 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328553 2634 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328555 2634 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328558 2634 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328560 2634 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328563 2634 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328566 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328568 2634 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328571 2634 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328574 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328576 2634 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328579 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:40.335345 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328582 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328590 2634 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328594 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328596 2634 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328599 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328601 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328604 2634 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328608 2634 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328612 2634 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328615 2634 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328618 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328621 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328624 2634 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328626 2634 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328629 2634 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328632 2634 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328634 2634 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328637 2634 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328639 2634 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:40.335835 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328642 2634 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328645 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328647 2634 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328650 2634 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328652 2634 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328655 2634 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328657 2634 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328661 2634 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328663 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328666 2634 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328668 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328671 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328673 2634 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328676 2634 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328679 2634 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328689 2634 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328692 2634 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328694 2634 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328697 2634 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328700 2634 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:40.336288 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328702 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328705 2634 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328707 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328710 2634 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328712 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328715 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328717 2634 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328720 2634 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328723 2634 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328725 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328728 2634 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328731 2634 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328733 2634 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328736 2634 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328738 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328741 2634 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328744 2634 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328746 2634 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328748 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:40.336747 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328752 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328754 2634 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328757 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328759 2634 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328762 2634 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328765 2634 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328767 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328770 2634 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328773 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328781 2634 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328784 2634 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328787 2634 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328789 2634 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328792 2634 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328794 2634 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328797 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328799 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328802 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328804 2634 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:40.337198 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.328807 2634 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.328835 2634 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329045 2634 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329049 2634 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329053 2634 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329056 2634 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329059 2634 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329063 2634 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329066 2634 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329069 2634 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329072 2634 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329075 2634 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329077 2634 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329080 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329083 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329086 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:40.337653 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329088 2634 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329091 2634 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329094 2634 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329096 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329099 2634 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329102 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329104 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329114 2634 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329118 2634 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329121 2634 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329123 2634 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329126 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329129 2634 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329131 2634 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329134 2634 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329136 2634 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329139 2634 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329141 2634 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329144 2634 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:40.338027 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329146 2634 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329149 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329152 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329167 2634 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329172 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329175 2634 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329179 2634 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329182 2634 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329185 2634 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329187 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329190 2634 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329193 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329195 2634 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329198 2634 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329201 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329203 2634 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329206 2634 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329209 2634 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329211 2634 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329214 2634 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:40.338483 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329216 2634 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329228 2634 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329231 2634 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329234 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329236 2634 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329239 2634 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329242 2634 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329244 2634 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329247 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329249 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329252 2634 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329254 2634 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329257 2634 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329259 2634 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329262 2634 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329264 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329267 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329269 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329271 2634 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329274 2634 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:40.338939 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329277 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329279 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329282 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329291 2634 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329293 2634 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329296 2634 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329298 2634 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329301 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329304 2634 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329307 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329309 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329311 2634 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329314 2634 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329316 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329330 2634 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329334 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329337 2634 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329340 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329343 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:40.339713 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329346 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329349 2634 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329352 2634 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329354 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329356 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329359 2634 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329361 2634 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329364 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329366 2634 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329369 2634 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329371 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329374 2634 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329377 2634 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329380 2634 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.329403 2634 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329442 2634 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:34:40.340622 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329446 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329449 2634 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329452 2634 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329454 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329457 2634 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329460 2634 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329463 2634 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329466 2634 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329468 2634 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329471 2634 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329473 2634 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329476 2634 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329487 2634 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329490 2634 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329492 2634 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329495 2634 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329497 2634 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329500 2634 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329502 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329505 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:34:40.341068 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329507 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329510 2634 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329513 2634 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329515 2634 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329518 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329520 2634 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329523 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329525 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329529 2634 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329533 2634 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329536 2634 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329538 2634 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329541 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329544 2634 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329546 2634 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329549 2634 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329551 2634 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329554 2634 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329557 2634 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:34:40.341573 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329559 2634 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329562 2634 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329565 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329567 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329570 2634 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329572 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329581 2634 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329584 2634 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329586 2634 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329589 2634 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329591 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329594 2634 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329597 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329599 2634 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329601 2634 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329604 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329607 2634 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329610 2634 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329613 2634 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329615 2634 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:34:40.342028 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329617 2634 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329620 2634 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329623 2634 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329626 2634 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329629 2634 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329631 2634 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329634 2634 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329636 2634 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329639 2634 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329641 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329646 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329649 2634 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329652 2634 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329654 2634 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329657 2634 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329659 2634 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329662 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329664 2634 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329667 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329675 2634 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:34:40.342563 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329678 2634 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329681 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329683 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329686 2634 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329688 2634 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329691 2634 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329694 2634 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329696 2634 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329699 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329702 2634 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329704 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329707 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329709 2634 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329712 2634 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329714 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329719 2634 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329723 2634 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329726 2634 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329729 2634 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:34:40.343022 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329731 2634 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329734 2634 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329736 2634 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329740 2634 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329743 2634 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329745 2634 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:40.329748 2634 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.329808 2634 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.332296 2634 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.333409 2634 server.go:1014] "Starting client certificate rotation" Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.333513 2634 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.333554 2634 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.335868 2634 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 23:34:40.343696 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.337363 2634 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 23:34:40.349677 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.349651 2634 log.go:25] "Validated CRI v1 runtime API" Oct 30 23:34:40.353485 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.353472 2634 log.go:25] "Validated CRI v1 image API" Oct 30 23:34:40.354315 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.354292 2634 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 23:34:40.357599 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.357578 2634 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 94f92131-9ed5-4f6d-b198-c45c1cee60ce:/dev/nvme0n1p4 d365ec25-25a4-4ec6-9760-d89e06d741f0:/dev/nvme0n1p3] Oct 30 23:34:40.357685 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.357598 2634 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 23:34:40.362943 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.362830 2634 manager.go:217] Machine: {Timestamp:2026-10-30 23:34:40.361315023 +0000 UTC m=+0.370614827 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3084710 MemoryCapacity:33164320768 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27bd2a3b568c91eae2d507564ccf5a SystemUUID:ec27bd2a-3b56-8c91-eae2-d507564ccf5a BootID:c28e2a69-12f9-49ef-a521-45cddae48f39 Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582160384 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582160384 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d3:a5:7e:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d3:a5:7e:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:71:ec:87:e7:54 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164320768 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 23:34:40.362943 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.362941 2634 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 23:34:40.363105 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.363044 2634 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 23:34:40.365217 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.365188 2634 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 23:34:40.365385 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.365218 2634 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-47.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 23:34:40.365462 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.365389 2634 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 23:34:40.365462 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.365402 2634 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 23:34:40.365462 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.365445 2634 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 23:34:40.365567 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.365464 2634 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 23:34:40.366674 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.366660 2634 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 23:34:40.371120 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.371105 2634 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 23:34:40.371266 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.371255 2634 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 23:34:40.372112 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.372102 2634 kubelet.go:493] "Attempting to sync node with API server" Oct 30 23:34:40.372180 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.372118 2634 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 23:34:40.372180 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.372137 2634 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 23:34:40.372180 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.372151 2634 kubelet.go:405] "Adding apiserver pod source" Oct 30 23:34:40.372180 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.372177 2634 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 23:34:40.372555 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.372541 2634 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 23:34:40.375129 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.375113 2634 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 23:34:40.382829 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.382815 2634 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 23:34:40.383688 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.383675 2634 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 23:34:40.383736 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.383706 2634 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 23:34:40.383851 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.383841 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 23:34:40.383881 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.383857 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 23:34:40.383881 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.383863 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 23:34:40.383881 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.383868 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 23:34:40.383881 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.383874 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 23:34:40.383881 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.383879 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 23:34:40.384734 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.384725 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 23:34:40.384767 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.384735 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 23:34:40.384767 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.384742 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 23:34:40.384767 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.384748 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 23:34:40.384767 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.384757 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 23:34:40.384767 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.384767 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 23:34:40.386094 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.386085 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 23:34:40.386134 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.386095 2634 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 23:34:40.389908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.389895 2634 server.go:1263] "Started kubelet" Oct 30 23:34:40.390022 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.389988 2634 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 23:34:40.390128 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.390011 2634 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 23:34:40.390219 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.390202 2634 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 23:34:40.390657 ip-10-0-138-47 systemd[1]: Started Kubernetes Kubelet. Oct 30 23:34:40.396861 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.396838 2634 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 23:34:40.398797 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.398777 2634 server.go:317] "Adding debug handlers to kubelet server" Oct 30 23:34:40.403321 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.403306 2634 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 23:34:40.403412 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.403363 2634 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 23:34:40.403822 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:40.403472 2634 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-47.ec2.internal\" not found" Oct 30 23:34:40.403822 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:40.403531 2634 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 23:34:40.404228 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.404209 2634 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 23:34:40.404228 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.404215 2634 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 23:34:40.404370 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.404238 2634 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 23:34:40.404370 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.404307 2634 reconstruct.go:97] "Volume reconstruction finished" Oct 30 23:34:40.404370 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.404316 2634 reconciler.go:29] "Reconciler: start to sync state" Oct 30 23:34:40.405917 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.405897 2634 factory.go:55] Registering systemd factory Oct 30 23:34:40.405917 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.405918 2634 factory.go:223] Registration of the systemd container factory successfully Oct 30 23:34:40.406213 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.406196 2634 factory.go:153] Registering CRI-O factory Oct 30 23:34:40.406213 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.406210 2634 factory.go:223] Registration of the crio container factory successfully Oct 30 23:34:40.406296 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.406260 2634 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 23:34:40.406296 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.406278 2634 factory.go:103] Registering Raw factory Oct 30 23:34:40.406296 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.406295 2634 manager.go:1199] Started watching for new ooms in manager Oct 30 23:34:40.407498 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.407484 2634 manager.go:319] Starting recovery of all containers Oct 30 23:34:40.418341 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.418325 2634 manager.go:324] Recovery completed Oct 30 23:34:40.420880 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.420828 2634 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-47.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 23:34:40.420880 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:40.420824 2634 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 23:34:40.421972 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:40.420825 2634 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-47.ec2.internal.18e372c81aa86209 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-47.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-47.ec2.internal,},FirstTimestamp:2026-10-30 23:34:40.389857801 +0000 UTC m=+0.399157604,LastTimestamp:2026-10-30 23:34:40.389857801 +0000 UTC m=+0.399157604,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-47.ec2.internal,}" Oct 30 23:34:40.424085 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.424067 2634 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 23:34:40.425934 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.425905 2634 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeHasSufficientMemory" Oct 30 23:34:40.426022 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.425949 2634 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 23:34:40.426022 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.425962 2634 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeHasSufficientPID" Oct 30 23:34:40.426257 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.426214 2634 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 23:34:40.426316 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.426309 2634 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pdhfz" Oct 30 23:34:40.426595 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.426583 2634 cpu_manager.go:226] "Starting" policy="none" Oct 30 23:34:40.426653 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.426595 2634 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 23:34:40.426653 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.426611 2634 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 23:34:40.426709 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.426590 2634 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 23:34:40.427396 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.427379 2634 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeHasSufficientMemory" Oct 30 23:34:40.427475 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.427406 2634 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 23:34:40.427475 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.427419 2634 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeHasSufficientPID" Oct 30 23:34:40.429727 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.429710 2634 policy_none.go:50] "Start" Oct 30 23:34:40.430386 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.430376 2634 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 23:34:40.430423 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.430390 2634 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 23:34:40.432374 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.432362 2634 policy_none.go:44] "Start" Oct 30 23:34:40.451765 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.451746 2634 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:34:40.453430 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.453409 2634 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:34:40.467221 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.467190 2634 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 23:34:40.469759 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.469743 2634 manager.go:341] "Starting Device Plugin manager" Oct 30 23:34:40.470388 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:40.470369 2634 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 23:34:40.470438 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.470391 2634 server.go:87] "Starting device plugin registration server" Oct 30 23:34:40.470638 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.470627 2634 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 23:34:40.470668 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.470642 2634 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 23:34:40.470880 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.470738 2634 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 23:34:40.470880 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.470817 2634 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 23:34:40.470880 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.470825 2634 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 23:34:40.471340 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:40.471311 2634 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 23:34:40.471417 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:40.471354 2634 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-47.ec2.internal\" not found" Oct 30 23:34:40.478970 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.478948 2634 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:34:40.529341 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.529314 2634 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 23:34:40.531326 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.530408 2634 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 23:34:40.531326 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.530424 2634 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 23:34:40.531326 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.530444 2634 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 23:34:40.531326 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:40.530474 2634 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 23:34:40.546358 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.546337 2634 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:34:40.571143 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.571101 2634 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 23:34:40.572280 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.572264 2634 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeHasSufficientMemory" Oct 30 23:34:40.572362 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.572297 2634 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 23:34:40.572362 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.572312 2634 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeHasSufficientPID" Oct 30 23:34:40.572362 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.572343 2634 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.591988 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.591961 2634 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.591988 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:40.591980 2634 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-47.ec2.internal\": node \"ip-10-0-138-47.ec2.internal\" not found" Oct 30 23:34:40.631323 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.631296 2634 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal"] Oct 30 23:34:40.633701 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.633687 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.635599 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.635582 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.667584 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.667569 2634 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.670293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.670278 2634 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.690845 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.690829 2634 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 23:34:40.694008 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.693994 2634 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 23:34:40.806403 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.806370 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ac66232dff389c81bfae9a48be8f6b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" (UID: \"6ac66232dff389c81bfae9a48be8f6b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.806403 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.806405 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ac66232dff389c81bfae9a48be8f6b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" (UID: \"6ac66232dff389c81bfae9a48be8f6b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.806574 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.806425 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb43bc9abe76bb2220c1657ae80c7c48-config\") pod \"kube-apiserver-proxy-ip-10-0-138-47.ec2.internal\" (UID: \"eb43bc9abe76bb2220c1657ae80c7c48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.906915 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.906834 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ac66232dff389c81bfae9a48be8f6b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" (UID: \"6ac66232dff389c81bfae9a48be8f6b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.906915 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.906874 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ac66232dff389c81bfae9a48be8f6b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" (UID: \"6ac66232dff389c81bfae9a48be8f6b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.906915 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.906897 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb43bc9abe76bb2220c1657ae80c7c48-config\") pod \"kube-apiserver-proxy-ip-10-0-138-47.ec2.internal\" (UID: \"eb43bc9abe76bb2220c1657ae80c7c48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.907111 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.906946 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb43bc9abe76bb2220c1657ae80c7c48-config\") pod \"kube-apiserver-proxy-ip-10-0-138-47.ec2.internal\" (UID: \"eb43bc9abe76bb2220c1657ae80c7c48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.907111 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.906947 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ac66232dff389c81bfae9a48be8f6b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" (UID: \"6ac66232dff389c81bfae9a48be8f6b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.907111 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.906949 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ac66232dff389c81bfae9a48be8f6b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" (UID: \"6ac66232dff389c81bfae9a48be8f6b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.994839 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.994816 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:34:40.997949 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:40.997927 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:34:41.334072 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.333827 2634 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 23:34:41.334596 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.334170 2634 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 23:34:41.334596 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.334212 2634 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 23:34:41.334596 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.334223 2634 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 23:34:41.372430 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.372408 2634 apiserver.go:52] "Watching apiserver" Oct 30 23:34:41.404230 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.404205 2634 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 23:34:41.424306 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.423018 2634 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 23:34:41.424306 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.424091 2634 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-hszwb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal","openshift-multus/multus-additional-cni-plugins-gx66m","openshift-network-operator/iptables-alerter-9mljf","openshift-ovn-kubernetes/ovnkube-node-jxjlg","kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal","openshift-network-diagnostics/network-check-target-d7mfp","openshift-dns/node-resolver-czdjt","openshift-multus/multus-rh7rt","kube-system/global-pull-secret-syncer-dhk5w","kube-system/konnectivity-agent-rbrcx","openshift-cluster-node-tuning-operator/tuned-zvhlw","openshift-multus/network-metrics-daemon-bgt8k","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh"] Oct 30 23:34:41.426937 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.426917 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:34:41.429601 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.429581 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.432124 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.432086 2634 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 23:29:41 +0000 UTC" deadline="2028-04-20 16:00:46.687351036 +0000 UTC" Oct 30 23:34:41.432124 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.432121 2634 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12904h26m5.255232415s" Oct 30 23:34:41.432258 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.432222 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:34:41.434991 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.434972 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.437316 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.437298 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:41.437392 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.437377 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:34:41.439535 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.439522 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-czdjt" Oct 30 23:34:41.441812 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.441797 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.442084 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.442062 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 23:34:41.442185 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.442132 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 23:34:41.442278 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.442265 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 23:34:41.442429 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.442418 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jsrq7\"" Oct 30 23:34:41.444038 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.444024 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 23:34:41.444200 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.444185 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 23:34:41.444325 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.444234 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:41.444325 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.444270 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-65zfb\"" Oct 30 23:34:41.444437 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.444323 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:34:41.444437 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.444384 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 23:34:41.444514 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.444460 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 23:34:41.446651 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.446634 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:34:41.447288 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.447270 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:34:41.447405 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.447309 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 23:34:41.447405 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.447318 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 23:34:41.447405 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.447345 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8ljqd\"" Oct 30 23:34:41.447405 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.447377 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 23:34:41.449069 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.449055 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.450722 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.450707 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 23:34:41.451666 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.451454 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:41.451666 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.451526 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:34:41.453811 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.453796 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.454626 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.454608 2634 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 23:34:41.454734 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.454668 2634 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5t792" Oct 30 23:34:41.458859 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.458842 2634 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5t792" Oct 30 23:34:41.505018 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.504999 2634 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 23:34:41.509999 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.509981 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-slash\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.510086 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510028 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.510086 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510057 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-log-socket\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.510199 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510104 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-tmp\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.510199 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510154 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d559e44-7c9d-464e-be57-884cff742118-host\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:34:41.510199 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510192 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.510426 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510233 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49jkb\" (UniqueName: \"kubernetes.io/projected/00844e37-d582-444e-ae95-a498060b4519-kube-api-access-49jkb\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.510426 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510257 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-var-lib-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.510426 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510297 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-multus-certs\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.510426 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510336 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysctl-d\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.510426 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510353 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-var-lib-kubelet\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.510426 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510377 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-etc-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.510426 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510408 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysconfig\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.510739 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510433 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-systemd\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.510739 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510458 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjvrc\" (UniqueName: \"kubernetes.io/projected/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-kube-api-access-wjvrc\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.510739 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510507 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.510739 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510676 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-system-cni-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.510739 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510711 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-k8s-cni-cncf-io\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.510739 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510737 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-etc-kubernetes\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.510978 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510779 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf-agent-certs\") pod \"konnectivity-agent-rbrcx\" (UID: \"e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf\") " pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:34:41.510978 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510810 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysctl-conf\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.510978 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510834 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-tuned\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.510978 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510862 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24d5c\" (UniqueName: \"kubernetes.io/projected/48c3e89e-58f0-40af-9c40-63be495d5482-kube-api-access-24d5c\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:41.510978 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510882 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-kubelet\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.510978 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510908 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-socket-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.510978 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510926 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d559e44-7c9d-464e-be57-884cff742118-serviceca\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:34:41.510978 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510957 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-cnibin\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.511262 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.510988 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-node-log\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.511262 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511019 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-cnibin\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.511262 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511039 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rbfk\" (UniqueName: \"kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk\") pod \"network-check-target-d7mfp\" (UID: \"c3fdf510-52fb-4e1e-92c9-5208cb680d05\") " pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:41.511262 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511079 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf-konnectivity-ca\") pod \"konnectivity-agent-rbrcx\" (UID: \"e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf\") " pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:34:41.511262 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511106 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-run\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.511262 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511163 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-systemd-units\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.511262 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511209 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-systemd\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.511262 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511230 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v45fc\" (UniqueName: \"kubernetes.io/projected/b44eee82-b560-4cab-8804-b1e77523635b-kube-api-access-v45fc\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:34:41.511524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511294 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1cc7c057-2789-4df5-8370-2244dc2f5d8b-kubelet-config\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:41.511524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511330 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-sys\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.511524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511416 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.511524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511442 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.511524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511458 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16cf618c-6b7c-463c-9501-b27e41b837cc-host-slash\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:34:41.511748 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511522 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-run-netns\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.511748 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511553 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:41.511748 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511581 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-kubernetes\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.511748 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511624 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.511748 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511650 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovnkube-script-lib\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.511748 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511681 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/377989f5-3ed6-4546-9722-b341f03c8e39-cni-binary-copy\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.511748 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511702 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-ovn\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.511748 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511723 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.512117 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511748 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgpxd\" (UniqueName: \"kubernetes.io/projected/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-kube-api-access-xgpxd\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.512117 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511774 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:41.512117 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511809 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-device-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.512117 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511840 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-cni-bin\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.512117 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511865 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx6m2\" (UniqueName: \"kubernetes.io/projected/0c018322-20cb-470c-ae55-7eaddfbb60ea-kube-api-access-jx6m2\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.512117 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511928 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-etc-selinux\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.512117 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.511991 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-cni-netd\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.512117 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.512016 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovn-node-metrics-cert\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.512117 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.512048 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b44eee82-b560-4cab-8804-b1e77523635b-tmp-dir\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:34:41.512117 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.512072 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-cni-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.512609 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.512088 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/377989f5-3ed6-4546-9722-b341f03c8e39-multus-daemon-config\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.512609 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.512580 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-host\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.512714 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.512661 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-registration-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.512793 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.512757 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b44eee82-b560-4cab-8804-b1e77523635b-hosts-file\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:34:41.512881 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.512842 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-hostroot\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.512948 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.512931 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltd62\" (UniqueName: \"kubernetes.io/projected/377989f5-3ed6-4546-9722-b341f03c8e39-kube-api-access-ltd62\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.513005 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.512972 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-modprobe-d\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.513079 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513065 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-sys-fs\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.513149 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513132 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovnkube-config\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.513209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513168 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-netns\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.513288 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513220 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-kubelet\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.513288 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513271 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-conf-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.513391 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513350 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1cc7c057-2789-4df5-8370-2244dc2f5d8b-dbus\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:41.513391 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513380 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-lib-modules\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.513498 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513454 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw585\" (UniqueName: \"kubernetes.io/projected/9d559e44-7c9d-464e-be57-884cff742118-kube-api-access-gw585\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:34:41.513498 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513490 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-system-cni-dir\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.513605 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513552 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16cf618c-6b7c-463c-9501-b27e41b837cc-iptables-alerter-script\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:34:41.513672 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513593 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-cni-bin\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.513726 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513668 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-cni-multus\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.513783 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513734 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-cni-binary-copy\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.513783 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513769 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prrbs\" (UniqueName: \"kubernetes.io/projected/16cf618c-6b7c-463c-9501-b27e41b837cc-kube-api-access-prrbs\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:34:41.513889 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.513832 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-env-overrides\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.514137 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.514111 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-socket-dir-parent\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.550656 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.550633 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 23:34:41.550765 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.550750 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 23:34:41.550992 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.550970 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wrqrm\"" Oct 30 23:34:41.551087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.551000 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 23:34:41.551148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.551131 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 23:34:41.551363 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.551343 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 23:34:41.551450 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.551370 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 23:34:41.551450 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.551390 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 23:34:41.551584 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.551464 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 23:34:41.551584 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.551473 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 23:34:41.551584 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.551496 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:34:41.551584 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.551516 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-swxmn\"" Oct 30 23:34:41.551584 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.551520 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 23:34:41.551584 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.551516 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 23:34:41.551584 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.551553 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 23:34:41.562513 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.562491 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2bmqg\"" Oct 30 23:34:41.562513 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.562502 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mp8rg\"" Oct 30 23:34:41.562703 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.562520 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l52wg\"" Oct 30 23:34:41.562703 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.562527 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 23:34:41.562703 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.562551 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-5t726\"" Oct 30 23:34:41.563880 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.563866 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 23:34:41.615106 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615071 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-cni-bin\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.615106 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615096 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-cni-bin\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615153 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6m2\" (UniqueName: \"kubernetes.io/projected/0c018322-20cb-470c-ae55-7eaddfbb60ea-kube-api-access-jx6m2\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615184 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-etc-selinux\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615204 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-cni-netd\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615234 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovn-node-metrics-cert\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615259 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b44eee82-b560-4cab-8804-b1e77523635b-tmp-dir\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615284 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-cni-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615306 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/377989f5-3ed6-4546-9722-b341f03c8e39-multus-daemon-config\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615313 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-cni-netd\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615328 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-host\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615360 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-etc-selinux\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615402 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-registration-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615389 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-host\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615455 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b44eee82-b560-4cab-8804-b1e77523635b-hosts-file\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:34:41.615464 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615456 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-cni-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615502 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-hostroot\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615512 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-registration-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615535 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b44eee82-b560-4cab-8804-b1e77523635b-hosts-file\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615588 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltd62\" (UniqueName: \"kubernetes.io/projected/377989f5-3ed6-4546-9722-b341f03c8e39-kube-api-access-ltd62\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615615 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-hostroot\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615656 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-modprobe-d\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615697 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b44eee82-b560-4cab-8804-b1e77523635b-tmp-dir\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615689 2634 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615764 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-sys-fs\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615790 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovnkube-config\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615811 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-netns\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615834 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-modprobe-d\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615875 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-sys-fs\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615893 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-netns\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615880 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-kubelet\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615915 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-kubelet\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615930 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-conf-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.616293 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615955 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1cc7c057-2789-4df5-8370-2244dc2f5d8b-dbus\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615965 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-conf-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.615979 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-lib-modules\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616005 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw585\" (UniqueName: \"kubernetes.io/projected/9d559e44-7c9d-464e-be57-884cff742118-kube-api-access-gw585\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616026 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1cc7c057-2789-4df5-8370-2244dc2f5d8b-dbus\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616030 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-system-cni-dir\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616034 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/377989f5-3ed6-4546-9722-b341f03c8e39-multus-daemon-config\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616079 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16cf618c-6b7c-463c-9501-b27e41b837cc-iptables-alerter-script\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616108 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-cni-bin\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616134 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-cni-multus\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616179 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-cni-binary-copy\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616215 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-cni-bin\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616220 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prrbs\" (UniqueName: \"kubernetes.io/projected/16cf618c-6b7c-463c-9501-b27e41b837cc-kube-api-access-prrbs\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616153 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-lib-modules\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616266 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-cni-multus\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616106 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-system-cni-dir\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616278 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-env-overrides\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.617345 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616307 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-socket-dir-parent\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616332 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-slash\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616366 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616427 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-log-socket\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616452 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-tmp\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616488 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovnkube-config\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616497 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d559e44-7c9d-464e-be57-884cff742118-host\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616488 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-slash\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616524 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616552 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49jkb\" (UniqueName: \"kubernetes.io/projected/00844e37-d582-444e-ae95-a498060b4519-kube-api-access-49jkb\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616567 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-socket-dir-parent\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616580 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-var-lib-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616606 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-multus-certs\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616646 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysctl-d\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616671 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-var-lib-kubelet\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616694 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-etc-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616714 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16cf618c-6b7c-463c-9501-b27e41b837cc-iptables-alerter-script\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:34:41.618264 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616738 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysconfig\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616766 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-systemd\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616779 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616791 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjvrc\" (UniqueName: \"kubernetes.io/projected/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-kube-api-access-wjvrc\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616830 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-multus-certs\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616861 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616875 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-env-overrides\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616892 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-system-cni-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616921 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-cni-binary-copy\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616927 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-k8s-cni-cncf-io\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616937 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-log-socket\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616958 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-etc-kubernetes\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616973 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-system-cni-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.616999 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf-agent-certs\") pod \"konnectivity-agent-rbrcx\" (UID: \"e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf\") " pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617010 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d559e44-7c9d-464e-be57-884cff742118-host\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617029 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysctl-conf\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617043 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-var-lib-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617070 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-etc-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.619148 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617108 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysconfig\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617128 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-systemd\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617135 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysctl-conf\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617159 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617169 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-etc-kubernetes\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617208 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-var-lib-kubelet\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617219 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-tuned\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617227 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysctl-d\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617270 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-k8s-cni-cncf-io\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617314 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24d5c\" (UniqueName: \"kubernetes.io/projected/48c3e89e-58f0-40af-9c40-63be495d5482-kube-api-access-24d5c\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617343 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-kubelet\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617380 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-socket-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617406 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d559e44-7c9d-464e-be57-884cff742118-serviceca\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617454 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-cnibin\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617482 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-node-log\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617531 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-kubelet\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617550 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-node-log\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617564 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-cnibin\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.620087 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617601 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-cnibin\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617601 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbfk\" (UniqueName: \"kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk\") pod \"network-check-target-d7mfp\" (UID: \"c3fdf510-52fb-4e1e-92c9-5208cb680d05\") " pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617659 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf-konnectivity-ca\") pod \"konnectivity-agent-rbrcx\" (UID: \"e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf\") " pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617668 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617675 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-cnibin\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617689 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-run\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617743 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-run\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617790 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-socket-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617822 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-systemd-units\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617859 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-systemd-units\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617876 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-systemd\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617903 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v45fc\" (UniqueName: \"kubernetes.io/projected/b44eee82-b560-4cab-8804-b1e77523635b-kube-api-access-v45fc\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617919 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1cc7c057-2789-4df5-8370-2244dc2f5d8b-kubelet-config\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617938 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-sys\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617984 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-systemd\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.617991 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-sys\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618039 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1cc7c057-2789-4df5-8370-2244dc2f5d8b-kubelet-config\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:41.620908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618093 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618131 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618174 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16cf618c-6b7c-463c-9501-b27e41b837cc-host-slash\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618227 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-run-netns\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618249 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618257 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618298 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-kubernetes\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618334 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.618341 2634 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618367 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovnkube-script-lib\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618402 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/377989f5-3ed6-4546-9722-b341f03c8e39-cni-binary-copy\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618429 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-ovn\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618457 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618514 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgpxd\" (UniqueName: \"kubernetes.io/projected/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-kube-api-access-xgpxd\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618544 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618570 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-device-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618666 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-device-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.621642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618723 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-kubernetes\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618769 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618793 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-run-netns\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.618851 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-ovn\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.619380 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret podName:1cc7c057-2789-4df5-8370-2244dc2f5d8b nodeName:}" failed. No retries permitted until 2026-10-30 23:34:42.119349581 +0000 UTC m=+2.128649377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret") pod "global-pull-secret-syncer-dhk5w" (UID: "1cc7c057-2789-4df5-8370-2244dc2f5d8b") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.619440 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf-konnectivity-ca\") pod \"konnectivity-agent-rbrcx\" (UID: \"e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf\") " pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.619634 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d559e44-7c9d-464e-be57-884cff742118-serviceca\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.619700 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.619742 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16cf618c-6b7c-463c-9501-b27e41b837cc-host-slash\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.619757 2634 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.619812 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs podName:48c3e89e-58f0-40af-9c40-63be495d5482 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:42.119792478 +0000 UTC m=+2.129092286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs") pod "network-metrics-daemon-bgt8k" (UID: "48c3e89e-58f0-40af-9c40-63be495d5482") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.620221 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.620700 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovn-node-metrics-cert\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.620730 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf-agent-certs\") pod \"konnectivity-agent-rbrcx\" (UID: \"e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf\") " pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.620861 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovnkube-script-lib\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.621073 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/377989f5-3ed6-4546-9722-b341f03c8e39-cni-binary-copy\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.622524 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.621215 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-tuned\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.625194 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.625172 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-tmp\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.635390 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.635361 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:34:41.635502 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.635394 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:34:41.635502 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.635409 2634 projected.go:196] Error preparing data for projected volume kube-api-access-5rbfk for pod openshift-network-diagnostics/network-check-target-d7mfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:41.635502 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.635470 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk podName:c3fdf510-52fb-4e1e-92c9-5208cb680d05 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:42.13544989 +0000 UTC m=+2.144749704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5rbfk" (UniqueName: "kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk") pod "network-check-target-d7mfp" (UID: "c3fdf510-52fb-4e1e-92c9-5208cb680d05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:41.636803 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.636771 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx6m2\" (UniqueName: \"kubernetes.io/projected/0c018322-20cb-470c-ae55-7eaddfbb60ea-kube-api-access-jx6m2\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.636899 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.636839 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prrbs\" (UniqueName: \"kubernetes.io/projected/16cf618c-6b7c-463c-9501-b27e41b837cc-kube-api-access-prrbs\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:34:41.637907 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.637881 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltd62\" (UniqueName: \"kubernetes.io/projected/377989f5-3ed6-4546-9722-b341f03c8e39-kube-api-access-ltd62\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.638518 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.638456 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24d5c\" (UniqueName: \"kubernetes.io/projected/48c3e89e-58f0-40af-9c40-63be495d5482-kube-api-access-24d5c\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:41.641926 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.641903 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v45fc\" (UniqueName: \"kubernetes.io/projected/b44eee82-b560-4cab-8804-b1e77523635b-kube-api-access-v45fc\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:34:41.641926 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.641915 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgpxd\" (UniqueName: \"kubernetes.io/projected/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-kube-api-access-xgpxd\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.642078 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.641969 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw585\" (UniqueName: \"kubernetes.io/projected/9d559e44-7c9d-464e-be57-884cff742118-kube-api-access-gw585\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:34:41.642375 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.642355 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49jkb\" (UniqueName: \"kubernetes.io/projected/00844e37-d582-444e-ae95-a498060b4519-kube-api-access-49jkb\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.642375 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.642366 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjvrc\" (UniqueName: \"kubernetes.io/projected/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-kube-api-access-wjvrc\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.735420 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:41.735384 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac66232dff389c81bfae9a48be8f6b5.slice/crio-d14eff06a8a23475968525d5e9c6055aacffb4d3608bcfd67261998eaec700b0 WatchSource:0}: Error finding container d14eff06a8a23475968525d5e9c6055aacffb4d3608bcfd67261998eaec700b0: Status 404 returned error can't find the container with id d14eff06a8a23475968525d5e9c6055aacffb4d3608bcfd67261998eaec700b0 Oct 30 23:34:41.738374 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.738357 2634 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 23:34:41.758923 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.758901 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:34:41.768826 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:41.768802 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d559e44_7c9d_464e_be57_884cff742118.slice/crio-d5bd256110a2036d4f2f29a185f8afc72510131e60ab9f535c052e3309119d07 WatchSource:0}: Error finding container d5bd256110a2036d4f2f29a185f8afc72510131e60ab9f535c052e3309119d07: Status 404 returned error can't find the container with id d5bd256110a2036d4f2f29a185f8afc72510131e60ab9f535c052e3309119d07 Oct 30 23:34:41.787119 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.787097 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:34:41.792201 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.792181 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:34:41.795346 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:41.795325 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00844e37_d582_444e_ae95_a498060b4519.slice/crio-6873988f97e8ecb25c550db400e9bd79a02808d71315cf8550774f643b19db0d WatchSource:0}: Error finding container 6873988f97e8ecb25c550db400e9bd79a02808d71315cf8550774f643b19db0d: Status 404 returned error can't find the container with id 6873988f97e8ecb25c550db400e9bd79a02808d71315cf8550774f643b19db0d Oct 30 23:34:41.800356 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:41.800335 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16cf618c_6b7c_463c_9501_b27e41b837cc.slice/crio-858a29eaba94849bdcc6aee1470b8e0ad860374e3215c05c5350f924cee414e2 WatchSource:0}: Error finding container 858a29eaba94849bdcc6aee1470b8e0ad860374e3215c05c5350f924cee414e2: Status 404 returned error can't find the container with id 858a29eaba94849bdcc6aee1470b8e0ad860374e3215c05c5350f924cee414e2 Oct 30 23:34:41.820044 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.820021 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-czdjt" Oct 30 23:34:41.823699 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.823681 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:34:41.830032 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:41.830011 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb44eee82_b560_4cab_8804_b1e77523635b.slice/crio-7be32046f516ee4eec26b214d1d5d99203e6e90078546f242e2c4316a78b9add WatchSource:0}: Error finding container 7be32046f516ee4eec26b214d1d5d99203e6e90078546f242e2c4316a78b9add: Status 404 returned error can't find the container with id 7be32046f516ee4eec26b214d1d5d99203e6e90078546f242e2c4316a78b9add Oct 30 23:34:41.832372 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.832333 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rh7rt" Oct 30 23:34:41.833079 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:41.833061 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c018322_20cb_470c_ae55_7eaddfbb60ea.slice/crio-39904baf573b1176c4c2a384caecdf284f926bb077167918250788b937bfb34e WatchSource:0}: Error finding container 39904baf573b1176c4c2a384caecdf284f926bb077167918250788b937bfb34e: Status 404 returned error can't find the container with id 39904baf573b1176c4c2a384caecdf284f926bb077167918250788b937bfb34e Oct 30 23:34:41.841670 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:41.841647 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377989f5_3ed6_4546_9722_b341f03c8e39.slice/crio-0acd2715cb67f1083440f6a51385987c88564e61afd2ca10cd08402637079eab WatchSource:0}: Error finding container 0acd2715cb67f1083440f6a51385987c88564e61afd2ca10cd08402637079eab: Status 404 returned error can't find the container with id 0acd2715cb67f1083440f6a51385987c88564e61afd2ca10cd08402637079eab Oct 30 23:34:41.857061 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.857016 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:34:41.865985 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:41.865964 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50cdfc2_8c66_4e22_bcfa_d7186b29f2cf.slice/crio-75826187d25a5d5f6fc3bc280335c119e2e52c9f92b72cfca9c13858a9f52a55 WatchSource:0}: Error finding container 75826187d25a5d5f6fc3bc280335c119e2e52c9f92b72cfca9c13858a9f52a55: Status 404 returned error can't find the container with id 75826187d25a5d5f6fc3bc280335c119e2e52c9f92b72cfca9c13858a9f52a55 Oct 30 23:34:41.876784 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.876767 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:34:41.885812 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:41.885796 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a4d6df_3ad8_44f6_9f53_4760069a9b9d.slice/crio-11fbecc95be1ab785f41bc5611da2589e0ac04e7ab957210593c386dcb1cb73b WatchSource:0}: Error finding container 11fbecc95be1ab785f41bc5611da2589e0ac04e7ab957210593c386dcb1cb73b: Status 404 returned error can't find the container with id 11fbecc95be1ab785f41bc5611da2589e0ac04e7ab957210593c386dcb1cb73b Oct 30 23:34:41.887562 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:41.887545 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:34:41.896477 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:34:41.896451 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e0565a_5dc8_4461_87fe_6f9dcb2a1468.slice/crio-ac5e4f15d3ba82a691c6a0f7430db1e6d54a79fa0b2eeda3b12064cdd6f047e3 WatchSource:0}: Error finding container ac5e4f15d3ba82a691c6a0f7430db1e6d54a79fa0b2eeda3b12064cdd6f047e3: Status 404 returned error can't find the container with id ac5e4f15d3ba82a691c6a0f7430db1e6d54a79fa0b2eeda3b12064cdd6f047e3 Oct 30 23:34:41.898306 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.898287 2634 kuberuntime_manager.go:1707] "Unhandled Error" err="container csi-driver start failed in pod aws-ebs-csi-driver-node-h5cgh_openshift-cluster-csi-drivers(04e0565a-5dc8-4461-87fe-6f9dcb2a1468): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Oct 30 23:34:41.899394 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.899376 2634 kuberuntime_manager.go:1707] "Unhandled Error" err="container csi-node-driver-registrar start failed in pod aws-ebs-csi-driver-node-h5cgh_openshift-cluster-csi-drivers(04e0565a-5dc8-4461-87fe-6f9dcb2a1468): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Oct 30 23:34:41.900399 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.900380 2634 kuberuntime_manager.go:1707] "Unhandled Error" err="container csi-liveness-probe start failed in pod aws-ebs-csi-driver-node-h5cgh_openshift-cluster-csi-drivers(04e0565a-5dc8-4461-87fe-6f9dcb2a1468): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Oct 30 23:34:41.900489 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:41.900424 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"csi-driver\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"csi-liveness-probe\" with ErrImagePull: \"pull QPS exceeded\"]" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" podUID="04e0565a-5dc8-4461-87fe-6f9dcb2a1468" Oct 30 23:34:42.122901 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.122765 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:42.122901 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.122816 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:42.123527 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:42.122909 2634 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:42.123527 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:42.122947 2634 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:42.123527 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:42.122966 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret podName:1cc7c057-2789-4df5-8370-2244dc2f5d8b nodeName:}" failed. No retries permitted until 2026-10-30 23:34:43.122950169 +0000 UTC m=+3.132249961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret") pod "global-pull-secret-syncer-dhk5w" (UID: "1cc7c057-2789-4df5-8370-2244dc2f5d8b") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:42.123527 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:42.123007 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs podName:48c3e89e-58f0-40af-9c40-63be495d5482 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:43.122991023 +0000 UTC m=+3.132290831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs") pod "network-metrics-daemon-bgt8k" (UID: "48c3e89e-58f0-40af-9c40-63be495d5482") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:42.157782 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.157483 2634 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:34:42.223669 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.223631 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbfk\" (UniqueName: \"kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk\") pod \"network-check-target-d7mfp\" (UID: \"c3fdf510-52fb-4e1e-92c9-5208cb680d05\") " pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:42.223901 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:42.223881 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:34:42.223974 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:42.223913 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:34:42.223974 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:42.223927 2634 projected.go:196] Error preparing data for projected volume kube-api-access-5rbfk for pod openshift-network-diagnostics/network-check-target-d7mfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:42.224085 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:42.223989 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk podName:c3fdf510-52fb-4e1e-92c9-5208cb680d05 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:43.223970918 +0000 UTC m=+3.233270725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5rbfk" (UniqueName: "kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk") pod "network-check-target-d7mfp" (UID: "c3fdf510-52fb-4e1e-92c9-5208cb680d05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:42.462165 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.461992 2634 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 23:29:42 +0000 UTC" deadline="2028-04-11 17:01:02.74046684 +0000 UTC" Oct 30 23:34:42.462165 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.462062 2634 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12689h26m20.278409752s" Oct 30 23:34:42.583189 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.573484 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9mljf" event={"ID":"16cf618c-6b7c-463c-9501-b27e41b837cc","Type":"ContainerStarted","Data":"858a29eaba94849bdcc6aee1470b8e0ad860374e3215c05c5350f924cee414e2"} Oct 30 23:34:42.588710 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.588631 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" event={"ID":"eb43bc9abe76bb2220c1657ae80c7c48","Type":"ContainerStarted","Data":"d9f4fa57baa1f18328bf7f1b9136484b845c4fedf53fdeb58974d63f1df350d3"} Oct 30 23:34:42.596592 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.596516 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" event={"ID":"6ac66232dff389c81bfae9a48be8f6b5","Type":"ContainerStarted","Data":"d14eff06a8a23475968525d5e9c6055aacffb4d3608bcfd67261998eaec700b0"} Oct 30 23:34:42.626254 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.625526 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" event={"ID":"04e0565a-5dc8-4461-87fe-6f9dcb2a1468","Type":"ContainerStarted","Data":"ac5e4f15d3ba82a691c6a0f7430db1e6d54a79fa0b2eeda3b12064cdd6f047e3"} Oct 30 23:34:42.629391 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.628472 2634 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:34:42.642219 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:42.642148 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"csi-driver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:007ba215236827a40e1b33f3799d289065305ae886c05e51214d74d0ff24d62d\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a5e96bc702bc529b424e6c80f95d7d4fc4fe92f83df4a77c3b47eb3a30fe729\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"csi-liveness-probe\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c4db2cbbaecb77e6b3a4e8dd7ee7a4d4fa9ab69787e4330711a3abb1277af2ac\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" podUID="04e0565a-5dc8-4461-87fe-6f9dcb2a1468" Oct 30 23:34:42.643982 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.643909 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" event={"ID":"04a4d6df-3ad8-44f6-9f53-4760069a9b9d","Type":"ContainerStarted","Data":"11fbecc95be1ab785f41bc5611da2589e0ac04e7ab957210593c386dcb1cb73b"} Oct 30 23:34:42.661736 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.661713 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rbrcx" event={"ID":"e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf","Type":"ContainerStarted","Data":"75826187d25a5d5f6fc3bc280335c119e2e52c9f92b72cfca9c13858a9f52a55"} Oct 30 23:34:42.689917 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.689840 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rh7rt" event={"ID":"377989f5-3ed6-4546-9722-b341f03c8e39","Type":"ContainerStarted","Data":"0acd2715cb67f1083440f6a51385987c88564e61afd2ca10cd08402637079eab"} Oct 30 23:34:42.696153 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.696125 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" event={"ID":"0c018322-20cb-470c-ae55-7eaddfbb60ea","Type":"ContainerStarted","Data":"39904baf573b1176c4c2a384caecdf284f926bb077167918250788b937bfb34e"} Oct 30 23:34:42.711874 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.711818 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-czdjt" event={"ID":"b44eee82-b560-4cab-8804-b1e77523635b","Type":"ContainerStarted","Data":"7be32046f516ee4eec26b214d1d5d99203e6e90078546f242e2c4316a78b9add"} Oct 30 23:34:42.736769 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.736706 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx66m" event={"ID":"00844e37-d582-444e-ae95-a498060b4519","Type":"ContainerStarted","Data":"6873988f97e8ecb25c550db400e9bd79a02808d71315cf8550774f643b19db0d"} Oct 30 23:34:42.746298 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.746226 2634 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:34:42.763625 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:42.763571 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hszwb" event={"ID":"9d559e44-7c9d-464e-be57-884cff742118","Type":"ContainerStarted","Data":"d5bd256110a2036d4f2f29a185f8afc72510131e60ab9f535c052e3309119d07"} Oct 30 23:34:43.133147 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:43.133068 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:43.133147 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:43.133135 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:43.133416 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:43.133243 2634 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:43.133416 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:43.133294 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret podName:1cc7c057-2789-4df5-8370-2244dc2f5d8b nodeName:}" failed. No retries permitted until 2026-10-30 23:34:45.133280711 +0000 UTC m=+5.142580518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret") pod "global-pull-secret-syncer-dhk5w" (UID: "1cc7c057-2789-4df5-8370-2244dc2f5d8b") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:43.133655 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:43.133602 2634 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:43.133655 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:43.133643 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs podName:48c3e89e-58f0-40af-9c40-63be495d5482 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:45.133632736 +0000 UTC m=+5.142932542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs") pod "network-metrics-daemon-bgt8k" (UID: "48c3e89e-58f0-40af-9c40-63be495d5482") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:43.233734 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:43.233694 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbfk\" (UniqueName: \"kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk\") pod \"network-check-target-d7mfp\" (UID: \"c3fdf510-52fb-4e1e-92c9-5208cb680d05\") " pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:43.233955 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:43.233925 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:34:43.234037 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:43.233958 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:34:43.234037 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:43.233973 2634 projected.go:196] Error preparing data for projected volume kube-api-access-5rbfk for pod openshift-network-diagnostics/network-check-target-d7mfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:43.234037 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:43.234033 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk podName:c3fdf510-52fb-4e1e-92c9-5208cb680d05 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:45.234012627 +0000 UTC m=+5.243312424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5rbfk" (UniqueName: "kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk") pod "network-check-target-d7mfp" (UID: "c3fdf510-52fb-4e1e-92c9-5208cb680d05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:43.462500 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:43.462390 2634 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 23:29:42 +0000 UTC" deadline="2028-05-17 10:42:35.12071493 +0000 UTC" Oct 30 23:34:43.462500 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:43.462451 2634 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13547h7m51.658267845s" Oct 30 23:34:43.531496 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:43.531463 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:43.531675 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:43.531606 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:34:43.532443 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:43.532337 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:43.532443 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:43.532376 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:43.532627 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:43.532452 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:34:43.532627 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:43.532551 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:34:45.157112 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:45.156470 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:45.157112 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:45.156527 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:45.157112 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:45.156664 2634 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:45.157112 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:45.156722 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs podName:48c3e89e-58f0-40af-9c40-63be495d5482 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:49.156704994 +0000 UTC m=+9.166004799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs") pod "network-metrics-daemon-bgt8k" (UID: "48c3e89e-58f0-40af-9c40-63be495d5482") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:45.157112 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:45.157044 2634 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:45.157112 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:45.157081 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret podName:1cc7c057-2789-4df5-8370-2244dc2f5d8b nodeName:}" failed. No retries permitted until 2026-10-30 23:34:49.157070024 +0000 UTC m=+9.166369830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret") pod "global-pull-secret-syncer-dhk5w" (UID: "1cc7c057-2789-4df5-8370-2244dc2f5d8b") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:45.258174 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:45.257505 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbfk\" (UniqueName: \"kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk\") pod \"network-check-target-d7mfp\" (UID: \"c3fdf510-52fb-4e1e-92c9-5208cb680d05\") " pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:45.258174 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:45.257723 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:34:45.258174 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:45.257747 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:34:45.258174 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:45.257761 2634 projected.go:196] Error preparing data for projected volume kube-api-access-5rbfk for pod openshift-network-diagnostics/network-check-target-d7mfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:45.258174 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:45.257821 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk podName:c3fdf510-52fb-4e1e-92c9-5208cb680d05 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:49.257802421 +0000 UTC m=+9.267102238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5rbfk" (UniqueName: "kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk") pod "network-check-target-d7mfp" (UID: "c3fdf510-52fb-4e1e-92c9-5208cb680d05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:45.531154 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:45.530925 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:45.531310 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:45.530925 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:45.531387 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:45.531295 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:34:45.531442 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:45.531423 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:34:45.531498 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:45.530939 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:45.531554 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:45.531520 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:34:45.816860 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:45.815889 2634 generic.go:356] "Generic (PLEG): container finished" podID="00844e37-d582-444e-ae95-a498060b4519" containerID="60bd83c6bb1f518514a0198a4c947d6b66fded76b6e349ce05774d715f0c2f1e" exitCode=0 Oct 30 23:34:45.816860 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:45.815991 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx66m" event={"ID":"00844e37-d582-444e-ae95-a498060b4519","Type":"ContainerDied","Data":"60bd83c6bb1f518514a0198a4c947d6b66fded76b6e349ce05774d715f0c2f1e"} Oct 30 23:34:45.826576 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:45.826543 2634 generic.go:356] "Generic (PLEG): container finished" podID="6ac66232dff389c81bfae9a48be8f6b5" containerID="aab186c0d7cf6890e4bab2c5eddb6500d356a1127e0d915b894c318b25e2add1" exitCode=0 Oct 30 23:34:45.826703 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:45.826599 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" event={"ID":"6ac66232dff389c81bfae9a48be8f6b5","Type":"ContainerDied","Data":"aab186c0d7cf6890e4bab2c5eddb6500d356a1127e0d915b894c318b25e2add1"} Oct 30 23:34:46.832110 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:46.832016 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rbrcx" event={"ID":"e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf","Type":"ContainerStarted","Data":"92acdfa3f75a97de3d131eb96ff42f3efb09c34f6837e1fc02984ac2ea69b340"} Oct 30 23:34:46.836467 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:46.835971 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" event={"ID":"eb43bc9abe76bb2220c1657ae80c7c48","Type":"ContainerStarted","Data":"eb23fd43317455631f5a35ff9cffe7bce47ce401fc7cfc2eade953d0cede8c01"} Oct 30 23:34:46.841643 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:46.841144 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" event={"ID":"6ac66232dff389c81bfae9a48be8f6b5","Type":"ContainerStarted","Data":"b71b7086004ce302df7689c7f697b955fedb35e59e4bf9444115956de18b4cba"} Oct 30 23:34:46.914274 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:46.914194 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rbrcx" podStartSLOduration=1.541623352 podStartE2EDuration="5.914174026s" totalImagesPullingTime="4.372550674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:46.872852664 +0000 UTC m=+6.882152483" watchObservedRunningTime="2026-10-30 23:34:46.914174026 +0000 UTC m=+6.923473843" Oct 30 23:34:46.955727 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:46.953552 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" podStartSLOduration=5.953530508 podStartE2EDuration="5.953530508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:46.914478852 +0000 UTC m=+6.923778670" watchObservedRunningTime="2026-10-30 23:34:46.953530508 +0000 UTC m=+6.962830325" Oct 30 23:34:47.531527 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:47.531492 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:47.531688 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:47.531552 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:47.531688 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:47.531497 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:47.531688 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:47.531664 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:34:47.531852 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:47.531751 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:34:47.531852 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:47.531813 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:34:47.848468 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:47.848428 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hszwb" event={"ID":"9d559e44-7c9d-464e-be57-884cff742118","Type":"ContainerStarted","Data":"7d2f754dd05bef04c8751b1b4b70bd0cb158ec9ba03299d14267ad7695d940d8"} Oct 30 23:34:47.887079 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:47.887017 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" podStartSLOduration=6.88699597 podStartE2EDuration="6.88699597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:46.954262672 +0000 UTC m=+6.963562495" watchObservedRunningTime="2026-10-30 23:34:47.88699597 +0000 UTC m=+7.896295786" Oct 30 23:34:49.193135 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:49.192506 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:49.193135 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:49.192550 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:49.193135 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:49.192657 2634 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:49.193135 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:49.192707 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs podName:48c3e89e-58f0-40af-9c40-63be495d5482 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:57.192692235 +0000 UTC m=+17.201992041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs") pod "network-metrics-daemon-bgt8k" (UID: "48c3e89e-58f0-40af-9c40-63be495d5482") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:49.193135 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:49.193045 2634 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:49.193135 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:49.193100 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret podName:1cc7c057-2789-4df5-8370-2244dc2f5d8b nodeName:}" failed. No retries permitted until 2026-10-30 23:34:57.193084984 +0000 UTC m=+17.202384792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret") pod "global-pull-secret-syncer-dhk5w" (UID: "1cc7c057-2789-4df5-8370-2244dc2f5d8b") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:49.294507 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:49.293767 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbfk\" (UniqueName: \"kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk\") pod \"network-check-target-d7mfp\" (UID: \"c3fdf510-52fb-4e1e-92c9-5208cb680d05\") " pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:49.294507 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:49.293992 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:34:49.294507 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:49.294015 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:34:49.294507 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:49.294028 2634 projected.go:196] Error preparing data for projected volume kube-api-access-5rbfk for pod openshift-network-diagnostics/network-check-target-d7mfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:49.294507 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:49.294092 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk podName:c3fdf510-52fb-4e1e-92c9-5208cb680d05 nodeName:}" failed. No retries permitted until 2026-10-30 23:34:57.294073727 +0000 UTC m=+17.303373525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5rbfk" (UniqueName: "kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk") pod "network-check-target-d7mfp" (UID: "c3fdf510-52fb-4e1e-92c9-5208cb680d05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:49.531787 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:49.531056 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:49.531787 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:49.531221 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:34:49.531787 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:49.531491 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:49.531787 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:49.531614 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:34:49.531787 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:49.531641 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:49.531787 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:49.531740 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:34:50.273764 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:50.272876 2634 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:34:50.274342 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:50.274318 2634 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:34:50.313977 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:50.313920 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hszwb" podStartSLOduration=3.7905920159999997 podStartE2EDuration="9.313907224s" totalImagesPullingTime="5.523315208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:47.887611144 +0000 UTC m=+7.896910959" watchObservedRunningTime="2026-10-30 23:34:50.313907224 +0000 UTC m=+10.323207038" Oct 30 23:34:50.856085 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:50.856045 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rh7rt" event={"ID":"377989f5-3ed6-4546-9722-b341f03c8e39","Type":"ContainerStarted","Data":"8940941888d556c1d090f7426bb9ed50e1dbe95fea2c3138931e8d34093e82f0"} Oct 30 23:34:50.858344 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:50.858309 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-czdjt" event={"ID":"b44eee82-b560-4cab-8804-b1e77523635b","Type":"ContainerStarted","Data":"1fded2475fadd9329674e03592329d73123f2d44d750e5deda61f89c5b189161"} Oct 30 23:34:50.861642 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:50.861616 2634 generic.go:356] "Generic (PLEG): container finished" podID="00844e37-d582-444e-ae95-a498060b4519" containerID="8415a727acdade78b0721fe7ee0a004e1348e4643974e897107893f209ad1ae4" exitCode=0 Oct 30 23:34:50.861763 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:50.861709 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx66m" event={"ID":"00844e37-d582-444e-ae95-a498060b4519","Type":"ContainerDied","Data":"8415a727acdade78b0721fe7ee0a004e1348e4643974e897107893f209ad1ae4"} Oct 30 23:34:50.903075 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:50.903011 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-rh7rt" podStartSLOduration=1.801436552 podStartE2EDuration="9.902995922s" totalImagesPullingTime="8.10155937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:50.90255817 +0000 UTC m=+10.911857987" watchObservedRunningTime="2026-10-30 23:34:50.902995922 +0000 UTC m=+10.912295738" Oct 30 23:34:50.987336 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:50.987288 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-czdjt" podStartSLOduration=1.870173054 podStartE2EDuration="9.987270576s" totalImagesPullingTime="8.117097522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:50.986873984 +0000 UTC m=+10.996173801" watchObservedRunningTime="2026-10-30 23:34:50.987270576 +0000 UTC m=+10.996570393" Oct 30 23:34:51.531001 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:51.530977 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:51.531346 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:51.531082 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:34:51.531425 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:51.531409 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:51.531495 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:51.531478 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:34:51.531545 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:51.531533 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:51.531594 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:51.531582 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:34:51.866993 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:51.866956 2634 generic.go:356] "Generic (PLEG): container finished" podID="00844e37-d582-444e-ae95-a498060b4519" containerID="1f2769a4499738a5c15e167a27fd0fb553844c04337284a4d2bf52faddbcbd08" exitCode=0 Oct 30 23:34:51.867210 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:51.867052 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx66m" event={"ID":"00844e37-d582-444e-ae95-a498060b4519","Type":"ContainerDied","Data":"1f2769a4499738a5c15e167a27fd0fb553844c04337284a4d2bf52faddbcbd08"} Oct 30 23:34:51.869689 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:51.869624 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9mljf" event={"ID":"16cf618c-6b7c-463c-9501-b27e41b837cc","Type":"ContainerStarted","Data":"b0701d27d9254feaae946987412f74e9ea3adbf474adea925f6a84f668c5a1d8"} Oct 30 23:34:52.873412 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:52.873143 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" event={"ID":"04a4d6df-3ad8-44f6-9f53-4760069a9b9d","Type":"ContainerStarted","Data":"9d3e4af5a2bbd48dd6a48b6c68b41942681e81b00b0dd80c6526e3bd9144b429"} Oct 30 23:34:52.875955 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:52.875926 2634 generic.go:356] "Generic (PLEG): container finished" podID="00844e37-d582-444e-ae95-a498060b4519" containerID="ada9c6da4fe17e58b663c2e1e276dbda9c80b5ef141a19414c856f196d0e56db" exitCode=0 Oct 30 23:34:52.876078 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:52.876007 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx66m" event={"ID":"00844e37-d582-444e-ae95-a498060b4519","Type":"ContainerDied","Data":"ada9c6da4fe17e58b663c2e1e276dbda9c80b5ef141a19414c856f196d0e56db"} Oct 30 23:34:52.912337 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:52.912274 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" podStartSLOduration=1.7996586620000001 podStartE2EDuration="11.912259088s" totalImagesPullingTime="10.112600426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:52.911938016 +0000 UTC m=+12.921237829" watchObservedRunningTime="2026-10-30 23:34:52.912259088 +0000 UTC m=+12.921558901" Oct 30 23:34:52.913026 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:52.912988 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9mljf" podStartSLOduration=3.568449356 podStartE2EDuration="11.912978482s" totalImagesPullingTime="8.344529126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:51.955509007 +0000 UTC m=+11.964808820" watchObservedRunningTime="2026-10-30 23:34:52.912978482 +0000 UTC m=+12.922278295" Oct 30 23:34:53.531729 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:53.531697 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:53.531899 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:53.531815 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:34:53.532201 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:53.532183 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:53.532328 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:53.532311 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:34:53.532403 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:53.532363 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:53.532451 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:53.532417 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:34:55.530704 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:55.530671 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:55.531385 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:55.530811 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:34:55.531385 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:55.530888 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:55.531385 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:55.530966 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:34:55.531385 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:55.531009 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:55.531385 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:55.531074 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:34:55.886204 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:55.886112 2634 generic.go:356] "Generic (PLEG): container finished" podID="00844e37-d582-444e-ae95-a498060b4519" containerID="a70402574f4e158fbec9007e85dac81e6874b3aaf50a0266ce870a70489e04fc" exitCode=0 Oct 30 23:34:55.886204 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:55.886189 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx66m" event={"ID":"00844e37-d582-444e-ae95-a498060b4519","Type":"ContainerDied","Data":"a70402574f4e158fbec9007e85dac81e6874b3aaf50a0266ce870a70489e04fc"} Oct 30 23:34:56.890186 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:56.889996 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" event={"ID":"0c018322-20cb-470c-ae55-7eaddfbb60ea","Type":"ContainerStarted","Data":"eb464084848945a923ccac4fa098440f482b7bf8883fd5b8581b173278969478"} Oct 30 23:34:56.890583 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:56.890238 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" event={"ID":"0c018322-20cb-470c-ae55-7eaddfbb60ea","Type":"ContainerStarted","Data":"af9b849966392c3e493fbd678894220ee0903a606edd5527373c85808b9ecae3"} Oct 30 23:34:56.893105 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:56.893080 2634 generic.go:356] "Generic (PLEG): container finished" podID="00844e37-d582-444e-ae95-a498060b4519" containerID="7a212b7eec071baae5badae2e386719aa1a189a914381e7b131c03bfd4f03190" exitCode=0 Oct 30 23:34:56.893219 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:56.893126 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx66m" event={"ID":"00844e37-d582-444e-ae95-a498060b4519","Type":"ContainerDied","Data":"7a212b7eec071baae5badae2e386719aa1a189a914381e7b131c03bfd4f03190"} Oct 30 23:34:57.257115 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.257088 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:57.257237 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.257120 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:57.257237 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:57.257232 2634 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:57.257348 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:57.257233 2634 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:57.257348 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:57.257281 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs podName:48c3e89e-58f0-40af-9c40-63be495d5482 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:13.257266069 +0000 UTC m=+33.266565875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs") pod "network-metrics-daemon-bgt8k" (UID: "48c3e89e-58f0-40af-9c40-63be495d5482") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:34:57.257348 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:57.257294 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret podName:1cc7c057-2789-4df5-8370-2244dc2f5d8b nodeName:}" failed. No retries permitted until 2026-10-30 23:35:13.257288276 +0000 UTC m=+33.266588066 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret") pod "global-pull-secret-syncer-dhk5w" (UID: "1cc7c057-2789-4df5-8370-2244dc2f5d8b") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:34:57.358009 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.357974 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbfk\" (UniqueName: \"kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk\") pod \"network-check-target-d7mfp\" (UID: \"c3fdf510-52fb-4e1e-92c9-5208cb680d05\") " pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:57.358173 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:57.358082 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:34:57.358173 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:57.358096 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:34:57.358173 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:57.358104 2634 projected.go:196] Error preparing data for projected volume kube-api-access-5rbfk for pod openshift-network-diagnostics/network-check-target-d7mfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:57.358173 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:57.358145 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk podName:c3fdf510-52fb-4e1e-92c9-5208cb680d05 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:13.35813354 +0000 UTC m=+33.367433343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5rbfk" (UniqueName: "kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk") pod "network-check-target-d7mfp" (UID: "c3fdf510-52fb-4e1e-92c9-5208cb680d05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:34:57.531131 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.531063 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:57.531131 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.531080 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:57.531390 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.531209 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:57.531390 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:57.531219 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:34:57.531390 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:57.531316 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:34:57.531541 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:57.531399 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:34:57.896216 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.896129 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" event={"ID":"04e0565a-5dc8-4461-87fe-6f9dcb2a1468","Type":"ContainerStarted","Data":"502de48ecd77fcf3857c33b9247f14385041483440d00f9a1e318d9e86279cd3"} Oct 30 23:34:57.898664 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.898643 2634 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:34:57.898954 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.898933 2634 generic.go:356] "Generic (PLEG): container finished" podID="0c018322-20cb-470c-ae55-7eaddfbb60ea" containerID="eb464084848945a923ccac4fa098440f482b7bf8883fd5b8581b173278969478" exitCode=1 Oct 30 23:34:57.899013 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.898995 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" event={"ID":"0c018322-20cb-470c-ae55-7eaddfbb60ea","Type":"ContainerDied","Data":"eb464084848945a923ccac4fa098440f482b7bf8883fd5b8581b173278969478"} Oct 30 23:34:57.899072 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.899057 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" event={"ID":"0c018322-20cb-470c-ae55-7eaddfbb60ea","Type":"ContainerStarted","Data":"4d28c037c2d1b6b8fdcacca8f6dc2509092bc300baa75b683de4c6ed85a5660a"} Oct 30 23:34:57.899133 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.899103 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" event={"ID":"0c018322-20cb-470c-ae55-7eaddfbb60ea","Type":"ContainerStarted","Data":"1fbf300e6ed43b452c8ebac966ad0d0ff74484f8de06560445acf51edd4c47f7"} Oct 30 23:34:57.899197 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.899132 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" event={"ID":"0c018322-20cb-470c-ae55-7eaddfbb60ea","Type":"ContainerStarted","Data":"3bdf7e6766340b58d58f117521c81d2e2b3b767b1b725b5f34c7e3ea738dc9b7"} Oct 30 23:34:57.899197 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.899176 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" event={"ID":"0c018322-20cb-470c-ae55-7eaddfbb60ea","Type":"ContainerStarted","Data":"8bfdcf29e3d5dca4b0bfbcaadb9ac5db713091db5a9d119df77e3d29064c2ee0"} Oct 30 23:34:57.901959 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.901938 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gx66m" event={"ID":"00844e37-d582-444e-ae95-a498060b4519","Type":"ContainerStarted","Data":"57931fb74d6135ff6b9a9c6c9a227fa5c7ebb8173c8ee014d54c1a51d8d307d9"} Oct 30 23:34:57.942731 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:57.942678 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gx66m" podStartSLOduration=6.8935566040000005 podStartE2EDuration="16.942666714s" totalImagesPullingTime="10.04911011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:34:57.942382201 +0000 UTC m=+17.951682014" watchObservedRunningTime="2026-10-30 23:34:57.942666714 +0000 UTC m=+17.951966525" Oct 30 23:34:58.198474 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:58.198448 2634 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 23:34:58.481108 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:58.480990 2634 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T23:34:58.198470946Z","UUID":"51b3601e-1492-4f92-be71-fc2f69c5c237","Handler":null,"Name":"","Endpoint":""} Oct 30 23:34:58.483170 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:58.483135 2634 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 23:34:58.483170 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:58.483174 2634 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 23:34:58.905350 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:58.905324 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" event={"ID":"04e0565a-5dc8-4461-87fe-6f9dcb2a1468","Type":"ContainerStarted","Data":"03fc1437a0e574f469f4f57d85f1e79ad44d14bd3f31aebf9d2a01b935fd681e"} Oct 30 23:34:59.530617 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:59.530590 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:34:59.530764 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:59.530726 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:34:59.530764 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:59.530740 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:34:59.530764 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:59.530746 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:34:59.530928 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:59.530802 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:34:59.530928 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:34:59.530850 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:34:59.909312 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:59.909278 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" event={"ID":"04e0565a-5dc8-4461-87fe-6f9dcb2a1468","Type":"ContainerStarted","Data":"614aeecef1220e91bf3f8a2ec126ca3594105003858570b7b78b4ddb262166b6"} Oct 30 23:34:59.912417 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:59.912399 2634 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:34:59.912751 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:59.912732 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" event={"ID":"0c018322-20cb-470c-ae55-7eaddfbb60ea","Type":"ContainerStarted","Data":"c6583b7ad29f43a6d07dcbd24554b1562bc0620ac34ffa087349e9f5ef8a3a6a"} Oct 30 23:34:59.949503 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:34:59.948375 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" podStartSLOduration=1.9904702890000001 podStartE2EDuration="18.948358571s" totalImagesPullingTime="16.957888282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=3 observedRunningTime="2026-10-30 23:34:59.947609025 +0000 UTC m=+19.956908836" watchObservedRunningTime="2026-10-30 23:34:59.948358571 +0000 UTC m=+19.957658387" Oct 30 23:35:01.530859 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:01.530824 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:01.531470 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:01.530884 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:01.531470 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:01.530978 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:01.531470 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:01.531000 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:01.531470 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:01.531065 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:01.531470 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:01.531152 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:01.919553 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:01.919526 2634 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:35:01.919877 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:01.919852 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" event={"ID":"0c018322-20cb-470c-ae55-7eaddfbb60ea","Type":"ContainerStarted","Data":"5e74994594aa2322d1d5c2069189812b3ce7670dd2d9e7e0d2c5ffb226f8c544"} Oct 30 23:35:01.920143 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:01.920122 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:01.920247 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:01.920203 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:01.920314 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:01.920297 2634 scope.go:122] "RemoveContainer" containerID="eb464084848945a923ccac4fa098440f482b7bf8883fd5b8581b173278969478" Oct 30 23:35:01.937504 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:01.937482 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:01.937652 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:01.937634 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:02.925993 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:02.925969 2634 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:35:02.926483 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:02.926320 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" event={"ID":"0c018322-20cb-470c-ae55-7eaddfbb60ea","Type":"ContainerStarted","Data":"cc86e7763a28c98d5e18663b43a6a88d5eee7919229bbd72791506d89bfd8312"} Oct 30 23:35:02.926483 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:02.926417 2634 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:35:03.009556 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:03.009510 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" podStartSLOduration=7.147958947 podStartE2EDuration="22.009496134s" totalImagesPullingTime="14.861537187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:03.009028298 +0000 UTC m=+23.018328111" watchObservedRunningTime="2026-10-30 23:35:03.009496134 +0000 UTC m=+23.018795947" Oct 30 23:35:03.488130 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:03.488058 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dhk5w"] Oct 30 23:35:03.488328 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:03.488205 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:03.488395 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:03.488317 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:03.492317 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:03.492289 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bgt8k"] Oct 30 23:35:03.492437 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:03.492422 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:03.492559 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:03.492531 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:03.492998 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:03.492978 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d7mfp"] Oct 30 23:35:03.493095 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:03.493080 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:03.493218 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:03.493200 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:03.928206 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:03.928182 2634 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:35:04.533719 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:04.533693 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:04.533947 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:04.533792 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:05.531240 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:05.531212 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:05.531571 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:05.531226 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:05.531571 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:05.531363 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:05.531571 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:05.531380 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:06.531673 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:06.531648 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:06.532015 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:06.531749 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:07.531536 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:07.531511 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:07.531692 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:07.531628 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:07.531692 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:07.531668 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:07.532005 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:07.531741 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:08.384682 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:08.384652 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:35:08.384846 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:08.384771 2634 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:35:08.385230 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:08.385211 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:35:08.531633 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:08.531607 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:08.531797 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:08.531718 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:08.744766 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:08.744699 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:08.744902 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:08.744877 2634 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:35:08.755369 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:08.755213 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:09.531114 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:09.531086 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:09.531114 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:09.531111 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:09.531241 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:09.531219 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:09.531344 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:09.531325 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:10.344883 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:10.344858 2634 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-czdjt_b44eee82-b560-4cab-8804-b1e77523635b/dns-node-resolver/0.log" Oct 30 23:35:10.532367 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:10.532341 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:10.532496 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:10.532417 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:11.098121 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:11.098096 2634 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hszwb_9d559e44-7c9d-464e-be57-884cff742118/node-ca/0.log" Oct 30 23:35:11.530908 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:11.530844 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:11.531278 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:11.530944 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:11.531278 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:11.531003 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:11.531278 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:11.531091 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:12.531448 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:12.531420 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:12.531817 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:12.531523 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:13.281485 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:13.281456 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:13.281620 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:13.281493 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:13.281620 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:13.281598 2634 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:35:13.281620 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:13.281599 2634 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 23:35:13.281724 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:13.281649 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret podName:1cc7c057-2789-4df5-8370-2244dc2f5d8b nodeName:}" failed. No retries permitted until 2026-10-30 23:35:45.281635916 +0000 UTC m=+65.290935706 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret") pod "global-pull-secret-syncer-dhk5w" (UID: "1cc7c057-2789-4df5-8370-2244dc2f5d8b") : object "kube-system"/"original-pull-secret" not registered Oct 30 23:35:13.281724 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:13.281665 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs podName:48c3e89e-58f0-40af-9c40-63be495d5482 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:45.281657501 +0000 UTC m=+65.290957292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs") pod "network-metrics-daemon-bgt8k" (UID: "48c3e89e-58f0-40af-9c40-63be495d5482") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 23:35:13.382092 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:13.382066 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbfk\" (UniqueName: \"kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk\") pod \"network-check-target-d7mfp\" (UID: \"c3fdf510-52fb-4e1e-92c9-5208cb680d05\") " pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:13.382244 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:13.382214 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 23:35:13.382244 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:13.382231 2634 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 23:35:13.382244 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:13.382240 2634 projected.go:196] Error preparing data for projected volume kube-api-access-5rbfk for pod openshift-network-diagnostics/network-check-target-d7mfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:35:13.382340 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:13.382283 2634 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk podName:c3fdf510-52fb-4e1e-92c9-5208cb680d05 nodeName:}" failed. No retries permitted until 2026-10-30 23:35:45.382271883 +0000 UTC m=+65.391571673 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5rbfk" (UniqueName: "kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk") pod "network-check-target-d7mfp" (UID: "c3fdf510-52fb-4e1e-92c9-5208cb680d05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 23:35:13.530684 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:13.530657 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:13.530782 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:13.530657 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:13.530782 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:13.530755 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:13.530861 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:13.530842 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:14.530924 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:14.530896 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:14.531328 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:14.530991 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:15.531288 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:15.531257 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:15.531661 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:15.531360 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:15.531661 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:15.531413 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:15.531661 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:15.531491 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:16.531701 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:16.531672 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:16.532079 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:16.531801 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:17.531633 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:17.531602 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:17.531799 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:17.531705 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:17.531799 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:17.531759 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:17.532109 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:17.531840 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:18.530914 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:18.530883 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:18.531099 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:18.530982 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:19.530895 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:19.530868 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:19.531352 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:19.530993 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:19.531352 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:19.531040 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:19.531352 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:19.531104 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:20.531941 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:20.531909 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:20.532308 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:20.532021 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:21.530824 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:21.530798 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:21.530920 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:21.530834 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:21.530956 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:21.530911 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:21.531039 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:21.531018 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:22.531450 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:22.531421 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:22.531847 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:22.531516 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:23.531195 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:23.531167 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:23.531359 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:23.531264 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:23.531359 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:23.531289 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:23.531359 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:23.531335 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:24.531589 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:24.531557 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:24.532081 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:24.531658 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:25.531309 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:25.531281 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:25.531477 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:25.531378 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:25.531477 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:25.531434 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:25.531547 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:25.531517 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:26.531700 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:26.531666 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:26.532266 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:26.531777 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhk5w" podUID="1cc7c057-2789-4df5-8370-2244dc2f5d8b" Oct 30 23:35:27.531580 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.531556 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:27.531668 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.531591 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:27.531668 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:27.531653 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7mfp" podUID="c3fdf510-52fb-4e1e-92c9-5208cb680d05" Oct 30 23:35:27.531809 ip-10-0-138-47 kubenswrapper[2634]: E1030 23:35:27.531790 2634 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgt8k" podUID="48c3e89e-58f0-40af-9c40-63be495d5482" Oct 30 23:35:27.788132 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.788109 2634 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeReady" Oct 30 23:35:27.788276 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.788233 2634 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 23:35:27.844337 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.844314 2634 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hbf9l"] Oct 30 23:35:27.847331 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.847313 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hbf9l" Oct 30 23:35:27.847623 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.847600 2634 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b2gj4"] Oct 30 23:35:27.851282 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.851267 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:27.863664 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.863645 2634 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xpf7m"] Oct 30 23:35:27.866584 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.866564 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 23:35:27.866662 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.866631 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-rvj77\"" Oct 30 23:35:27.866802 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.866788 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:27.867139 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.867122 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 23:35:27.867290 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.867202 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 23:35:27.869180 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.869144 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 23:35:27.875029 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.875011 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 23:35:27.875114 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.875034 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 23:35:27.875761 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.875741 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hbf9l"] Oct 30 23:35:27.878800 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.878782 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b2gj4"] Oct 30 23:35:27.890015 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.889697 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xpf7m"] Oct 30 23:35:27.966832 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.966802 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 23:35:27.967196 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.967179 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 23:35:27.967301 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.967205 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vskkf\"" Oct 30 23:35:27.967301 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.967239 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 23:35:27.967414 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.967397 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dqbbs\"" Oct 30 23:35:27.994773 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.994749 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:27.994878 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.994795 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fe30e1c-b403-4aca-868f-5bbc23f99e77-cert\") pod \"ingress-canary-hbf9l\" (UID: \"1fe30e1c-b403-4aca-868f-5bbc23f99e77\") " pod="openshift-ingress-canary/ingress-canary-hbf9l" Oct 30 23:35:27.994878 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.994818 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9rpw\" (UniqueName: \"kubernetes.io/projected/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-kube-api-access-b9rpw\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:27.994978 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.994893 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee4cfb5e-2b2a-4831-8114-e57970cb7569-config-volume\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:27.994978 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.994930 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-crio-socket\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:27.994978 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.994968 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-data-volume\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:27.995121 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.995059 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4cfb5e-2b2a-4831-8114-e57970cb7569-tmp-dir\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:27.995121 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.995100 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnjfx\" (UniqueName: \"kubernetes.io/projected/ee4cfb5e-2b2a-4831-8114-e57970cb7569-kube-api-access-nnjfx\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:27.995242 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.995151 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4cfb5e-2b2a-4831-8114-e57970cb7569-metrics-tls\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:27.995242 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.995197 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:27.995320 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:27.995259 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rqmv\" (UniqueName: \"kubernetes.io/projected/1fe30e1c-b403-4aca-868f-5bbc23f99e77-kube-api-access-2rqmv\") pod \"ingress-canary-hbf9l\" (UID: \"1fe30e1c-b403-4aca-868f-5bbc23f99e77\") " pod="openshift-ingress-canary/ingress-canary-hbf9l" Oct 30 23:35:28.039209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.039126 2634 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-ljn2m"] Oct 30 23:35:28.042149 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.042131 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:28.063080 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.063058 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-ljn2m"] Oct 30 23:35:28.066808 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.066786 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 23:35:28.066911 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.066895 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-lgp55\"" Oct 30 23:35:28.066963 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.066905 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 23:35:28.096470 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.096449 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4cfb5e-2b2a-4831-8114-e57970cb7569-tmp-dir\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:28.096592 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.096484 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnjfx\" (UniqueName: \"kubernetes.io/projected/ee4cfb5e-2b2a-4831-8114-e57970cb7569-kube-api-access-nnjfx\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:28.096592 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.096522 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4cfb5e-2b2a-4831-8114-e57970cb7569-metrics-tls\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:28.096592 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.096550 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:28.096742 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.096592 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rqmv\" (UniqueName: \"kubernetes.io/projected/1fe30e1c-b403-4aca-868f-5bbc23f99e77-kube-api-access-2rqmv\") pod \"ingress-canary-hbf9l\" (UID: \"1fe30e1c-b403-4aca-868f-5bbc23f99e77\") " pod="openshift-ingress-canary/ingress-canary-hbf9l" Oct 30 23:35:28.096742 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.096620 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:28.096832 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.096806 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fe30e1c-b403-4aca-868f-5bbc23f99e77-cert\") pod \"ingress-canary-hbf9l\" (UID: \"1fe30e1c-b403-4aca-868f-5bbc23f99e77\") " pod="openshift-ingress-canary/ingress-canary-hbf9l" Oct 30 23:35:28.096881 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.096832 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4cfb5e-2b2a-4831-8114-e57970cb7569-tmp-dir\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:28.096881 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.096841 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9rpw\" (UniqueName: \"kubernetes.io/projected/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-kube-api-access-b9rpw\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:28.096979 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.096898 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee4cfb5e-2b2a-4831-8114-e57970cb7569-config-volume\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:28.096979 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.096926 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-crio-socket\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:28.096979 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.096951 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-data-volume\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:28.097226 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.097201 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-crio-socket\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:28.097290 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.097235 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-data-volume\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:28.097367 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.097346 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:28.097530 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.097509 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee4cfb5e-2b2a-4831-8114-e57970cb7569-config-volume\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:28.100520 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.100495 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4cfb5e-2b2a-4831-8114-e57970cb7569-metrics-tls\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:28.100599 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.100519 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:28.100599 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.100505 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fe30e1c-b403-4aca-868f-5bbc23f99e77-cert\") pod \"ingress-canary-hbf9l\" (UID: \"1fe30e1c-b403-4aca-868f-5bbc23f99e77\") " pod="openshift-ingress-canary/ingress-canary-hbf9l" Oct 30 23:35:28.115088 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.115058 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9rpw\" (UniqueName: \"kubernetes.io/projected/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-kube-api-access-b9rpw\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:28.115209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.115127 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnjfx\" (UniqueName: \"kubernetes.io/projected/ee4cfb5e-2b2a-4831-8114-e57970cb7569-kube-api-access-nnjfx\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:28.115407 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.115390 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rqmv\" (UniqueName: \"kubernetes.io/projected/1fe30e1c-b403-4aca-868f-5bbc23f99e77-kube-api-access-2rqmv\") pod \"ingress-canary-hbf9l\" (UID: \"1fe30e1c-b403-4aca-868f-5bbc23f99e77\") " pod="openshift-ingress-canary/ingress-canary-hbf9l" Oct 30 23:35:28.160324 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.160299 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hbf9l" Oct 30 23:35:28.168547 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.168522 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:28.183435 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.183414 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:28.197514 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.197492 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f-tmp\") pod \"downloads-6dd789c8b7-ljn2m\" (UID: \"dca9509b-a5f9-4afd-baff-f10b6a9b0c7f\") " pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:28.197606 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.197559 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx8xl\" (UniqueName: \"kubernetes.io/projected/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f-kube-api-access-hx8xl\") pod \"downloads-6dd789c8b7-ljn2m\" (UID: \"dca9509b-a5f9-4afd-baff-f10b6a9b0c7f\") " pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:28.298664 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.298584 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f-tmp\") pod \"downloads-6dd789c8b7-ljn2m\" (UID: \"dca9509b-a5f9-4afd-baff-f10b6a9b0c7f\") " pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:28.298664 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.298664 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx8xl\" (UniqueName: \"kubernetes.io/projected/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f-kube-api-access-hx8xl\") pod \"downloads-6dd789c8b7-ljn2m\" (UID: \"dca9509b-a5f9-4afd-baff-f10b6a9b0c7f\") " pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:28.299014 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.298994 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f-tmp\") pod \"downloads-6dd789c8b7-ljn2m\" (UID: \"dca9509b-a5f9-4afd-baff-f10b6a9b0c7f\") " pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:28.317758 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.317730 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx8xl\" (UniqueName: \"kubernetes.io/projected/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f-kube-api-access-hx8xl\") pod \"downloads-6dd789c8b7-ljn2m\" (UID: \"dca9509b-a5f9-4afd-baff-f10b6a9b0c7f\") " pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:28.352852 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.352826 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:28.494590 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.494565 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hbf9l"] Oct 30 23:35:28.497725 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.497699 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xpf7m"] Oct 30 23:35:28.498535 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.498511 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b2gj4"] Oct 30 23:35:28.501514 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:35:28.501487 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe30e1c_b403_4aca_868f_5bbc23f99e77.slice/crio-c836e8c92487296727c5dab73b7272d153bd5e43c81bcee0866c6c274146e066 WatchSource:0}: Error finding container c836e8c92487296727c5dab73b7272d153bd5e43c81bcee0866c6c274146e066: Status 404 returned error can't find the container with id c836e8c92487296727c5dab73b7272d153bd5e43c81bcee0866c6c274146e066 Oct 30 23:35:28.502814 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:35:28.502798 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78c4a1f_3d9d_46de_90a2_d5c6b16a62cf.slice/crio-6c25b175d7521262fe8b7e28fb8e0ad05158a442f90f6872b49f043546b66a3d WatchSource:0}: Error finding container 6c25b175d7521262fe8b7e28fb8e0ad05158a442f90f6872b49f043546b66a3d: Status 404 returned error can't find the container with id 6c25b175d7521262fe8b7e28fb8e0ad05158a442f90f6872b49f043546b66a3d Oct 30 23:35:28.503790 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:35:28.503738 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4cfb5e_2b2a_4831_8114_e57970cb7569.slice/crio-a9e6823a8410c87862e771c6a1f96a97fe55fbab8437d855cc3ae7532ee5ae95 WatchSource:0}: Error finding container a9e6823a8410c87862e771c6a1f96a97fe55fbab8437d855cc3ae7532ee5ae95: Status 404 returned error can't find the container with id a9e6823a8410c87862e771c6a1f96a97fe55fbab8437d855cc3ae7532ee5ae95 Oct 30 23:35:28.530787 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.530765 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:28.545229 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.545211 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-wj7js\"" Oct 30 23:35:28.545484 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.545302 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 23:35:28.644068 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.644043 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-ljn2m"] Oct 30 23:35:28.649572 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:35:28.649534 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca9509b_a5f9_4afd_baff_f10b6a9b0c7f.slice/crio-207a1c5fc9534a993035ec0d9ad43fd68919560f78e8e9c5db8216a6b81c95f3 WatchSource:0}: Error finding container 207a1c5fc9534a993035ec0d9ad43fd68919560f78e8e9c5db8216a6b81c95f3: Status 404 returned error can't find the container with id 207a1c5fc9534a993035ec0d9ad43fd68919560f78e8e9c5db8216a6b81c95f3 Oct 30 23:35:28.992104 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.992017 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b2gj4" event={"ID":"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf","Type":"ContainerStarted","Data":"ed3617f5f409128109f0c7f3ebfa6d94a9861d468f57c6e87857f42653afa6ec"} Oct 30 23:35:28.992104 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.992092 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b2gj4" event={"ID":"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf","Type":"ContainerStarted","Data":"6c25b175d7521262fe8b7e28fb8e0ad05158a442f90f6872b49f043546b66a3d"} Oct 30 23:35:28.993526 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.993496 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-ljn2m" event={"ID":"dca9509b-a5f9-4afd-baff-f10b6a9b0c7f","Type":"ContainerStarted","Data":"207a1c5fc9534a993035ec0d9ad43fd68919560f78e8e9c5db8216a6b81c95f3"} Oct 30 23:35:28.995655 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.995631 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xpf7m" event={"ID":"ee4cfb5e-2b2a-4831-8114-e57970cb7569","Type":"ContainerStarted","Data":"a9e6823a8410c87862e771c6a1f96a97fe55fbab8437d855cc3ae7532ee5ae95"} Oct 30 23:35:28.997049 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:28.997027 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hbf9l" event={"ID":"1fe30e1c-b403-4aca-868f-5bbc23f99e77","Type":"ContainerStarted","Data":"c836e8c92487296727c5dab73b7272d153bd5e43c81bcee0866c6c274146e066"} Oct 30 23:35:29.533086 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.530958 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:29.533086 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.531623 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:29.545533 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.545509 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 23:35:29.547075 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.545938 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 23:35:29.547075 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.546001 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-p2ccw\"" Oct 30 23:35:29.551336 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.551314 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tzsrk\"" Oct 30 23:35:29.551459 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.551445 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 23:35:29.669869 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.668791 2634 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf"] Oct 30 23:35:29.673751 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.672116 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.687643 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.687623 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 30 23:35:29.687766 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.687750 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 23:35:29.687896 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.687882 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 23:35:29.687966 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.687955 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 30 23:35:29.688063 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.688048 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 23:35:29.688206 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.688191 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b99jz\"" Oct 30 23:35:29.692377 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.692354 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf"] Oct 30 23:35:29.812682 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.812420 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa89d93c-3459-445c-a4ad-2afc60b41ded-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.812682 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.812493 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa89d93c-3459-445c-a4ad-2afc60b41ded-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.812682 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.812532 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n97r4\" (UniqueName: \"kubernetes.io/projected/aa89d93c-3459-445c-a4ad-2afc60b41ded-kube-api-access-n97r4\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.812682 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.812564 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa89d93c-3459-445c-a4ad-2afc60b41ded-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.913553 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.913508 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa89d93c-3459-445c-a4ad-2afc60b41ded-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.913728 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.913567 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n97r4\" (UniqueName: \"kubernetes.io/projected/aa89d93c-3459-445c-a4ad-2afc60b41ded-kube-api-access-n97r4\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.913728 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.913598 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa89d93c-3459-445c-a4ad-2afc60b41ded-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.913728 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.913637 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa89d93c-3459-445c-a4ad-2afc60b41ded-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.914447 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.914415 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa89d93c-3459-445c-a4ad-2afc60b41ded-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.917713 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.917692 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa89d93c-3459-445c-a4ad-2afc60b41ded-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.919626 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.919598 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa89d93c-3459-445c-a4ad-2afc60b41ded-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.933121 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.933095 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n97r4\" (UniqueName: \"kubernetes.io/projected/aa89d93c-3459-445c-a4ad-2afc60b41ded-kube-api-access-n97r4\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:29.987902 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:29.987872 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:30.002466 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:30.002430 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b2gj4" event={"ID":"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf","Type":"ContainerStarted","Data":"54d7c5ebabf306b7eda020ee90c1bbdce0100702b8bd417a75086c9baccc51f5"} Oct 30 23:35:30.294594 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:30.294469 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf"] Oct 30 23:35:30.302199 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:35:30.302168 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa89d93c_3459_445c_a4ad_2afc60b41ded.slice/crio-372ea3c2192894a44e591e1551ba3c4bfb79e0e317ea3d64e3935a9c8b349527 WatchSource:0}: Error finding container 372ea3c2192894a44e591e1551ba3c4bfb79e0e317ea3d64e3935a9c8b349527: Status 404 returned error can't find the container with id 372ea3c2192894a44e591e1551ba3c4bfb79e0e317ea3d64e3935a9c8b349527 Oct 30 23:35:30.384709 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:30.384660 2634 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-czdjt_b44eee82-b560-4cab-8804-b1e77523635b/dns-node-resolver/0.log" Oct 30 23:35:31.008637 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:31.008529 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xpf7m" event={"ID":"ee4cfb5e-2b2a-4831-8114-e57970cb7569","Type":"ContainerStarted","Data":"90b8f5e9fa3759b69e396b49c87dcdf285b7efd3db3add9a1a65bf8faa1df4e5"} Oct 30 23:35:31.008637 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:31.008598 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xpf7m" event={"ID":"ee4cfb5e-2b2a-4831-8114-e57970cb7569","Type":"ContainerStarted","Data":"b1f14bac8f82ae19f8edc7e94b04f09f545d8612034bfa5641ee46089f7a09f4"} Oct 30 23:35:31.009386 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:31.009365 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:31.011514 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:31.011487 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" event={"ID":"aa89d93c-3459-445c-a4ad-2afc60b41ded","Type":"ContainerStarted","Data":"372ea3c2192894a44e591e1551ba3c4bfb79e0e317ea3d64e3935a9c8b349527"} Oct 30 23:35:31.047798 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:31.047740 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-xpf7m" podStartSLOduration=2.046505725 podStartE2EDuration="4.047722539s" totalImagesPullingTime="2.001216814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:31.047027879 +0000 UTC m=+51.056327691" watchObservedRunningTime="2026-10-30 23:35:31.047722539 +0000 UTC m=+51.057022349" Oct 30 23:35:31.383057 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:31.383024 2634 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hszwb_9d559e44-7c9d-464e-be57-884cff742118/node-ca/0.log" Oct 30 23:35:32.017147 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.017121 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" event={"ID":"aa89d93c-3459-445c-a4ad-2afc60b41ded","Type":"ContainerStarted","Data":"8091e44e19641229aa7b96ad935601d3dae38ed8016135c3145b9ca50d3507db"} Oct 30 23:35:32.017532 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.017234 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" event={"ID":"aa89d93c-3459-445c-a4ad-2afc60b41ded","Type":"ContainerStarted","Data":"dbd5f1d2e0695ff18a89c2b13e5402174efe31dc385c6a0a2431b153dea99028"} Oct 30 23:35:32.019460 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.019432 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b2gj4" event={"ID":"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf","Type":"ContainerStarted","Data":"352104bb8f955d0a2ed5d14e8810c76e61685803e0a35391dc98bfbc109fbe4c"} Oct 30 23:35:32.054572 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.054531 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" podStartSLOduration=1.565061634 podStartE2EDuration="3.054519374s" totalImagesPullingTime="1.48945774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:32.053664881 +0000 UTC m=+52.062964696" watchObservedRunningTime="2026-10-30 23:35:32.054519374 +0000 UTC m=+52.063819179" Oct 30 23:35:32.094184 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.092593 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b2gj4" podStartSLOduration=2.530650343 podStartE2EDuration="5.092577352s" totalImagesPullingTime="2.561927009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:35:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:32.092009813 +0000 UTC m=+52.101309626" watchObservedRunningTime="2026-10-30 23:35:32.092577352 +0000 UTC m=+52.101877164" Oct 30 23:35:32.304434 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.304359 2634 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-75578f867d-n2cxw"] Oct 30 23:35:32.307695 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.307671 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.323215 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.323177 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 30 23:35:32.323376 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.323360 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 30 23:35:32.323456 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.323420 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 30 23:35:32.323456 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.323428 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 30 23:35:32.323456 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.323451 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jdw7v\"" Oct 30 23:35:32.323579 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.323469 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 30 23:35:32.328543 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.328504 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75578f867d-n2cxw"] Oct 30 23:35:32.436506 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.436449 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d221531c-2ebd-483d-8456-254ae91c3f85-tmp\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.436686 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.436576 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-oauth-config\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.436686 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.436613 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-console-config\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.436686 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.436660 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-service-ca\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.436844 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.436702 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmmrq\" (UniqueName: \"kubernetes.io/projected/d221531c-2ebd-483d-8456-254ae91c3f85-kube-api-access-hmmrq\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.436844 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.436740 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-serving-cert\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.436844 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.436759 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-oauth-serving-cert\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.537512 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.537471 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-oauth-config\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.537512 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.537512 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-console-config\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.537736 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.537694 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-service-ca\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.537804 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.537771 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmmrq\" (UniqueName: \"kubernetes.io/projected/d221531c-2ebd-483d-8456-254ae91c3f85-kube-api-access-hmmrq\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.537857 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.537814 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-serving-cert\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.537857 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.537843 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-oauth-serving-cert\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.537957 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.537882 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d221531c-2ebd-483d-8456-254ae91c3f85-tmp\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.538284 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.538254 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-console-config\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.538408 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.538265 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d221531c-2ebd-483d-8456-254ae91c3f85-tmp\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.538804 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.538784 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-service-ca\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.538917 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.538840 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-oauth-serving-cert\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.540506 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.540461 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-oauth-config\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.540914 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.540892 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-serving-cert\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.556550 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.556497 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmmrq\" (UniqueName: \"kubernetes.io/projected/d221531c-2ebd-483d-8456-254ae91c3f85-kube-api-access-hmmrq\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.620567 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.620366 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:32.924268 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:32.924149 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75578f867d-n2cxw"] Oct 30 23:35:32.929147 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:35:32.929113 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd221531c_2ebd_483d_8456_254ae91c3f85.slice/crio-23894e914379904a5c7ea7ff6b349d59f6a4f7dd9bcb7b25673bca68722a8a76 WatchSource:0}: Error finding container 23894e914379904a5c7ea7ff6b349d59f6a4f7dd9bcb7b25673bca68722a8a76: Status 404 returned error can't find the container with id 23894e914379904a5c7ea7ff6b349d59f6a4f7dd9bcb7b25673bca68722a8a76 Oct 30 23:35:33.024340 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:33.024297 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hbf9l" event={"ID":"1fe30e1c-b403-4aca-868f-5bbc23f99e77","Type":"ContainerStarted","Data":"9d1616f9cfe8b333f9222fdc154f8791a93ed868abdccee331307a83a22be7b7"} Oct 30 23:35:33.025929 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:33.025896 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75578f867d-n2cxw" event={"ID":"d221531c-2ebd-483d-8456-254ae91c3f85","Type":"ContainerStarted","Data":"23894e914379904a5c7ea7ff6b349d59f6a4f7dd9bcb7b25673bca68722a8a76"} Oct 30 23:35:33.061483 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:33.061434 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hbf9l" podStartSLOduration=2.579433435 podStartE2EDuration="6.061417994s" totalImagesPullingTime="3.481984559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:33.060871262 +0000 UTC m=+53.070171076" watchObservedRunningTime="2026-10-30 23:35:33.061417994 +0000 UTC m=+53.070717802" Oct 30 23:35:34.290970 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.290904 2634 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z2tf6"] Oct 30 23:35:34.294688 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.294325 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.377122 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.377093 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9kbs4\"" Oct 30 23:35:34.377282 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.377211 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 23:35:34.377282 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.377232 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 23:35:34.377397 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.377313 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 23:35:34.454682 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.454651 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.454861 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.454692 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-tls\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.454861 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.454736 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwxrr\" (UniqueName: \"kubernetes.io/projected/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-kube-api-access-mwxrr\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.454861 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.454782 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-sys\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.454861 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.454819 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.454861 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.454855 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-root\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.455107 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.454877 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-wtmp\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.455107 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.454905 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-textfile\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.455107 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.454962 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-metrics-client-ca\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.555977 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.555904 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-root\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.555977 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.555952 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-wtmp\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556331 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.555983 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-textfile\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556331 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.556032 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-metrics-client-ca\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556331 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.556032 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-root\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556331 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.556064 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556331 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.556096 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-tls\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556331 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.556136 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwxrr\" (UniqueName: \"kubernetes.io/projected/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-kube-api-access-mwxrr\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556331 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.556148 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-wtmp\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556331 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.556208 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-sys\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556331 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.556246 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556730 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.556412 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-textfile\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556730 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.556576 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-sys\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556730 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.556576 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.556903 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.556877 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-metrics-client-ca\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.559027 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.559003 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-tls\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.565755 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.565732 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.575104 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.575080 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwxrr\" (UniqueName: \"kubernetes.io/projected/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-kube-api-access-mwxrr\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.612878 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:34.612844 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:34.625826 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:35:34.625788 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd63f30a_bd74_47e5_9692_e6a41b88ad6c.slice/crio-4893badea04ec167ff7fddf04a9a9d9eb23aadfd09c2f8f6c67f67b082084654 WatchSource:0}: Error finding container 4893badea04ec167ff7fddf04a9a9d9eb23aadfd09c2f8f6c67f67b082084654: Status 404 returned error can't find the container with id 4893badea04ec167ff7fddf04a9a9d9eb23aadfd09c2f8f6c67f67b082084654 Oct 30 23:35:35.035026 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.034944 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2tf6" event={"ID":"dd63f30a-bd74-47e5-9692-e6a41b88ad6c","Type":"ContainerStarted","Data":"4893badea04ec167ff7fddf04a9a9d9eb23aadfd09c2f8f6c67f67b082084654"} Oct 30 23:35:35.669882 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.669842 2634 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 23:35:35.673472 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.673446 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.691459 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.691433 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 23:35:35.701096 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.701076 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 23:35:35.701334 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.701316 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 23:35:35.701451 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.701395 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 23:35:35.701525 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.701508 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c8cbk\"" Oct 30 23:35:35.701641 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.701623 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 23:35:35.701729 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.701712 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 23:35:35.701793 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.701766 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 23:35:35.701871 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.701859 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 23:35:35.701931 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.701917 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 23:35:35.701998 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.701982 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767405 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-web-config\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767447 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767483 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-out\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767513 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767573 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767624 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-volume\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767662 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767688 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767702 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767719 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767745 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fbw2\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-kube-api-access-4fbw2\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767761 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.767933 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.767780 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.868606 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.868568 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.868798 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.868615 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-web-config\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.868798 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.868644 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.869119 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.869097 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-out\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.869214 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.869137 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.869260 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.869217 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.869297 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.869260 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-volume\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.869332 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.869296 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.869367 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.869330 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.869367 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.869353 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.869421 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.869382 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.869421 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.869410 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fbw2\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-kube-api-access-4fbw2\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.869489 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.869437 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.871060 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.870730 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.871150 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.871133 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.871803 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.871635 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.872410 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.872034 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.872410 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.872057 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.872723 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.872685 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.874226 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.874207 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.874960 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.874939 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-web-config\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.875572 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.875547 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.875823 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.875780 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-out\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.877557 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.877533 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.879375 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.879353 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-volume\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:35.891705 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:35.891683 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fbw2\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-kube-api-access-4fbw2\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:36.004713 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:36.004628 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:36.045369 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:36.045331 2634 generic.go:356] "Generic (PLEG): container finished" podID="dd63f30a-bd74-47e5-9692-e6a41b88ad6c" containerID="4217e1f7e73b4ae7cb7ee8cb57df499758dfd65df707b2f2291e13f87a2a927c" exitCode=0 Oct 30 23:35:36.045533 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:36.045437 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2tf6" event={"ID":"dd63f30a-bd74-47e5-9692-e6a41b88ad6c","Type":"ContainerDied","Data":"4217e1f7e73b4ae7cb7ee8cb57df499758dfd65df707b2f2291e13f87a2a927c"} Oct 30 23:35:36.334896 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:36.334859 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 23:35:36.339071 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:35:36.339041 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b37470_09fd_4ec5_8cff_c4b840d49ef0.slice/crio-e4fc9dadb24dd9e62999cc340212c8b225132620b5e3a25f0f95a4d1da78d825 WatchSource:0}: Error finding container e4fc9dadb24dd9e62999cc340212c8b225132620b5e3a25f0f95a4d1da78d825: Status 404 returned error can't find the container with id e4fc9dadb24dd9e62999cc340212c8b225132620b5e3a25f0f95a4d1da78d825 Oct 30 23:35:37.051279 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:37.051245 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75578f867d-n2cxw" event={"ID":"d221531c-2ebd-483d-8456-254ae91c3f85","Type":"ContainerStarted","Data":"25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b"} Oct 30 23:35:37.053000 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:37.052895 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerStarted","Data":"e4fc9dadb24dd9e62999cc340212c8b225132620b5e3a25f0f95a4d1da78d825"} Oct 30 23:35:37.055776 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:37.055694 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2tf6" event={"ID":"dd63f30a-bd74-47e5-9692-e6a41b88ad6c","Type":"ContainerStarted","Data":"aaf30569ccc545de9f3cfeb96d7e74cbcb2fec083b16344280c00fe39b3f4eac"} Oct 30 23:35:37.055776 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:37.055743 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2tf6" event={"ID":"dd63f30a-bd74-47e5-9692-e6a41b88ad6c","Type":"ContainerStarted","Data":"bcae89fda84617107ab4476123bee0fc5e6a1cb18655ee9a3191870bfeb07ace"} Oct 30 23:35:37.091914 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:37.091417 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-75578f867d-n2cxw" podStartSLOduration=1.8878825259999998 podStartE2EDuration="5.09140187s" totalImagesPullingTime="3.203519344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:37.090750339 +0000 UTC m=+57.100050156" watchObservedRunningTime="2026-10-30 23:35:37.09140187 +0000 UTC m=+57.100701686" Oct 30 23:35:38.060566 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:38.060527 2634 generic.go:356] "Generic (PLEG): container finished" podID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerID="44f667879e12356a502010043bd0f4849b75bc3697ad71c8bc251079d05b6038" exitCode=0 Oct 30 23:35:38.061029 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:38.060610 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerDied","Data":"44f667879e12356a502010043bd0f4849b75bc3697ad71c8bc251079d05b6038"} Oct 30 23:35:38.129532 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:38.129486 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z2tf6" podStartSLOduration=2.972128402 podStartE2EDuration="4.129473213s" totalImagesPullingTime="1.067884722s" totalInitContainerRuntime="89.460089ms" isStatefulPod=true podCreationTimestamp="2026-10-30 23:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:37.132377348 +0000 UTC m=+57.141677161" watchObservedRunningTime="2026-10-30 23:35:38.129473213 +0000 UTC m=+58.138773032" Oct 30 23:35:39.082566 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.082515 2634 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc"] Oct 30 23:35:39.086125 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.086098 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:39.108284 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.108221 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc"] Oct 30 23:35:39.118626 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.118604 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Oct 30 23:35:39.118750 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.118607 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4mrbk\"" Oct 30 23:35:39.202308 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.202270 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3eff329b-439c-49f0-9325-f4111a5fc659-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-tnlqc\" (UID: \"3eff329b-439c-49f0-9325-f4111a5fc659\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:39.202449 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.202378 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkf2k\" (UniqueName: \"kubernetes.io/projected/3eff329b-439c-49f0-9325-f4111a5fc659-kube-api-access-gkf2k\") pod \"monitoring-plugin-77f4f76594-tnlqc\" (UID: \"3eff329b-439c-49f0-9325-f4111a5fc659\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:39.303581 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.303545 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3eff329b-439c-49f0-9325-f4111a5fc659-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-tnlqc\" (UID: \"3eff329b-439c-49f0-9325-f4111a5fc659\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:39.303744 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.303656 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkf2k\" (UniqueName: \"kubernetes.io/projected/3eff329b-439c-49f0-9325-f4111a5fc659-kube-api-access-gkf2k\") pod \"monitoring-plugin-77f4f76594-tnlqc\" (UID: \"3eff329b-439c-49f0-9325-f4111a5fc659\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:39.306526 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.306500 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3eff329b-439c-49f0-9325-f4111a5fc659-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-tnlqc\" (UID: \"3eff329b-439c-49f0-9325-f4111a5fc659\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:39.323135 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.323102 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkf2k\" (UniqueName: \"kubernetes.io/projected/3eff329b-439c-49f0-9325-f4111a5fc659-kube-api-access-gkf2k\") pod \"monitoring-plugin-77f4f76594-tnlqc\" (UID: \"3eff329b-439c-49f0-9325-f4111a5fc659\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:39.401111 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.401026 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:39.703689 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:39.703267 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc"] Oct 30 23:35:39.708181 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:35:39.708077 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eff329b_439c_49f0_9325_f4111a5fc659.slice/crio-a0d2cc1d2704dcc34109b2a8f1df6c06fb8ae1b40b76f11bedf739c2fec328cb WatchSource:0}: Error finding container a0d2cc1d2704dcc34109b2a8f1df6c06fb8ae1b40b76f11bedf739c2fec328cb: Status 404 returned error can't find the container with id a0d2cc1d2704dcc34109b2a8f1df6c06fb8ae1b40b76f11bedf739c2fec328cb Oct 30 23:35:40.070404 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:40.070363 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" event={"ID":"3eff329b-439c-49f0-9325-f4111a5fc659","Type":"ContainerStarted","Data":"a0d2cc1d2704dcc34109b2a8f1df6c06fb8ae1b40b76f11bedf739c2fec328cb"} Oct 30 23:35:40.073968 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:40.073937 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerStarted","Data":"4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4"} Oct 30 23:35:40.074110 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:40.074009 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerStarted","Data":"ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134"} Oct 30 23:35:40.074110 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:40.074054 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerStarted","Data":"cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca"} Oct 30 23:35:40.074110 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:40.074088 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerStarted","Data":"a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb"} Oct 30 23:35:40.074247 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:40.074111 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerStarted","Data":"e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864"} Oct 30 23:35:41.097172 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:41.097113 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerStarted","Data":"cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4"} Oct 30 23:35:41.182580 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:41.182526 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.977453943 podStartE2EDuration="6.182511278s" totalImagesPullingTime="3.191222083s" totalInitContainerRuntime="13.835252ms" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:41.181451403 +0000 UTC m=+61.190751219" watchObservedRunningTime="2026-10-30 23:35:41.182511278 +0000 UTC m=+61.191811089" Oct 30 23:35:42.028322 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:42.028293 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:42.103892 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:42.103846 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" event={"ID":"3eff329b-439c-49f0-9325-f4111a5fc659","Type":"ContainerStarted","Data":"ad4fbeeebfae254b599528f9cd029e0e79328eae3137ac390bbc73a154a8dd75"} Oct 30 23:35:42.104739 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:42.104717 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:42.110567 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:42.110544 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:42.141537 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:42.141487 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" podStartSLOduration=1.592801892 podStartE2EDuration="3.141469204s" totalImagesPullingTime="1.548667312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:42.140697455 +0000 UTC m=+62.149997272" watchObservedRunningTime="2026-10-30 23:35:42.141469204 +0000 UTC m=+62.150769019" Oct 30 23:35:42.621085 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:42.621045 2634 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:42.621272 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:42.621118 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:42.626745 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:42.626721 2634 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:43.111084 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.110890 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:43.548601 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.548569 2634 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dbcd5d88c-jnld8"] Oct 30 23:35:43.552014 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.551988 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.603641 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.603608 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 30 23:35:43.604974 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.604941 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dbcd5d88c-jnld8"] Oct 30 23:35:43.644714 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.644688 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7l82\" (UniqueName: \"kubernetes.io/projected/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-kube-api-access-q7l82\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.644836 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.644720 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-oauth-serving-cert\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.644836 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.644749 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-tmp\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.644836 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.644778 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-service-ca\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.645000 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.644922 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-trusted-ca-bundle\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.645000 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.644967 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-config\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.645000 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.644988 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-oauth-config\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.645173 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.645011 2634 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-serving-cert\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.745891 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.745854 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-trusted-ca-bundle\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.746058 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.745924 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-config\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.746058 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.745959 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-oauth-config\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.746058 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.745992 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-serving-cert\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.746058 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.746017 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7l82\" (UniqueName: \"kubernetes.io/projected/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-kube-api-access-q7l82\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.746058 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.746043 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-oauth-serving-cert\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.746328 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.746076 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-tmp\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.746328 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.746107 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-service-ca\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.746731 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.746712 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-service-ca\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.746846 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.746824 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-trusted-ca-bundle\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.746888 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.746824 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-config\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.747246 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.747223 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-tmp\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.747457 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.747438 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-oauth-serving-cert\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.749020 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.748999 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-oauth-config\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.749796 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.749772 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-serving-cert\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.766990 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.766970 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7l82\" (UniqueName: \"kubernetes.io/projected/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-kube-api-access-q7l82\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:43.864354 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:43.864288 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:44.163984 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:44.163909 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dbcd5d88c-jnld8"] Oct 30 23:35:44.171900 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:35:44.171852 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eac4053_9b77_4a82_9b9c_2ad59058f1bb.slice/crio-c24b668460a6b72acfa4ce7083af2881d761e54fdaf3434ed3f7be57744f391d WatchSource:0}: Error finding container c24b668460a6b72acfa4ce7083af2881d761e54fdaf3434ed3f7be57744f391d: Status 404 returned error can't find the container with id c24b668460a6b72acfa4ce7083af2881d761e54fdaf3434ed3f7be57744f391d Oct 30 23:35:45.116452 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.116414 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbcd5d88c-jnld8" event={"ID":"8eac4053-9b77-4a82-9b9c-2ad59058f1bb","Type":"ContainerStarted","Data":"c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6"} Oct 30 23:35:45.116639 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.116466 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbcd5d88c-jnld8" event={"ID":"8eac4053-9b77-4a82-9b9c-2ad59058f1bb","Type":"ContainerStarted","Data":"c24b668460a6b72acfa4ce7083af2881d761e54fdaf3434ed3f7be57744f391d"} Oct 30 23:35:45.161230 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.161181 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6dbcd5d88c-jnld8" podStartSLOduration=2.1611524 podStartE2EDuration="2.1611524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:45.160622517 +0000 UTC m=+65.169922330" watchObservedRunningTime="2026-10-30 23:35:45.1611524 +0000 UTC m=+65.170452273" Oct 30 23:35:45.360241 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.360208 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:45.360241 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.360246 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:45.374057 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.373991 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 23:35:45.374208 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.374108 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 23:35:45.383678 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.383655 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:45.383783 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.383740 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:45.461545 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.461509 2634 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbfk\" (UniqueName: \"kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk\") pod \"network-check-target-d7mfp\" (UID: \"c3fdf510-52fb-4e1e-92c9-5208cb680d05\") " pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:45.464599 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.464579 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tzsrk\"" Oct 30 23:35:45.471702 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.471677 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:45.474977 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.474957 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 23:35:45.496422 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.496391 2634 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 23:35:45.506035 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.506013 2634 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rbfk\" (UniqueName: \"kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk\") pod \"network-check-target-d7mfp\" (UID: \"c3fdf510-52fb-4e1e-92c9-5208cb680d05\") " pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:45.657209 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.657123 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-wj7js\"" Oct 30 23:35:45.663565 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.663528 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:45.773125 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.773092 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bgt8k"] Oct 30 23:35:45.774017 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.773991 2634 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-p2ccw\"" Oct 30 23:35:45.776464 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:35:45.776436 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c3e89e_58f0_40af_9c40_63be495d5482.slice/crio-03e4dc948afcb026070e1c0b0bd56cfd569ae38d92e8dff079bea06891250055 WatchSource:0}: Error finding container 03e4dc948afcb026070e1c0b0bd56cfd569ae38d92e8dff079bea06891250055: Status 404 returned error can't find the container with id 03e4dc948afcb026070e1c0b0bd56cfd569ae38d92e8dff079bea06891250055 Oct 30 23:35:45.780725 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.780527 2634 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:45.965423 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:45.965343 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dhk5w"] Oct 30 23:35:46.082362 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:46.082328 2634 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d7mfp"] Oct 30 23:35:46.091716 ip-10-0-138-47 kubenswrapper[2634]: W1030 23:35:46.091670 2634 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3fdf510_52fb_4e1e_92c9_5208cb680d05.slice/crio-e795c35eaa025fe5b4aeae7ffab88e8fbdb70a900dbf5290c2975a4577d554fc WatchSource:0}: Error finding container e795c35eaa025fe5b4aeae7ffab88e8fbdb70a900dbf5290c2975a4577d554fc: Status 404 returned error can't find the container with id e795c35eaa025fe5b4aeae7ffab88e8fbdb70a900dbf5290c2975a4577d554fc Oct 30 23:35:46.124783 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:46.124738 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d7mfp" event={"ID":"c3fdf510-52fb-4e1e-92c9-5208cb680d05","Type":"ContainerStarted","Data":"e795c35eaa025fe5b4aeae7ffab88e8fbdb70a900dbf5290c2975a4577d554fc"} Oct 30 23:35:46.126192 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:46.126148 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dhk5w" event={"ID":"1cc7c057-2789-4df5-8370-2244dc2f5d8b","Type":"ContainerStarted","Data":"c7ac24cfaf9e0b4fa95bcbfac4c67cb4595fd7d2ed78a98b631497e28afbc83e"} Oct 30 23:35:46.127469 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:46.127447 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgt8k" event={"ID":"48c3e89e-58f0-40af-9c40-63be495d5482","Type":"ContainerStarted","Data":"03e4dc948afcb026070e1c0b0bd56cfd569ae38d92e8dff079bea06891250055"} Oct 30 23:35:47.152248 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:47.152198 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgt8k" event={"ID":"48c3e89e-58f0-40af-9c40-63be495d5482","Type":"ContainerStarted","Data":"09f8f74e23e4b522c61df6d313895efbcb4dd1fefb378410f65b9a1eb635e27d"} Oct 30 23:35:47.153800 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:47.153767 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-ljn2m" event={"ID":"dca9509b-a5f9-4afd-baff-f10b6a9b0c7f","Type":"ContainerStarted","Data":"743e1d85d0ca9bbf985569490902337a18426fa60c02b148860f01773fd7555b"} Oct 30 23:35:47.154533 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:47.154514 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:47.162046 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:47.161961 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:47.209890 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:47.209436 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-ljn2m" podStartSLOduration=1.132713402 podStartE2EDuration="19.209423176s" totalImagesPullingTime="18.076709774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:47.208243084 +0000 UTC m=+67.217542896" watchObservedRunningTime="2026-10-30 23:35:47.209423176 +0000 UTC m=+67.218722987" Oct 30 23:35:48.177205 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:48.177153 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgt8k" event={"ID":"48c3e89e-58f0-40af-9c40-63be495d5482","Type":"ContainerStarted","Data":"f4b8b30208b9a85c87cff8ae248688748b1820049faa8d6f9080485a594ed911"} Oct 30 23:35:52.209179 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:52.209069 2634 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d7mfp" event={"ID":"c3fdf510-52fb-4e1e-92c9-5208cb680d05","Type":"ContainerStarted","Data":"003cb8121035709b6f2f534576500b41ca1b6df6cc193ab512325a409d09fbb1"} Oct 30 23:35:52.209947 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:52.209925 2634 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:52.249202 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:52.249102 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d7mfp" podStartSLOduration=65.468527224 podStartE2EDuration="1m11.249082795s" totalImagesPullingTime="5.780555571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:52.248285417 +0000 UTC m=+72.257585228" watchObservedRunningTime="2026-10-30 23:35:52.249082795 +0000 UTC m=+72.258382607" Oct 30 23:35:52.249443 ip-10-0-138-47 kubenswrapper[2634]: I1030 23:35:52.249403 2634 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bgt8k" podStartSLOduration=70.055824867 podStartE2EDuration="1m11.249394695s" totalImagesPullingTime="1.193569828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:35:48.220152836 +0000 UTC m=+68.229452647" watchObservedRunningTime="2026-10-30 23:35:52.249394695 +0000 UTC m=+72.258694507" Oct 30 23:35:53.706984 ip-10-0-138-47 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 23:35:53.726759 ip-10-0-138-47 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 23:35:53.726987 ip-10-0-138-47 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 23:35:53.727039 ip-10-0-138-47 systemd[1]: kubelet.service: Consumed 3.948s CPU time. Oct 30 23:35:53.740772 ip-10-0-138-47 systemd[1]: Starting Kubernetes Kubelet... Oct 30 23:35:53.841638 ip-10-0-138-47 kubenswrapper[6174]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 23:35:53.841638 ip-10-0-138-47 kubenswrapper[6174]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 23:35:53.841638 ip-10-0-138-47 kubenswrapper[6174]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 23:35:53.841638 ip-10-0-138-47 kubenswrapper[6174]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 23:35:53.844210 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844114 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:53.844210 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844206 6174 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:53.844210 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844210 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:53.844210 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844214 6174 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:53.844210 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844217 6174 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:53.844210 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844220 6174 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844223 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844227 6174 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844230 6174 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844233 6174 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844236 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844238 6174 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844241 6174 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844245 6174 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844248 6174 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844250 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844253 6174 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844256 6174 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844258 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844261 6174 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844264 6174 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844267 6174 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844269 6174 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844272 6174 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844275 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:53.844500 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844278 6174 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844281 6174 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844283 6174 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844286 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844289 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844291 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844294 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844298 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844300 6174 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844303 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844306 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844308 6174 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844311 6174 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844314 6174 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844316 6174 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844319 6174 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844322 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844325 6174 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844327 6174 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844330 6174 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:53.845105 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844333 6174 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844335 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844338 6174 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844340 6174 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844343 6174 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844346 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844348 6174 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844351 6174 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844354 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844359 6174 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844363 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844367 6174 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844370 6174 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844373 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844376 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844378 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844382 6174 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844385 6174 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844388 6174 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:53.845706 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844391 6174 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844394 6174 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844397 6174 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844399 6174 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844402 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844405 6174 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844407 6174 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844410 6174 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844413 6174 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844416 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844418 6174 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844422 6174 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844424 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844427 6174 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844430 6174 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844433 6174 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844435 6174 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844440 6174 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844443 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:53.846303 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844446 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844449 6174 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844452 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844455 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844457 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844460 6174 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844463 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844466 6174 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844468 6174 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844471 6174 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844474 6174 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844476 6174 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844479 6174 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844481 6174 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844484 6174 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844494 6174 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844499 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844503 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844507 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844514 6174 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:53.846957 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844517 6174 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844520 6174 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.844522 6174 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845416 6174 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845425 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845429 6174 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845432 6174 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845435 6174 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845438 6174 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845441 6174 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845443 6174 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845446 6174 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845449 6174 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845452 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845455 6174 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845457 6174 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845460 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845463 6174 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845466 6174 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845468 6174 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:53.847626 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845471 6174 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845475 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845480 6174 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845484 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845487 6174 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845490 6174 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845493 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845495 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845499 6174 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845501 6174 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845504 6174 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845507 6174 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845510 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845513 6174 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845515 6174 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845518 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845521 6174 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845523 6174 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845526 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:53.848346 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845530 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845535 6174 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845539 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845541 6174 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845544 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845547 6174 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845550 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845552 6174 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845555 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845558 6174 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845561 6174 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845564 6174 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845567 6174 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845570 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845572 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845575 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845578 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845580 6174 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845583 6174 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:53.848990 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845586 6174 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845589 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845591 6174 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845595 6174 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845597 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845600 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845602 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845605 6174 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845607 6174 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845610 6174 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845613 6174 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845617 6174 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845623 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845628 6174 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845633 6174 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845637 6174 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845643 6174 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845647 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845652 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:53.849622 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845658 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845662 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845668 6174 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845674 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845679 6174 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845683 6174 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845688 6174 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845693 6174 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845697 6174 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845702 6174 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845706 6174 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845710 6174 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845714 6174 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845719 6174 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845723 6174 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845727 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845732 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845737 6174 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845742 6174 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:53.850296 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845746 6174 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845750 6174 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845755 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845759 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845764 6174 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845768 6174 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845773 6174 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845777 6174 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845781 6174 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845786 6174 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845790 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845792 6174 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.845796 6174 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846405 6174 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846413 6174 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846416 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846418 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846421 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846424 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846430 6174 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:53.850873 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846435 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846439 6174 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846443 6174 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846447 6174 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846452 6174 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846457 6174 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846461 6174 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846465 6174 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846469 6174 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846471 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846475 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846478 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846481 6174 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846483 6174 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846487 6174 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846489 6174 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846492 6174 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846495 6174 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846497 6174 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:53.851588 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846500 6174 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846502 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846505 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846508 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846512 6174 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846516 6174 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846522 6174 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846526 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846531 6174 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846534 6174 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846536 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846539 6174 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846543 6174 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846548 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846552 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846556 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846560 6174 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846563 6174 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846566 6174 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:53.852372 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846568 6174 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846571 6174 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846574 6174 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846577 6174 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846579 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846584 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846588 6174 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846592 6174 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846597 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846602 6174 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846606 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846610 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846615 6174 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846619 6174 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846623 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846628 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846631 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846634 6174 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846637 6174 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:53.853183 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846641 6174 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846646 6174 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846652 6174 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846656 6174 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846660 6174 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846666 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846673 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846678 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846682 6174 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846685 6174 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846687 6174 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846690 6174 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846693 6174 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846695 6174 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846698 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846700 6174 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846703 6174 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846705 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846710 6174 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846715 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:53.853831 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846719 6174 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846723 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846727 6174 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846732 6174 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846736 6174 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846739 6174 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846741 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846744 6174 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846747 6174 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846749 6174 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846752 6174 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846756 6174 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846762 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846766 6174 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846773 6174 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846777 6174 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846780 6174 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846783 6174 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846789 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:53.854552 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846794 6174 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846800 6174 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.846804 6174 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.846933 6174 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.846953 6174 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.846960 6174 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.846967 6174 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.846972 6174 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.846976 6174 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.846981 6174 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.846985 6174 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.846988 6174 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.846991 6174 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.846997 6174 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847003 6174 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847009 6174 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847014 6174 flags.go:64] FLAG: --cgroup-root="" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847019 6174 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847024 6174 flags.go:64] FLAG: --client-ca-file="" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847027 6174 flags.go:64] FLAG: --cloud-provider="external" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847031 6174 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847037 6174 flags.go:64] FLAG: --cluster-domain="" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847041 6174 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 23:35:53.855147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847046 6174 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847051 6174 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847058 6174 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847064 6174 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847069 6174 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847075 6174 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847081 6174 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847085 6174 flags.go:64] FLAG: --contention-profiling="false" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847092 6174 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847096 6174 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847101 6174 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847106 6174 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847113 6174 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847118 6174 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847124 6174 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847128 6174 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847131 6174 flags.go:64] FLAG: --enable-server="true" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847135 6174 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847139 6174 flags.go:64] FLAG: --event-burst="100" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847142 6174 flags.go:64] FLAG: --event-qps="50" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847145 6174 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847148 6174 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847167 6174 flags.go:64] FLAG: --eviction-hard="" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847180 6174 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 23:35:53.855939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847185 6174 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847190 6174 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847195 6174 flags.go:64] FLAG: --eviction-soft="" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847202 6174 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847205 6174 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847208 6174 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847211 6174 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847214 6174 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847218 6174 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847221 6174 flags.go:64] FLAG: --feature-gates="" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847225 6174 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847228 6174 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847231 6174 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847235 6174 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847238 6174 flags.go:64] FLAG: --healthz-port="10248" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847241 6174 flags.go:64] FLAG: --help="false" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847246 6174 flags.go:64] FLAG: --hostname-override="ip-10-0-138-47.ec2.internal" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847249 6174 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847252 6174 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847256 6174 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847259 6174 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847262 6174 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847265 6174 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 23:35:53.856835 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847268 6174 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847272 6174 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847275 6174 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847278 6174 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847281 6174 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847284 6174 flags.go:64] FLAG: --kube-reserved="" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847287 6174 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847290 6174 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847293 6174 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847297 6174 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847302 6174 flags.go:64] FLAG: --lock-file="" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847307 6174 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847312 6174 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847318 6174 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847326 6174 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847331 6174 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847336 6174 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847341 6174 flags.go:64] FLAG: --logging-format="text" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847345 6174 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847351 6174 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847356 6174 flags.go:64] FLAG: --manifest-url="" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847361 6174 flags.go:64] FLAG: --manifest-url-header="" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847368 6174 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847373 6174 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847378 6174 flags.go:64] FLAG: --max-pods="110" Oct 30 23:35:53.857669 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847385 6174 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847390 6174 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847395 6174 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847400 6174 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847406 6174 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847411 6174 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847416 6174 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847425 6174 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847429 6174 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847432 6174 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847435 6174 flags.go:64] FLAG: --pod-cidr="" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847438 6174 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847441 6174 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847445 6174 flags.go:64] FLAG: --pods-per-core="0" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847450 6174 flags.go:64] FLAG: --port="10250" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847455 6174 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847459 6174 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0196086e017f8c9e7" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847466 6174 flags.go:64] FLAG: --qos-reserved="" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847471 6174 flags.go:64] FLAG: --read-only-port="10255" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847476 6174 flags.go:64] FLAG: --register-node="true" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847480 6174 flags.go:64] FLAG: --register-with-taints="" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847487 6174 flags.go:64] FLAG: --registry-burst="10" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847490 6174 flags.go:64] FLAG: --registry-qps="5" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847493 6174 flags.go:64] FLAG: --reserved-cpus="" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847496 6174 flags.go:64] FLAG: --reserved-memory="" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847500 6174 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 23:35:53.858499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847505 6174 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847510 6174 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847516 6174 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847521 6174 flags.go:64] FLAG: --runonce="false" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847526 6174 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847530 6174 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847535 6174 flags.go:64] FLAG: --seccomp-default="false" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847539 6174 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847541 6174 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847558 6174 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847563 6174 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847577 6174 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847581 6174 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847584 6174 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847587 6174 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847592 6174 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847597 6174 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847602 6174 flags.go:64] FLAG: --system-cgroups="" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847607 6174 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847616 6174 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847621 6174 flags.go:64] FLAG: --tls-cert-file="" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847625 6174 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847633 6174 flags.go:64] FLAG: --tls-min-version="" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847638 6174 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847642 6174 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 23:35:53.859388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847646 6174 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847649 6174 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847654 6174 flags.go:64] FLAG: --v="2" Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847661 6174 flags.go:64] FLAG: --version="false" Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847667 6174 flags.go:64] FLAG: --vmodule="" Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847673 6174 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.847679 6174 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847841 6174 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847846 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847849 6174 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847852 6174 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847855 6174 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847858 6174 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847862 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847865 6174 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847868 6174 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847871 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847874 6174 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847876 6174 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847879 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847882 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:53.860208 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847884 6174 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847891 6174 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847895 6174 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847900 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847904 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847908 6174 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847912 6174 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847916 6174 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847921 6174 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847925 6174 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847929 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847934 6174 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847939 6174 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847943 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847948 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847953 6174 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847956 6174 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847958 6174 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847961 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847964 6174 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:53.860896 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847969 6174 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847973 6174 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847977 6174 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847981 6174 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847990 6174 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847993 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847996 6174 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.847999 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848003 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848010 6174 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848016 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848022 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848026 6174 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848031 6174 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848034 6174 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848036 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848039 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848042 6174 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848045 6174 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:53.861694 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848047 6174 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848050 6174 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848053 6174 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848055 6174 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848058 6174 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848061 6174 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848064 6174 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848067 6174 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848069 6174 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848072 6174 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848075 6174 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848079 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848083 6174 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848090 6174 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848095 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848101 6174 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848105 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848112 6174 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848117 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:53.862420 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848121 6174 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848125 6174 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848130 6174 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848134 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848138 6174 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848143 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848147 6174 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848152 6174 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848171 6174 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848175 6174 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848179 6174 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848184 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848188 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848192 6174 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848196 6174 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848201 6174 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848205 6174 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848209 6174 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848214 6174 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848219 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:53.863075 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848223 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848227 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848231 6174 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848234 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848237 6174 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848240 6174 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848242 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848245 6174 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848248 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848251 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848255 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848258 6174 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848261 6174 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848263 6174 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.848302 6174 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 23:35:53.863730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848344 6174 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848350 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848353 6174 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848356 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848362 6174 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848366 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848370 6174 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848374 6174 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848379 6174 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848383 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848386 6174 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848388 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848391 6174 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848394 6174 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848396 6174 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848399 6174 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848402 6174 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848405 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848408 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848411 6174 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:53.864270 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848414 6174 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848417 6174 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848419 6174 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848422 6174 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848424 6174 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848427 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848429 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848432 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848436 6174 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848439 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848441 6174 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848444 6174 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848446 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848449 6174 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848452 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848454 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848458 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848463 6174 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848467 6174 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:53.865077 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848471 6174 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848476 6174 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848481 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848485 6174 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848489 6174 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848493 6174 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848497 6174 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848502 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848505 6174 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848508 6174 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848512 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848515 6174 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848518 6174 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848521 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848523 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848526 6174 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848528 6174 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848533 6174 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848537 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848541 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:53.865794 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848545 6174 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848551 6174 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848557 6174 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848561 6174 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848566 6174 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848570 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848575 6174 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848579 6174 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848584 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848591 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848595 6174 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848600 6174 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848603 6174 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848605 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848609 6174 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848612 6174 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848614 6174 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848617 6174 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848620 6174 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848622 6174 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:53.866486 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848626 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848629 6174 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848631 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848634 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848639 6174 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848645 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848650 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848654 6174 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848658 6174 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848661 6174 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848664 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848667 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848669 6174 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848673 6174 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848676 6174 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848679 6174 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848682 6174 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848684 6174 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848687 6174 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:53.867147 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848690 6174 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848692 6174 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848696 6174 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848698 6174 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848702 6174 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848705 6174 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848707 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.848710 6174 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.855610 6174 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.855633 6174 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.855658 6174 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.855667 6174 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855731 6174 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855740 6174 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855746 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855750 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855754 6174 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855758 6174 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855762 6174 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855766 6174 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:53.867790 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855769 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855773 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855775 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855778 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855782 6174 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855784 6174 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855787 6174 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855790 6174 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855792 6174 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855796 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855801 6174 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855806 6174 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855810 6174 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855813 6174 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855820 6174 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855824 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855829 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855834 6174 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855837 6174 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855840 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:53.868459 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855843 6174 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855845 6174 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855848 6174 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855851 6174 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855854 6174 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855856 6174 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855859 6174 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855862 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855864 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855867 6174 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855870 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855872 6174 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855875 6174 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855878 6174 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855880 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855883 6174 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855887 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855892 6174 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855898 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:53.869139 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855903 6174 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855908 6174 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855912 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855917 6174 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855921 6174 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855925 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855929 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855933 6174 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855937 6174 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855941 6174 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855945 6174 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855950 6174 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855955 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855960 6174 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855964 6174 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855969 6174 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855974 6174 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855979 6174 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855984 6174 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855988 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:53.869870 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855993 6174 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.855997 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856002 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856006 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856010 6174 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856015 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856019 6174 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856023 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856028 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856033 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856037 6174 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856041 6174 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856046 6174 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856051 6174 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856055 6174 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856060 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856064 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856069 6174 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:53.870532 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856073 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856078 6174 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856081 6174 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856084 6174 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856088 6174 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856092 6174 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856096 6174 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856101 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856105 6174 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856110 6174 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856115 6174 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856119 6174 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856124 6174 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856127 6174 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856129 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856132 6174 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856135 6174 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856137 6174 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856144 6174 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856151 6174 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:53.871145 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856169 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.856214 6174 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856431 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856437 6174 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856441 6174 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856444 6174 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856447 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856452 6174 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856456 6174 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856461 6174 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856465 6174 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856469 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856473 6174 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856477 6174 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856482 6174 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856485 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:53.871800 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856487 6174 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856490 6174 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856493 6174 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856495 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856498 6174 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856501 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856503 6174 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856506 6174 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856508 6174 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856511 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856513 6174 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856516 6174 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856519 6174 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856521 6174 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856524 6174 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856526 6174 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856531 6174 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856535 6174 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856538 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:53.872323 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856541 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856543 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856546 6174 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856548 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856551 6174 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856557 6174 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856561 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856565 6174 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856569 6174 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856572 6174 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856575 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856577 6174 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856581 6174 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856585 6174 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856589 6174 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856594 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856599 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856602 6174 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856604 6174 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856609 6174 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:53.872911 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856613 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856618 6174 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856622 6174 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856626 6174 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856629 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856632 6174 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856635 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856637 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856640 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856643 6174 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856646 6174 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856648 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856651 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856654 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856656 6174 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856659 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856661 6174 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856664 6174 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856667 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:53.873592 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856670 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856674 6174 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856678 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856683 6174 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856686 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856690 6174 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856695 6174 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856700 6174 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856705 6174 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856709 6174 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856713 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856717 6174 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856722 6174 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856726 6174 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856730 6174 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856734 6174 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856739 6174 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856743 6174 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856747 6174 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856751 6174 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:53.874279 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856755 6174 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856759 6174 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856764 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856767 6174 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856770 6174 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856772 6174 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856775 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856778 6174 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856781 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856785 6174 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856788 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856791 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856795 6174 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856798 6174 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.856825 6174 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856862 6174 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 23:35:53.874992 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856867 6174 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856871 6174 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856876 6174 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856880 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856886 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856890 6174 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856894 6174 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856899 6174 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856904 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856906 6174 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856909 6174 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856912 6174 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856914 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856917 6174 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856920 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856922 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856925 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856927 6174 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856932 6174 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856935 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 23:35:53.875761 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856938 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856940 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856943 6174 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856945 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856948 6174 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856951 6174 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856953 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856956 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856958 6174 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856961 6174 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856964 6174 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856967 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856969 6174 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856972 6174 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856974 6174 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856977 6174 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856979 6174 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856982 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856984 6174 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856987 6174 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 23:35:53.876600 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856990 6174 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856994 6174 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.856998 6174 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857002 6174 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857007 6174 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857011 6174 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857014 6174 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857016 6174 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857019 6174 feature_gate.go:386] unrecognized feature gate: Example Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857022 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857028 6174 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857033 6174 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857037 6174 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857041 6174 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857045 6174 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857050 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857058 6174 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857062 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857065 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 23:35:53.877355 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857068 6174 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857072 6174 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857076 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857082 6174 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857086 6174 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857090 6174 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857093 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857096 6174 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857098 6174 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857101 6174 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857104 6174 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857106 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857109 6174 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857112 6174 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857115 6174 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857117 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857120 6174 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857122 6174 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857125 6174 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 23:35:53.877963 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857127 6174 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857130 6174 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857133 6174 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857137 6174 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857145 6174 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857150 6174 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857153 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857170 6174 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857175 6174 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857179 6174 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857182 6174 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857186 6174 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857188 6174 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857193 6174 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857196 6174 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857198 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857201 6174 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857209 6174 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857213 6174 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 23:35:53.878629 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857218 6174 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857222 6174 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857227 6174 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857231 6174 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857235 6174 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857240 6174 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857244 6174 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:35:53.857248 6174 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.857316 6174 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.858545 6174 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.858612 6174 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.858837 6174 server.go:1014] "Starting client certificate rotation" Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.858996 6174 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.859052 6174 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 23:29:41 +0000 UTC" deadline="2028-04-09 18:51:29.977969025 +0000 UTC" Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.859099 6174 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12643h15m36.118873596s" Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.859407 6174 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 23:35:53.879237 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.860731 6174 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 23:35:53.879821 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.862317 6174 log.go:25] "Validated CRI v1 runtime API" Oct 30 23:35:53.879821 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.864754 6174 log.go:25] "Validated CRI v1 image API" Oct 30 23:35:53.879821 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.865638 6174 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 23:35:53.879821 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.868295 6174 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 94f92131-9ed5-4f6d-b198-c45c1cee60ce:/dev/nvme0n1p4 d365ec25-25a4-4ec6-9760-d89e06d741f0:/dev/nvme0n1p3] Oct 30 23:35:53.879975 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.868321 6174 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/03e4dc948afcb026070e1c0b0bd56cfd569ae38d92e8dff079bea06891250055/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/03e4dc948afcb026070e1c0b0bd56cfd569ae38d92e8dff079bea06891250055/userdata/shm major:0 minor:375 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0acd2715cb67f1083440f6a51385987c88564e61afd2ca10cd08402637079eab/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0acd2715cb67f1083440f6a51385987c88564e61afd2ca10cd08402637079eab/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/207a1c5fc9534a993035ec0d9ad43fd68919560f78e8e9c5db8216a6b81c95f3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/207a1c5fc9534a993035ec0d9ad43fd68919560f78e8e9c5db8216a6b81c95f3/userdata/shm major:0 minor:212 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/23894e914379904a5c7ea7ff6b349d59f6a4f7dd9bcb7b25673bca68722a8a76/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/23894e914379904a5c7ea7ff6b349d59f6a4f7dd9bcb7b25673bca68722a8a76/userdata/shm major:0 minor:276 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/372ea3c2192894a44e591e1551ba3c4bfb79e0e317ea3d64e3935a9c8b349527/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/372ea3c2192894a44e591e1551ba3c4bfb79e0e317ea3d64e3935a9c8b349527/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/39904baf573b1176c4c2a384caecdf284f926bb077167918250788b937bfb34e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/39904baf573b1176c4c2a384caecdf284f926bb077167918250788b937bfb34e/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4893badea04ec167ff7fddf04a9a9d9eb23aadfd09c2f8f6c67f67b082084654/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4893badea04ec167ff7fddf04a9a9d9eb23aadfd09c2f8f6c67f67b082084654/userdata/shm major:0 minor:283 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6873988f97e8ecb25c550db400e9bd79a02808d71315cf8550774f643b19db0d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6873988f97e8ecb25c550db400e9bd79a02808d71315cf8550774f643b19db0d/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6c25b175d7521262fe8b7e28fb8e0ad05158a442f90f6872b49f043546b66a3d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6c25b175d7521262fe8b7e28fb8e0ad05158a442f90f6872b49f043546b66a3d/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/75826187d25a5d5f6fc3bc280335c119e2e52c9f92b72cfca9c13858a9f52a55/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/75826187d25a5d5f6fc3bc280335c119e2e52c9f92b72cfca9c13858a9f52a55/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7be32046f516ee4eec26b214d1d5d99203e6e90078546f242e2c4316a78b9add/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7be32046f516ee4eec26b214d1d5d99203e6e90078546f242e2c4316a78b9add/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/858a29eaba94849bdcc6aee1470b8e0ad860374e3215c05c5350f924cee414e2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/858a29eaba94849bdcc6aee1470b8e0ad860374e3215c05c5350f924cee414e2/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a0d2cc1d2704dcc34109b2a8f1df6c06fb8ae1b40b76f11bedf739c2fec328cb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a0d2cc1d2704dcc34109b2a8f1df6c06fb8ae1b40b76f11bedf739c2fec328cb/userdata/shm major:0 minor:319 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a9e6823a8410c87862e771c6a1f96a97fe55fbab8437d855cc3ae7532ee5ae95/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a9e6823a8410c87862e771c6a1f96a97fe55fbab8437d855cc3ae7532ee5ae95/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ac5e4f15d3ba82a691c6a0f7430db1e6d54a79fa0b2eeda3b12064cdd6f047e3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ac5e4f15d3ba82a691c6a0f7430db1e6d54a79fa0b2eeda3b12064cdd6f047e3/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c24b668460a6b72acfa4ce7083af2881d761e54fdaf3434ed3f7be57744f391d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c24b668460a6b72acfa4ce7083af2881d761e54fdaf3434ed3f7be57744f391d/userdata/shm major:0 minor:363 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c7ac24cfaf9e0b4fa95bcbfac4c67cb4595fd7d2ed78a98b631497e28afbc83e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c7ac24cfaf9e0b4fa95bcbfac4c67cb4595fd7d2ed78a98b631497e28afbc83e/userdata/shm major:0 minor:378 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c836e8c92487296727c5dab73b7272d153bd5e43c81bcee0866c6c274146e066/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c836e8c92487296727c5dab73b7272d153bd5e43c81bcee0866c6c274146e066/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d14eff06a8a23475968525d5e9c6055aacffb4d3608bcfd67261998eaec700b0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d14eff06a8a23475968525d5e9c6055aacffb4d3608bcfd67261998eaec700b0/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d5bd256110a2036d4f2f29a185f8afc72510131e60ab9f535c052e3309119d07/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d5bd256110a2036d4f2f29a185f8afc72510131e60ab9f535c052e3309119d07/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d9f4fa57baa1f18328bf7f1b9136484b845c4fedf53fdeb58974d63f1df350d3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d9f4fa57baa1f18328bf7f1b9136484b845c4fedf53fdeb58974d63f1df350d3/userdata/shm major:0 minor:62 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e4fc9dadb24dd9e62999cc340212c8b225132620b5e3a25f0f95a4d1da78d825/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e4fc9dadb24dd9e62999cc340212c8b225132620b5e3a25f0f95a4d1da78d825/userdata/shm major:0 minor:297 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e795c35eaa025fe5b4aeae7ffab88e8fbdb70a900dbf5290c2975a4577d554fc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e795c35eaa025fe5b4aeae7ffab88e8fbdb70a900dbf5290c2975a4577d554fc/userdata/shm major:0 minor:382 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00844e37-d582-444e-ae95-a498060b4519/volumes/kubernetes.io~projected/kube-api-access-49jkb:{mountpoint:/var/lib/kubelet/pods/00844e37-d582-444e-ae95-a498060b4519/volumes/kubernetes.io~projected/kube-api-access-49jkb major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volume-subpaths/web-config/alertmanager/9 major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volume-subpaths/web-config/config-reloader/6 major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~empty-dir/config-out major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~projected/kube-api-access-4fbw2:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~projected/kube-api-access-4fbw2 major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~projected/tls-assets major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/config-volume major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/web-config major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04a4d6df-3ad8-44f6-9f53-4760069a9b9d/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/04a4d6df-3ad8-44f6-9f53-4760069a9b9d/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04a4d6df-3ad8-44f6-9f53-4760069a9b9d/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/04a4d6df-3ad8-44f6-9f53-4760069a9b9d/volumes/kubernetes.io~empty-dir/tmp major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04a4d6df-3ad8-44f6-9f53-4760069a9b9d/volumes/kubernetes.io~projected/kube-api-access-xgpxd:{mountpoint:/var/lib/kubelet/pods/04a4d6df-3ad8-44f6-9f53-4760069a9b9d/volumes/kubernetes.io~projected/kube-api-access-xgpxd major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/04e0565a-5dc8-4461-87fe-6f9dcb2a1468/volumes/kubernetes.io~projected/kube-api-access-wjvrc:{mountpoint:/var/lib/kubelet/pods/04e0565a-5dc8-4461-87fe-6f9dcb2a1468/volumes/kubernetes.io~projected/kube-api-access-wjvrc major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0c018322-20cb-470c-ae55-7eaddfbb60ea/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/0c018322-20cb-470c-ae55-7eaddfbb60ea/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0c018322-20cb-470c-ae55-7eaddfbb60ea/volumes/kubernetes.io~projected/kube-api-access-jx6m2:{mountpoint:/var/lib/kubelet/pods/0c018322-20cb-470c-ae55-7eaddfbb60ea/volumes/kubernetes.io~projected/kube-api-access-jx6m2 major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0c018322-20cb-470c-ae55-7eaddfbb60ea/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/0c018322-20cb-470c-ae55-7eaddfbb60ea/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/16cf618c-6b7c-463c-9501-b27e41b837cc/volumes/kubernetes.io~projected/kube-api-access-prrbs:{mountpoint:/var/lib/kubelet/pods/16cf618c-6b7c-463c-9501-b27e41b837cc/volumes/kubernetes.io~projected/kube-api-access-prrbs major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1cc7c057-2789-4df5-8370-2244dc2f5d8b/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/1cc7c057-2789-4df5-8370-2244dc2f5d8b/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:374 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1fe30e1c-b403-4aca-868f-5bbc23f99e77/volumes/kubernetes.io~projected/kube-api-access-2rqmv:{mountpoint:/var/lib/kubelet/pods/1fe30e1c-b403-4aca-868f-5bbc23f99e77/volumes/kubernetes.io~projected/kube-api-access-2rqmv major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1fe30e1c-b403-4aca-868f-5bbc23f99e77/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/1fe30e1c-b403-4aca-868f-5bbc23f99e77/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/377989f5-3ed6-4546-9722-b341f03c8e39/volumes/kubernetes.io~projected/kube-api-access-ltd62:{mountpoint:/var/lib/kubelet/pods/377989f5-3ed6-4546-9722-b341f03c8e39/volumes/kubernetes.io~projected/kube-api-access-ltd62 major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3eff329b-439c-49f0-9325-f4111a5fc659/volumes/kubernetes.io~projected/kube-api-access-gkf2k:{mountpoint:/var/lib/kubelet/pods/3eff329b-439c-49f0-9325-f4111a5fc659/volumes/kubernetes.io~projected/kube-api-access-gkf2k major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3eff329b-439c-49f0-9325-f4111a5fc659/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/3eff329b-439c-49f0-9325-f4111a5fc659/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/48c3e89e-58f0-40af-9c40-63be495d5482/volumes/kubernetes.io~projected/kube-api-access-24d5c:{mountpoint:/var/lib/kubelet/pods/48c3e89e-58f0-40af-9c40-63be495d5482/volumes/kubernetes.io~projected/kube-api-access-24d5c major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/48c3e89e-58f0-40af-9c40-63be495d5482/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/48c3e89e-58f0-40af-9c40-63be495d5482/volumes/kubernetes.io~secret/metrics-certs major:0 minor:369 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8eac4053-9b77-4a82-9b9c-2ad59058f1bb/volumes/kubernetes.io~projected/kube-api-access-q7l82:{mountpoint:/var/lib/kubelet/pods/8eac4053-9b77-4a82-9b9c-2ad59058f1bb/volumes/kubernetes.io~projected/kube-api-access-q7l82 major:0 minor:362 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8eac4053-9b77-4a82-9b9c-2ad59058f1bb/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/8eac4053-9b77-4a82-9b9c-2ad59058f1bb/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:356 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8eac4053-9b77-4a82-9b9c-2ad59058f1bb/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/8eac4053-9b77-4a82-9b9c-2ad59058f1bb/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d559e44-7c9d-464e-be57-884cff742118/volumes/kubernetes.io~projected/kube-api-access-gw585:{mountpoint:/var/lib/kubelet/pods/9d559e44-7c9d-464e-be57-884cff742118/volumes/kubernetes.io~projected/kube-api-access-gw585 major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa89d93c-3459-445c-a4ad-2afc60b41ded/volumes/kubernetes.io~projected/kube-api-access-n97r4:{mountpoint:/var/lib/kubelet/pods/aa89d93c-3459-445c-a4ad-2afc60b41ded/volumes/kubernetes.io~projected/kube-api-access-n97r4 major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa89d93c-3459-445c-a4ad-2afc60b41ded/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/aa89d93c-3459-445c-a4ad-2afc60b41ded/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa89d93c-3459-445c-a4ad-2afc60b41ded/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/aa89d93c-3459-445c-a4ad-2afc60b41ded/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b44eee82-b560-4cab-8804-b1e77523635b/volumes/kubernetes.io~projected/kube-api-access-v45fc:{mountpoint:/var/lib/kubelet/pods/b44eee82-b560-4cab-8804-b1e77523635b/volumes/kubernetes.io~projected/kube-api-access-v45fc major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3fdf510-52fb-4e1e-92c9-5208cb680d05/volumes/kubernetes.io~projected/kube-api-access-5rbfk:{mountpoint:/var/lib/kubelet/pods/c3fdf510-52fb-4e1e-92c9-5208cb680d05/volumes/kubernetes.io~projected/kube-api-access-5rbfk major:0 minor:377 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf/volumes/kubernetes.io~projected/kube-api-access-b9rpw:{mountpoint:/var/lib/kubelet/pods/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf/volumes/kubernetes.io~projected/kube-api-access-b9rpw major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d221531c-2ebd-483d-8456-254ae91c3f85/volumes/kubernetes.io~projected/kube-api-access-hmmrq:{mountpoint:/var/lib/kubelet/pods/d221531c-2ebd-483d-8456-254ae91c3f85/volumes/kubernetes.io~projected/kube-api-access-hmmrq major:0 minor:275 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d221531c-2ebd-483d-8456-254ae91c3f85/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/d221531c-2ebd-483d-8456-254ae91c3f85/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d221531c-2ebd-483d-8456-254ae91c3f85/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/d221531c-2ebd-483d-8456-254ae91c3f85/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:274 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f/volumes/kubernetes.io~projected/kube-api-access-hx8xl:{mountpoint:/var/lib/kubelet/pods/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f/volumes/kubernetes.io~projected/kube-api-access-hx8xl major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dd63f30a-bd74-47e5-9692-e6a41b88ad6c/volumes/kubernetes.io~projected/kube-api-access-mwxrr:{mountpoint:/var/lib/kubelet/pods/dd63f30a-bd74-47e5-9692-e6a41b88ad6c/volumes/kubernetes.io~projected/kube-api-access-mwxrr major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dd63f30a-bd74-47e5-9692-e6a41b88ad6c/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/dd63f30a-bd74-47e5-9692-e6a41b88ad6c/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:280 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dd63f30a-bd74-47e5-9692-e6a41b88ad6c/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/dd63f30a-bd74-47e5-9692-e6a41b88ad6c/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:281 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf/volumes/kubernetes.io~secret/agent-certs major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee4cfb5e-2b2a-4831-8114-e57970cb7569/volumes/kubernetes.io~projected/kube-api-access-nnjfx:{mountpoint:/var/lib/kubelet/pods/ee4cfb5e-2b2a-4831-8114-e57970cb7569/volumes/kubernetes.io~projected/kube-api-access-nnjfx major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ee4cfb5e-2b2a-4831-8114-e57970cb7569/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/ee4cfb5e-2b2a-4831-8114-e57970cb7569/volumes/kubernetes.io~secret/metrics-tls major:0 minor:201 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/043fe2b1faf5a36a51812765eb3ce7c0bbfa9d7b1de3849211d093f75933a2e6/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/5f7e8915cf5f91351d5ed6184fa00b1e94e956d42cad8f1bc04c0ba7ef498ca1/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/2fc85f920ecb646f08812690aeb2c3aae0039c537134e3cd4ac03332db9a4bbf/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/9ec6dc2a047897dd4a7a68617ef65ddacddeaa003e9fff0aea225e7672389450/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/022d5e35831830f42c92fd45671b42e86558971b982fdcc1bd547541fd33859e/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/cbec49e2e37201f9e02a9af0f3c50ce3e6ce8b9e8b98fdcb45eb730eeb75eb45/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/998e96644313792a5bde04e87952669da3cc1141b00e8cb466f4672f564a89b5/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-126:{mountpoint:/var/lib/containers/storage/overlay/324c2bc872a76d537e8661c6b6ce09bec3b8fb61a50a111eaa5103af85cd1c89/merged major:0 minor:126 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/9264a9fae9d69b147d226b84c5869711e1afe5a249ac6ec72d26ebde582101c9/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/0d80ce07c5e4a921508173b55500a51af51a0ef2da157ad5d1bc797a63b29934/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/66e06064aeabd936baa3dbe291d76e69bb67bd1c79da9765346666399b596dd8/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-149:{mountpoint:/var/lib/containers/storage/overlay/668466c0f4048fda4c112b7defb06bb82ba4556cd332bd5fb777cb6a9456fd85/merged major:0 minor:149 fsType:overlay blockSize:0} overlay_0-151:{mountpoint:/var/lib/containers/storage/overlay/ecc05de3d022ce548c0f6fe9deebb2646a9f8979fa68437c5e4f9951a4dd7678/merged major:0 minor:151 fsType:overlay blockSize:0} overlay_0-153:{mountpoint:/var/lib/containers/storage/overlay/37f52f33c56a3a864759abc9c17c732a7e539277bccd634878378aca645a23fe/merged major:0 minor:153 fsType:overlay blockSize:0} overlay_0-161:{mountpoint:/var/lib/containers/storage/overlay/a483ea891c19a9fa9f41fbc1a2cffbbdd56c3f7a8c152da951195b0951abd24b/merged major:0 minor:161 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/99235d096a56bb6082cf2ab0e6294fa1714f80554a28565a1155cc915161ddaa/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/76a17e3cfa20072e9cfde3e1965aaeeb5f43dcd061e1c818e8a97f653e669756/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/10b02fe41de54a9cb3a4fa8e3c5e720ae27296a44dc8d59616647e9af7e34b7f/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/e97043813a61924efaf62f4eb3b951680d70def6628e07a779b2540d32726512/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/c6ba4ed73ac2ee9e3b49d5fabe7bb29f96dade7fd63322f7a768c6fdbd042221/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/a3f2da0d39158ee5106c550174ae8b6ec29e1d818461f0dc732ba61913fa66bf/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-214:{mountpoint:/var/lib/containers/storage/overlay/e786bcf941e5009dacc7f6e741555d389daddd9c44e16550b86a7b840c330491/merged major:0 minor:214 fsType:overlay blockSize:0} overlay_0-216:{mountpoint:/var/lib/containers/storage/overlay/e3f188b523a4a65f877710dc1fb2ef0c27d1887bf875ee514b94fd76800d340b/merged major:0 minor:216 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/03e0f86247524b8d574d5bfa2b79b1b92208c168f4600ac5c48245e02730038c/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/d6cad693bfe9f01df79c5611bc578da1c0f9f5cfa6c191e105f086a1ab12e48a/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/8bc5bea67f1c4c4c8e798c901122f4612468b85b7e1ba92d40dc17adfa76625f/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/99544f68fc36a59d2143c0d708e8bd57457b2ca3988a4343ee01f9f629085dc7/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-238:{mountpoint:/var/lib/containers/storage/overlay/825dc4d22eb382522a2197df1f1fbe99bed977d0f15294d6944a6ea4f30a809d/merged major:0 minor:238 fsType:overlay blockSize:0} overlay_0-240:{mountpoint:/var/lib/containers/storage/overlay/37d2a76efe60e74edd513eea283d523f4405e5d47ef9e9abf79baad0d00a1b7f/merged major:0 minor:240 fsType:overlay blockSize:0} overlay_0-242:{mountpoint:/var/lib/containers/storage/overlay/33944df0dad084f082fe6a7df11d91f7e4aec908a35fac3a6919907c8d539d93/merged major:0 minor:242 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/782c95c433202497c14b53b1eaf2c6684035a1ee86124d83b2ae3a214067a0ac/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/248a45c617b0d35639f890d7709effc675cb7adfc9458723bf7cd5baab9ad93c/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/e460e9939a531d8cebed136171b85df1a416bdb712c56ea50c9ae0baf6fab372/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/777b4d526eb945459181fbf0c255d96e5fe6b04f26badd594d0e54f18a19c013/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/b0039f7b96eafab5c3dafe23529ee316d26b77278625b268a4a307378e85f3d7/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-285:{mountpoint:/var/lib/containers/storage/overlay/f04ff1744d97031a1dac2d67006d562a87c322f6c453446223d56122da2f3f83/merged major:0 minor:285 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/8a051ee3a83269743de801c48494b0074caaa566bde2b6e608e313722c6ff1ec/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-301:{mountpoint:/var/lib/containers/storage/overlay/6237fc751a8b3a9d1b9263a48c85fa445115f72c80af3c0cc84b7755ecc3b745/merged major:0 minor:301 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/0f818447f020b87cd9e3ac6c74037949f487042cdf2739c42da1e90991ea91fe/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/48fec18a086efe1e82a518100e0c0b542aedcaa964b52a297ab3a4d5a8cd5277/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-321:{mountpoint:/var/lib/containers/storage/overlay/d985cf0e0029db5ecd5043d1d718f8c445c424788ce98b98099c97ef74b727a8/merged major:0 minor:321 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/a19dcdae221ad114a561ce6bc9c1781c39ab6f9f0285f2837f1e585a13b8490c/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/57c8e3cebd79c410eab409d3d58c1eb4ef549cf47fde7e60a4633842da2acac1/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-334:{mountpoint:/var/lib/containers/storage/overlay/ed68354158bdea1fe19c93bcc3c872591d7d594cbec9d41c4c9d2b7e00d296bc/merged major:0 minor:334 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/a3e528a5e2e8ce26755b8852afb0afbdd2218350393a3a1f008676e419541d3c/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/e0468d60b3616129c968546728209f27001cc2ec1ea74f357542ee1f078be7eb/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/0306ed06b1415334be883433068540b07e01ff1c50b07c961a47d6520e1c43c1/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-351:{mountpoint:/var/lib/containers/storage/overlay/82a6d23fe65cd66b6fec09a76503019431b8d2623e20b55dfdcb34ec0f742c37/merged major:0 minor:351 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/bdb4b86fd27217066ecf17d3096f4033308d50b3eda86222896a2ab6c6232ccf/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-367:{mountpoint:/var/lib/containers/storage/overlay/7046e796b4e724753aebc342d3302e851475aa90e439ee481d84c7990f2feb17/merged major:0 minor:367 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/a511148491fbc5f1e6e3eb18f1a69530d17aaa688d28dcdd3ef9e3271c9cccaf/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-384:{mountpoint:/var/lib/containers/storage/overlay/2fe3ca2d49c8e46477291b920618249e027f8e8ec88defe29007ca5b44b25c21/merged major:0 minor:384 fsType:overlay blockSize:0} overlay_0-386:{mountpoint:/var/lib/containers/storage/overlay/23fc17f7d3a17a8c4dba2ae2f8388afdae530ffe4719761afa9ea3cf61a68660/merged major:0 minor:386 fsType:overlay blockSize:0} overlay_0-388:{mountpoint:/var/lib/containers/storage/overlay/521207d58dd3c01b1ac361860febfef9018dae23c6ebdc80f699c7a9f9ea2082/merged major:0 minor:388 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/66a8950df7b9f3962bf443571a6eb33e79039e481bc87a813791927d1986a363/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-396:{mountpoint:/var/lib/containers/storage/overlay/3b7f5f72d1a1b3f8668a0aa25771ac11c22bb810b1bfa3a9f81787113075e9d9/merged major:0 minor:396 fsType:overlay blockSize:0} overlay_0-402:{mountpoint:/var/lib/containers/storage/overlay/36d5b4b275eb58e06cfbe963e7fcb9dacfa54f8c2e91ee86e467e08998f95f9a/merged major:0 minor:402 fsType:overlay blockSize:0} overlay_0-407:{mountpoint:/var/lib/containers/storage/overlay/7ac8cc5487c498b4a9fb44a07ef6a939b85a61bacda8447ae5cab7c8d7105373/merged major:0 minor:407 fsType:overlay blockSize:0} overlay_0-63:{mountpoint:/var/lib/containers/storage/overlay/c3ae0acdd77775a91af4e58be3619f61f053602594f56daa7fd0d28f29b0196f/merged major:0 minor:63 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/9aa85d45d80277e28dde9f81df71e1a58e1213fdfb5caada3a69f9caaa7f9194/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/3646d94d9545b78dc58240cd8fc519bf41878e893e578d4ee64e775307316916/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/6bc4c9f1260419e5a1fe46a585309da054a12e26cdc98c1a4c4b2a427d87cf18/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/77bff9c00331ed317b4dcbe3a77794256de8b304b720247a0fe6986941f06c2a/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/c772d3e5d01aeef8e7c7f341c3bd7e19fd68c5581fd55cfb2245a3cc104e8e69/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/f820c92b00c0fb1ed6e66ceb88ec945217a733d7a15ba98b0401dedb9c828002/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/ec2a95655bdabe8236b71dde64e523a1f8e003638ef48788d7bc7a8b4b322305/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/4a789274c9aae0436d7eb2310d46a46110e6b21b14705c5afc53bdf9c6ea8e90/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/7498252324a94d40330f5a3ac27ede307207f1098421cc9863725a2162a17a43/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 30 23:35:53.880343 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.879511 6174 manager.go:217] Machine: {Timestamp:2026-10-30 23:35:53.878820321 +0000 UTC m=+0.089406813 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099386 MemoryCapacity:33164320768 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27bd2a3b568c91eae2d507564ccf5a SystemUUID:ec27bd2a-3b56-8c91-eae2-d507564ccf5a BootID:c28e2a69-12f9-49ef-a521-45cddae48f39 Filesystems:[{Device:/run/containers/storage/overlay-containers/0acd2715cb67f1083440f6a51385987c88564e61afd2ca10cd08402637079eab/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/d221531c-2ebd-483d-8456-254ae91c3f85/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:269 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c24b668460a6b72acfa4ce7083af2881d761e54fdaf3434ed3f7be57744f391d/userdata/shm DeviceMajor:0 DeviceMinor:363 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/48c3e89e-58f0-40af-9c40-63be495d5482/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:369 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/b44eee82-b560-4cab-8804-b1e77523635b/volumes/kubernetes.io~projected/kube-api-access-v45fc DeviceMajor:0 DeviceMinor:56 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:288 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:287 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/0c018322-20cb-470c-ae55-7eaddfbb60ea/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:48 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-63 DeviceMajor:0 DeviceMinor:63 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7be32046f516ee4eec26b214d1d5d99203e6e90078546f242e2c4316a78b9add/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e4fc9dadb24dd9e62999cc340212c8b225132620b5e3a25f0f95a4d1da78d825/userdata/shm DeviceMajor:0 DeviceMinor:297 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a9e6823a8410c87862e771c6a1f96a97fe55fbab8437d855cc3ae7532ee5ae95/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c7ac24cfaf9e0b4fa95bcbfac4c67cb4595fd7d2ed78a98b631497e28afbc83e/userdata/shm DeviceMajor:0 DeviceMinor:378 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/16cf618c-6b7c-463c-9501-b27e41b837cc/volumes/kubernetes.io~projected/kube-api-access-prrbs DeviceMajor:0 DeviceMinor:53 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/75826187d25a5d5f6fc3bc280335c119e2e52c9f92b72cfca9c13858a9f52a55/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6c25b175d7521262fe8b7e28fb8e0ad05158a442f90f6872b49f043546b66a3d/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:289 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:291 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/8eac4053-9b77-4a82-9b9c-2ad59058f1bb/volumes/kubernetes.io~projected/kube-api-access-q7l82 DeviceMajor:0 DeviceMinor:362 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/372ea3c2192894a44e591e1551ba3c4bfb79e0e317ea3d64e3935a9c8b349527/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/dd63f30a-bd74-47e5-9692-e6a41b88ad6c/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:281 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/04a4d6df-3ad8-44f6-9f53-4760069a9b9d/volumes/kubernetes.io~projected/kube-api-access-xgpxd DeviceMajor:0 DeviceMinor:58 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ee4cfb5e-2b2a-4831-8114-e57970cb7569/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:201 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:294 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:293 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/04a4d6df-3ad8-44f6-9f53-4760069a9b9d/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:49 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/377989f5-3ed6-4546-9722-b341f03c8e39/volumes/kubernetes.io~projected/kube-api-access-ltd62 DeviceMajor:0 DeviceMinor:54 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-367 DeviceMajor:0 DeviceMinor:367 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582160384 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/0c018322-20cb-470c-ae55-7eaddfbb60ea/volumes/kubernetes.io~projected/kube-api-access-jx6m2 DeviceMajor:0 DeviceMinor:52 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-151 DeviceMajor:0 DeviceMinor:151 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c836e8c92487296727c5dab73b7272d153bd5e43c81bcee0866c6c274146e066/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-334 DeviceMajor:0 DeviceMinor:334 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e795c35eaa025fe5b4aeae7ffab88e8fbdb70a900dbf5290c2975a4577d554fc/userdata/shm DeviceMajor:0 DeviceMinor:382 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/858a29eaba94849bdcc6aee1470b8e0ad860374e3215c05c5350f924cee414e2/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-285 DeviceMajor:0 DeviceMinor:285 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3eff329b-439c-49f0-9325-f4111a5fc659/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:317 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/3eff329b-439c-49f0-9325-f4111a5fc659/volumes/kubernetes.io~projected/kube-api-access-gkf2k DeviceMajor:0 DeviceMinor:318 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/8eac4053-9b77-4a82-9b9c-2ad59058f1bb/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:356 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/48c3e89e-58f0-40af-9c40-63be495d5482/volumes/kubernetes.io~projected/kube-api-access-24d5c DeviceMajor:0 DeviceMinor:55 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/1fe30e1c-b403-4aca-868f-5bbc23f99e77/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/dd63f30a-bd74-47e5-9692-e6a41b88ad6c/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:280 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/dd63f30a-bd74-47e5-9692-e6a41b88ad6c/volumes/kubernetes.io~projected/kube-api-access-mwxrr DeviceMajor:0 DeviceMinor:282 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d14eff06a8a23475968525d5e9c6055aacffb4d3608bcfd67261998eaec700b0/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/04a4d6df-3ad8-44f6-9f53-4760069a9b9d/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:50 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-216 DeviceMajor:0 DeviceMinor:216 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-238 DeviceMajor:0 DeviceMinor:238 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-386 DeviceMajor:0 DeviceMinor:386 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:47 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4893badea04ec167ff7fddf04a9a9d9eb23aadfd09c2f8f6c67f67b082084654/userdata/shm DeviceMajor:0 DeviceMinor:283 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/1cc7c057-2789-4df5-8370-2244dc2f5d8b/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:374 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1fe30e1c-b403-4aca-868f-5bbc23f99e77/volumes/kubernetes.io~projected/kube-api-access-2rqmv DeviceMajor:0 DeviceMinor:204 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/d221531c-2ebd-483d-8456-254ae91c3f85/volumes/kubernetes.io~projected/kube-api-access-hmmrq DeviceMajor:0 DeviceMinor:275 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/03e4dc948afcb026070e1c0b0bd56cfd569ae38d92e8dff079bea06891250055/userdata/shm DeviceMajor:0 DeviceMinor:375 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/39904baf573b1176c4c2a384caecdf284f926bb077167918250788b937bfb34e/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d221531c-2ebd-483d-8456-254ae91c3f85/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:274 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-396 DeviceMajor:0 DeviceMinor:396 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d5bd256110a2036d4f2f29a185f8afc72510131e60ab9f535c052e3309119d07/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/aa89d93c-3459-445c-a4ad-2afc60b41ded/volumes/kubernetes.io~projected/kube-api-access-n97r4 DeviceMajor:0 DeviceMinor:235 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-240 DeviceMajor:0 DeviceMinor:240 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-351 DeviceMajor:0 DeviceMinor:351 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/00844e37-d582-444e-ae95-a498060b4519/volumes/kubernetes.io~projected/kube-api-access-49jkb DeviceMajor:0 DeviceMinor:57 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6873988f97e8ecb25c550db400e9bd79a02808d71315cf8550774f643b19db0d/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f/volumes/kubernetes.io~projected/kube-api-access-hx8xl DeviceMajor:0 DeviceMinor:211 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~projected/kube-api-access-4fbw2 DeviceMajor:0 DeviceMinor:296 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:293 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/04e0565a-5dc8-4461-87fe-6f9dcb2a1468/volumes/kubernetes.io~projected/kube-api-access-wjvrc DeviceMajor:0 DeviceMinor:59 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/23894e914379904a5c7ea7ff6b349d59f6a4f7dd9bcb7b25673bca68722a8a76/userdata/shm DeviceMajor:0 DeviceMinor:276 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:287 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-301 DeviceMajor:0 DeviceMinor:301 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-402 DeviceMajor:0 DeviceMinor:402 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-242 DeviceMajor:0 DeviceMinor:242 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:292 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-407 DeviceMajor:0 DeviceMinor:407 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/aa89d93c-3459-445c-a4ad-2afc60b41ded/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:230 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:295 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-388 DeviceMajor:0 DeviceMinor:388 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582160384 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/aa89d93c-3459-445c-a4ad-2afc60b41ded/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:234 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-384 DeviceMajor:0 DeviceMinor:384 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ee4cfb5e-2b2a-4831-8114-e57970cb7569/volumes/kubernetes.io~projected/kube-api-access-nnjfx DeviceMajor:0 DeviceMinor:203 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:293 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d9f4fa57baa1f18328bf7f1b9136484b845c4fedf53fdeb58974d63f1df350d3/userdata/shm DeviceMajor:0 DeviceMinor:62 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-149 DeviceMajor:0 DeviceMinor:149 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:293 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-321 DeviceMajor:0 DeviceMinor:321 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8eac4053-9b77-4a82-9b9c-2ad59058f1bb/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:361 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9d559e44-7c9d-464e-be57-884cff742118/volumes/kubernetes.io~projected/kube-api-access-gw585 DeviceMajor:0 DeviceMinor:51 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-126 DeviceMajor:0 DeviceMinor:126 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c3fdf510-52fb-4e1e-92c9-5208cb680d05/volumes/kubernetes.io~projected/kube-api-access-5rbfk DeviceMajor:0 DeviceMinor:377 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-214 DeviceMajor:0 DeviceMinor:214 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0c018322-20cb-470c-ae55-7eaddfbb60ea/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/207a1c5fc9534a993035ec0d9ad43fd68919560f78e8e9c5db8216a6b81c95f3/userdata/shm DeviceMajor:0 DeviceMinor:212 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:290 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a0d2cc1d2704dcc34109b2a8f1df6c06fb8ae1b40b76f11bedf739c2fec328cb/userdata/shm DeviceMajor:0 DeviceMinor:319 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-161 DeviceMajor:0 DeviceMinor:161 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ac5e4f15d3ba82a691c6a0f7430db1e6d54a79fa0b2eeda3b12064cdd6f047e3/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048379 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-153 DeviceMajor:0 DeviceMinor:153 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf/volumes/kubernetes.io~projected/kube-api-access-b9rpw DeviceMajor:0 DeviceMinor:202 Capacity:31985721344 Type:vfs Inodes:4048379 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:03e4dc948afcb02 MacAddress:8a:d3:42:89:19:ce Speed:10000 Mtu:8901} {Name:207a1c5fc9534a9 MacAddress:56:c0:d4:d5:4a:0e Speed:10000 Mtu:8901} {Name:23894e914379904 MacAddress:e2:7f:b1:ff:64:69 Speed:10000 Mtu:8901} {Name:372ea3c2192894a MacAddress:9e:e3:75:e8:4b:d9 Speed:10000 Mtu:8901} {Name:6c25b175d752126 MacAddress:7e:77:91:7e:6f:d0 Speed:10000 Mtu:8901} {Name:a0d2cc1d2704dcc MacAddress:72:1a:c3:a7:77:66 Speed:10000 Mtu:8901} {Name:a9e6823a8410c87 MacAddress:96:31:d9:3c:7f:6e Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d3:a5:7e:a9 Speed:0 Mtu:9001} {Name:br-int MacAddress:b2:01:b7:2d:32:c9 Speed:0 Mtu:8901} {Name:c24b668460a6b72 MacAddress:72:59:f0:24:98:07 Speed:10000 Mtu:8901} {Name:c7ac24cfaf9e0b4 MacAddress:32:ba:f4:73:ed:c6 Speed:10000 Mtu:8901} {Name:c836e8c92487296 MacAddress:3a:77:75:fc:f5:ad Speed:10000 Mtu:8901} {Name:e4fc9dadb24dd9e MacAddress:32:7a:01:51:40:22 Speed:10000 Mtu:8901} {Name:e795c35eaa025fe MacAddress:06:81:c1:07:01:a0 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d3:a5:7e:a9 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:9a:77:34:ee:89:f2 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:1e:71:ec:87:e7:54 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164320768 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 23:35:53.880343 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.880006 6174 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 23:35:53.880343 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.880077 6174 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 23:35:53.880636 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.880407 6174 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 23:35:53.880636 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.880428 6174 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-47.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 23:35:53.880636 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.880584 6174 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 23:35:53.880636 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.880591 6174 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 23:35:53.880636 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.880605 6174 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 23:35:53.880636 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.880624 6174 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 23:35:53.880818 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.880730 6174 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 23:35:53.880935 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.880924 6174 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 23:35:53.881075 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.881063 6174 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 23:35:53.881125 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.881104 6174 kubelet.go:493] "Attempting to sync node with API server" Oct 30 23:35:53.881125 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.881115 6174 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 23:35:53.881235 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.881128 6174 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 23:35:53.881235 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.881137 6174 kubelet.go:405] "Adding apiserver pod source" Oct 30 23:35:53.881235 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.881148 6174 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 23:35:53.882357 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.881906 6174 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 23:35:53.882357 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.881921 6174 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 23:35:53.882515 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.882476 6174 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 23:35:53.885627 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.885610 6174 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 23:35:53.885627 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.885626 6174 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 23:35:53.885800 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.885783 6174 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 23:35:53.886021 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886008 6174 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 23:35:53.886087 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886046 6174 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 23:35:53.886169 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886146 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 23:35:53.886209 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886177 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 23:35:53.886209 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886186 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 23:35:53.886209 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886197 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 23:35:53.886209 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886204 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 23:35:53.886209 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886210 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 23:35:53.886439 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886216 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 23:35:53.886439 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886221 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 23:35:53.886439 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886228 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 23:35:53.886439 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886234 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 23:35:53.886439 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886242 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 23:35:53.886439 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886251 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 23:35:53.886439 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886278 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 23:35:53.886439 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.886288 6174 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 23:35:53.890018 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.889996 6174 server.go:1263] "Started kubelet" Oct 30 23:35:53.890361 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.890313 6174 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 23:35:53.890574 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.890267 6174 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 23:35:53.890574 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.890500 6174 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 23:35:53.890560 ip-10-0-138-47 systemd[1]: Started Kubernetes Kubelet. Oct 30 23:35:53.890994 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.890797 6174 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 23:35:53.892260 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.892242 6174 server.go:317] "Adding debug handlers to kubelet server" Oct 30 23:35:53.899215 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.894495 6174 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 23:35:53.899215 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.896067 6174 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 23:35:53.899215 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.896545 6174 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 23:35:53.899215 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.896558 6174 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 23:35:53.899215 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.896645 6174 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 23:35:53.899215 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.896774 6174 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 23:29:42 +0000 UTC" deadline="2028-06-18 08:13:16.521849198 +0000 UTC" Oct 30 23:35:53.899215 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.896810 6174 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14312h37m22.625042445s" Oct 30 23:35:53.899215 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:35:53.897452 6174 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-138-47.ec2.internal\" not found" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903799 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04a4d6df-3ad8-44f6-9f53-4760069a9b9d" volumeName="kubernetes.io/empty-dir/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-tuned" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903839 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" volumeName="kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-config" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903852 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" volumeName="kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-oauth-serving-cert" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903864 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" volumeName="kubernetes.io/empty-dir/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-tmp" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903875 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" volumeName="kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-oauth-config" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903887 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf" volumeName="kubernetes.io/projected/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-kube-api-access-b9rpw" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903898 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee4cfb5e-2b2a-4831-8114-e57970cb7569" volumeName="kubernetes.io/configmap/ee4cfb5e-2b2a-4831-8114-e57970cb7569-config-volume" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903910 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee4cfb5e-2b2a-4831-8114-e57970cb7569" volumeName="kubernetes.io/projected/ee4cfb5e-2b2a-4831-8114-e57970cb7569-kube-api-access-nnjfx" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903923 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" volumeName="kubernetes.io/projected/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-kube-api-access-q7l82" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903934 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee4cfb5e-2b2a-4831-8114-e57970cb7569" volumeName="kubernetes.io/empty-dir/ee4cfb5e-2b2a-4831-8114-e57970cb7569-tmp-dir" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903946 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00844e37-d582-444e-ae95-a498060b4519" volumeName="kubernetes.io/projected/00844e37-d582-444e-ae95-a498060b4519-kube-api-access-49jkb" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903958 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b44eee82-b560-4cab-8804-b1e77523635b" volumeName="kubernetes.io/empty-dir/b44eee82-b560-4cab-8804-b1e77523635b-tmp-dir" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903968 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3fdf510-52fb-4e1e-92c9-5208cb680d05" volumeName="kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903979 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf" volumeName="kubernetes.io/empty-dir/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-data-volume" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.903992 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d221531c-2ebd-483d-8456-254ae91c3f85" volumeName="kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-oauth-serving-cert" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904004 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00844e37-d582-444e-ae95-a498060b4519" volumeName="kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-cni-binary-copy" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904018 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dca9509b-a5f9-4afd-baff-f10b6a9b0c7f" volumeName="kubernetes.io/projected/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f-kube-api-access-hx8xl" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904032 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-main-tls" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904043 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1fe30e1c-b403-4aca-868f-5bbc23f99e77" volumeName="kubernetes.io/projected/1fe30e1c-b403-4aca-868f-5bbc23f99e77-kube-api-access-2rqmv" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904054 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" volumeName="kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-serving-cert" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904065 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00844e37-d582-444e-ae95-a498060b4519" volumeName="kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904077 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="377989f5-3ed6-4546-9722-b341f03c8e39" volumeName="kubernetes.io/projected/377989f5-3ed6-4546-9722-b341f03c8e39-kube-api-access-ltd62" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904088 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf" volumeName="kubernetes.io/secret/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-insights-runtime-extractor-tls" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904101 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dca9509b-a5f9-4afd-baff-f10b6a9b0c7f" volumeName="kubernetes.io/empty-dir/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f-tmp" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904113 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904128 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904185 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c018322-20cb-470c-ae55-7eaddfbb60ea" volumeName="kubernetes.io/projected/0c018322-20cb-470c-ae55-7eaddfbb60ea-kube-api-access-jx6m2" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904206 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16cf618c-6b7c-463c-9501-b27e41b837cc" volumeName="kubernetes.io/projected/16cf618c-6b7c-463c-9501-b27e41b837cc-kube-api-access-prrbs" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904223 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3eff329b-439c-49f0-9325-f4111a5fc659" volumeName="kubernetes.io/secret/3eff329b-439c-49f0-9325-f4111a5fc659-monitoring-plugin-cert" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904243 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d559e44-7c9d-464e-be57-884cff742118" volumeName="kubernetes.io/projected/9d559e44-7c9d-464e-be57-884cff742118-kube-api-access-gw585" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904259 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d221531c-2ebd-483d-8456-254ae91c3f85" volumeName="kubernetes.io/empty-dir/d221531c-2ebd-483d-8456-254ae91c3f85-tmp" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904271 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04a4d6df-3ad8-44f6-9f53-4760069a9b9d" volumeName="kubernetes.io/empty-dir/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-tmp" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904282 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d221531c-2ebd-483d-8456-254ae91c3f85" volumeName="kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-service-ca" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904294 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ee4cfb5e-2b2a-4831-8114-e57970cb7569" volumeName="kubernetes.io/secret/ee4cfb5e-2b2a-4831-8114-e57970cb7569-metrics-tls" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904305 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00844e37-d582-444e-ae95-a498060b4519" volumeName="kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904318 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04e0565a-5dc8-4461-87fe-6f9dcb2a1468" volumeName="kubernetes.io/projected/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-kube-api-access-wjvrc" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904329 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c018322-20cb-470c-ae55-7eaddfbb60ea" volumeName="kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-env-overrides" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904341 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa89d93c-3459-445c-a4ad-2afc60b41ded" volumeName="kubernetes.io/projected/aa89d93c-3459-445c-a4ad-2afc60b41ded-kube-api-access-n97r4" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904352 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf" volumeName="kubernetes.io/configmap/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf-konnectivity-ca" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904374 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-kube-api-access-4fbw2" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904387 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="04a4d6df-3ad8-44f6-9f53-4760069a9b9d" volumeName="kubernetes.io/projected/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-kube-api-access-xgpxd" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904400 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1cc7c057-2789-4df5-8370-2244dc2f5d8b" volumeName="kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904411 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd63f30a-bd74-47e5-9692-e6a41b88ad6c" volumeName="kubernetes.io/secret/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-tls" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904423 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1fe30e1c-b403-4aca-868f-5bbc23f99e77" volumeName="kubernetes.io/secret/1fe30e1c-b403-4aca-868f-5bbc23f99e77-cert" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904437 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d221531c-2ebd-483d-8456-254ae91c3f85" volumeName="kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-serving-cert" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904449 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd63f30a-bd74-47e5-9692-e6a41b88ad6c" volumeName="kubernetes.io/projected/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-kube-api-access-mwxrr" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904461 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c018322-20cb-470c-ae55-7eaddfbb60ea" volumeName="kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovnkube-script-lib" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904473 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d559e44-7c9d-464e-be57-884cff742118" volumeName="kubernetes.io/configmap/9d559e44-7c9d-464e-be57-884cff742118-serviceca" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904485 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa89d93c-3459-445c-a4ad-2afc60b41ded" volumeName="kubernetes.io/configmap/aa89d93c-3459-445c-a4ad-2afc60b41ded-metrics-client-ca" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904496 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa89d93c-3459-445c-a4ad-2afc60b41ded" volumeName="kubernetes.io/secret/aa89d93c-3459-445c-a4ad-2afc60b41ded-prometheus-operator-tls" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904508 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd63f30a-bd74-47e5-9692-e6a41b88ad6c" volumeName="kubernetes.io/configmap/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-metrics-client-ca" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904520 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd63f30a-bd74-47e5-9692-e6a41b88ad6c" volumeName="kubernetes.io/secret/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904532 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-main-db" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904544 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-tls-assets" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904556 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-volume" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904567 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-web-config" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904587 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c018322-20cb-470c-ae55-7eaddfbb60ea" volumeName="kubernetes.io/secret/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904598 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3eff329b-439c-49f0-9325-f4111a5fc659" volumeName="kubernetes.io/projected/3eff329b-439c-49f0-9325-f4111a5fc659-kube-api-access-gkf2k" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904609 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b44eee82-b560-4cab-8804-b1e77523635b" volumeName="kubernetes.io/projected/b44eee82-b560-4cab-8804-b1e77523635b-kube-api-access-v45fc" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904622 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf" volumeName="kubernetes.io/secret/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf-agent-certs" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904633 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa89d93c-3459-445c-a4ad-2afc60b41ded" volumeName="kubernetes.io/secret/aa89d93c-3459-445c-a4ad-2afc60b41ded-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904644 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-trusted-ca-bundle" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904659 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-out" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904672 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-cluster-tls-config" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904683 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16cf618c-6b7c-463c-9501-b27e41b837cc" volumeName="kubernetes.io/configmap/16cf618c-6b7c-463c-9501-b27e41b837cc-iptables-alerter-script" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904696 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="377989f5-3ed6-4546-9722-b341f03c8e39" volumeName="kubernetes.io/configmap/377989f5-3ed6-4546-9722-b341f03c8e39-multus-daemon-config" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904708 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="377989f5-3ed6-4546-9722-b341f03c8e39" volumeName="kubernetes.io/configmap/377989f5-3ed6-4546-9722-b341f03c8e39-cni-binary-copy" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904721 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d221531c-2ebd-483d-8456-254ae91c3f85" volumeName="kubernetes.io/projected/d221531c-2ebd-483d-8456-254ae91c3f85-kube-api-access-hmmrq" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904732 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf" volumeName="kubernetes.io/configmap/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-kube-rbac-proxy-cm" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904744 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-metrics-client-ca" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904755 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c018322-20cb-470c-ae55-7eaddfbb60ea" volumeName="kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovnkube-config" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904767 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="48c3e89e-58f0-40af-9c40-63be495d5482" volumeName="kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904787 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" volumeName="kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-service-ca" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904798 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d221531c-2ebd-483d-8456-254ae91c3f85" volumeName="kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-console-config" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904809 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d221531c-2ebd-483d-8456-254ae91c3f85" volumeName="kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-oauth-config" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904822 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd63f30a-bd74-47e5-9692-e6a41b88ad6c" volumeName="kubernetes.io/configmap/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-accelerators-collector-config" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904833 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03b37470-09fd-4ec5-8cff-c4b840d49ef0" volumeName="kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904846 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="48c3e89e-58f0-40af-9c40-63be495d5482" volumeName="kubernetes.io/projected/48c3e89e-58f0-40af-9c40-63be495d5482-kube-api-access-24d5c" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904857 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" volumeName="kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-trusted-ca-bundle" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904868 6174 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd63f30a-bd74-47e5-9692-e6a41b88ad6c" volumeName="kubernetes.io/empty-dir/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-textfile" seLinuxMountContext="" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904878 6174 reconstruct.go:97] "Volume reconstruction finished" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.904885 6174 reconciler.go:29] "Reconciler: start to sync state" Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.905251 6174 factory.go:153] Registering CRI-O factory Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.905267 6174 factory.go:223] Registration of the crio container factory successfully Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.905321 6174 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.905330 6174 factory.go:55] Registering systemd factory Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.905338 6174 factory.go:223] Registration of the systemd container factory successfully Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.905353 6174 factory.go:103] Registering Raw factory Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.905367 6174 manager.go:1199] Started watching for new ooms in manager Oct 30 23:35:53.908262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.905687 6174 manager.go:319] Starting recovery of all containers Oct 30 23:35:53.937895 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.937744 6174 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:35:53.937895 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.937865 6174 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 23:35:53.941331 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.941221 6174 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 23:35:53.941667 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.941538 6174 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:35:53.944616 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.943093 6174 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 23:35:53.944616 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.943115 6174 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 23:35:53.944616 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.943136 6174 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 23:35:53.944616 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:35:53.943192 6174 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 23:35:53.962534 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.962473 6174 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:35:53.962898 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.962849 6174 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 23:35:53.968599 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.968582 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:35:53.976077 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.976034 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:35:53.977883 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.977848 6174 generic.go:356] "Generic (PLEG): container finished" podID="6ac66232dff389c81bfae9a48be8f6b5" containerID="aab186c0d7cf6890e4bab2c5eddb6500d356a1127e0d915b894c318b25e2add1" exitCode=0 Oct 30 23:35:53.997135 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.997079 6174 generic.go:356] "Generic (PLEG): container finished" podID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerID="44f667879e12356a502010043bd0f4849b75bc3697ad71c8bc251079d05b6038" exitCode=0 Oct 30 23:35:53.999707 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:53.999678 6174 generic.go:356] "Generic (PLEG): container finished" podID="dd63f30a-bd74-47e5-9692-e6a41b88ad6c" containerID="4217e1f7e73b4ae7cb7ee8cb57df499758dfd65df707b2f2291e13f87a2a927c" exitCode=0 Oct 30 23:35:54.009013 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.008983 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:35:54.009493 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.009473 6174 generic.go:356] "Generic (PLEG): container finished" podID="0c018322-20cb-470c-ae55-7eaddfbb60ea" containerID="eb464084848945a923ccac4fa098440f482b7bf8883fd5b8581b173278969478" exitCode=1 Oct 30 23:35:54.037770 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.037751 6174 manager.go:324] Recovery completed Oct 30 23:35:54.041934 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.041905 6174 generic.go:356] "Generic (PLEG): container finished" podID="00844e37-d582-444e-ae95-a498060b4519" containerID="7a212b7eec071baae5badae2e386719aa1a189a914381e7b131c03bfd4f03190" exitCode=0 Oct 30 23:35:54.041934 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.041933 6174 generic.go:356] "Generic (PLEG): container finished" podID="00844e37-d582-444e-ae95-a498060b4519" containerID="a70402574f4e158fbec9007e85dac81e6874b3aaf50a0266ce870a70489e04fc" exitCode=0 Oct 30 23:35:54.042084 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.041943 6174 generic.go:356] "Generic (PLEG): container finished" podID="00844e37-d582-444e-ae95-a498060b4519" containerID="ada9c6da4fe17e58b663c2e1e276dbda9c80b5ef141a19414c856f196d0e56db" exitCode=0 Oct 30 23:35:54.042084 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.041975 6174 generic.go:356] "Generic (PLEG): container finished" podID="00844e37-d582-444e-ae95-a498060b4519" containerID="1f2769a4499738a5c15e167a27fd0fb553844c04337284a4d2bf52faddbcbd08" exitCode=0 Oct 30 23:35:54.042084 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.041987 6174 generic.go:356] "Generic (PLEG): container finished" podID="00844e37-d582-444e-ae95-a498060b4519" containerID="8415a727acdade78b0721fe7ee0a004e1348e4643974e897107893f209ad1ae4" exitCode=0 Oct 30 23:35:54.042084 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.041996 6174 generic.go:356] "Generic (PLEG): container finished" podID="00844e37-d582-444e-ae95-a498060b4519" containerID="60bd83c6bb1f518514a0198a4c947d6b66fded76b6e349ce05774d715f0c2f1e" exitCode=0 Oct 30 23:35:54.043257 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:35:54.043234 6174 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Oct 30 23:35:54.063847 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.063822 6174 cpu_manager.go:226] "Starting" policy="none" Oct 30 23:35:54.063847 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.063840 6174 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 23:35:54.064017 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.063860 6174 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 23:35:54.064017 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.064003 6174 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 23:35:54.064105 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.064018 6174 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 23:35:54.064105 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.064039 6174 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 23:35:54.064105 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.064047 6174 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 23:35:54.064105 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.064053 6174 policy_none.go:50] "Start" Oct 30 23:35:54.064105 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.064061 6174 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 23:35:54.064105 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.064071 6174 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 23:35:54.073937 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.073915 6174 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 23:35:54.074024 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.073942 6174 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 23:35:54.074024 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.073954 6174 policy_none.go:44] "Start" Oct 30 23:35:54.079275 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.079246 6174 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 23:35:54.083538 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.083520 6174 manager.go:341] "Starting Device Plugin manager" Oct 30 23:35:54.084269 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:35:54.083553 6174 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 23:35:54.084351 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.084272 6174 server.go:87] "Starting device plugin registration server" Oct 30 23:35:54.084624 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.084610 6174 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 23:35:54.084715 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.084625 6174 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 23:35:54.084778 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.084763 6174 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 23:35:54.086571 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.086531 6174 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 23:35:54.086666 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.086587 6174 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 23:35:54.086666 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.086593 6174 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 23:35:54.086666 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:35:54.086645 6174 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 23:35:54.086978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.086637 6174 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T23:35:54.086576212Z","UUID":"9ef77aba-1f5e-416f-9ab8-14778d728c10","Handler":null,"Name":"","Endpoint":""} Oct 30 23:35:54.088415 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.088249 6174 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 23:35:54.088415 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.088279 6174 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 23:35:54.185609 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.185581 6174 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 23:35:54.187607 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.187584 6174 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeHasSufficientMemory" Oct 30 23:35:54.187711 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.187620 6174 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 23:35:54.187711 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.187635 6174 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-138-47.ec2.internal" event="NodeHasSufficientPID" Oct 30 23:35:54.187711 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.187680 6174 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.220104 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.220040 6174 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.220248 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.220114 6174 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.243598 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.243553 6174 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal"] Oct 30 23:35:54.244213 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.244173 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" event={"ID":"eb43bc9abe76bb2220c1657ae80c7c48","Type":"ContainerStarted","Data":"eb23fd43317455631f5a35ff9cffe7bce47ce401fc7cfc2eade953d0cede8c01"} Oct 30 23:35:54.244318 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.244224 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" event={"ID":"eb43bc9abe76bb2220c1657ae80c7c48","Type":"ContainerStarted","Data":"d9f4fa57baa1f18328bf7f1b9136484b845c4fedf53fdeb58974d63f1df350d3"} Oct 30 23:35:54.244318 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.244233 6174 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.244318 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.244245 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" event={"ID":"6ac66232dff389c81bfae9a48be8f6b5","Type":"ContainerStarted","Data":"b71b7086004ce302df7689c7f697b955fedb35e59e4bf9444115956de18b4cba"} Oct 30 23:35:54.244318 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.244265 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" event={"ID":"6ac66232dff389c81bfae9a48be8f6b5","Type":"ContainerDied","Data":"aab186c0d7cf6890e4bab2c5eddb6500d356a1127e0d915b894c318b25e2add1"} Oct 30 23:35:54.244318 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.244286 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" event={"ID":"6ac66232dff389c81bfae9a48be8f6b5","Type":"ContainerStarted","Data":"d14eff06a8a23475968525d5e9c6055aacffb4d3608bcfd67261998eaec700b0"} Oct 30 23:35:54.244535 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.244446 6174 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.268274 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.268245 6174 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 23:35:54.268386 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:35:54.268306 6174 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-47.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.268539 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.268515 6174 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 23:35:54.268646 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:35:54.268565 6174 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.338954 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.338917 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb43bc9abe76bb2220c1657ae80c7c48-config\") pod \"kube-apiserver-proxy-ip-10-0-138-47.ec2.internal\" (UID: \"eb43bc9abe76bb2220c1657ae80c7c48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.339111 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.338967 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ac66232dff389c81bfae9a48be8f6b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" (UID: \"6ac66232dff389c81bfae9a48be8f6b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.339111 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.338995 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ac66232dff389c81bfae9a48be8f6b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" (UID: \"6ac66232dff389c81bfae9a48be8f6b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.439526 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.439486 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ac66232dff389c81bfae9a48be8f6b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" (UID: \"6ac66232dff389c81bfae9a48be8f6b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.439688 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.439533 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb43bc9abe76bb2220c1657ae80c7c48-config\") pod \"kube-apiserver-proxy-ip-10-0-138-47.ec2.internal\" (UID: \"eb43bc9abe76bb2220c1657ae80c7c48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.439688 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.439561 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ac66232dff389c81bfae9a48be8f6b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" (UID: \"6ac66232dff389c81bfae9a48be8f6b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.439688 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.439621 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb43bc9abe76bb2220c1657ae80c7c48-config\") pod \"kube-apiserver-proxy-ip-10-0-138-47.ec2.internal\" (UID: \"eb43bc9abe76bb2220c1657ae80c7c48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.439688 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.439622 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ac66232dff389c81bfae9a48be8f6b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" (UID: \"6ac66232dff389c81bfae9a48be8f6b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.439861 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.439686 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ac66232dff389c81bfae9a48be8f6b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" (UID: \"6ac66232dff389c81bfae9a48be8f6b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:35:54.882315 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.882282 6174 apiserver.go:52] "Watching apiserver" Oct 30 23:35:54.934273 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.934242 6174 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 23:35:54.934853 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.934829 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-hszwb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh","openshift-monitoring/alertmanager-main-0","openshift-multus/multus-rh7rt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal","openshift-console/console-6dbcd5d88c-jnld8","openshift-insights/insights-runtime-extractor-b2gj4","openshift-multus/network-metrics-daemon-bgt8k","openshift-multus/multus-additional-cni-plugins-gx66m","openshift-network-diagnostics/network-check-target-d7mfp","openshift-dns/dns-default-xpf7m","kube-system/global-pull-secret-syncer-dhk5w","openshift-ovn-kubernetes/ovnkube-node-jxjlg","openshift-console/console-75578f867d-n2cxw","openshift-cluster-node-tuning-operator/tuned-zvhlw","kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal","openshift-console/downloads-6dd789c8b7-ljn2m","openshift-dns/node-resolver-czdjt","openshift-ingress-canary/ingress-canary-hbf9l","openshift-monitoring/node-exporter-z2tf6","kube-system/konnectivity-agent-rbrcx","openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc","openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf","openshift-network-operator/iptables-alerter-9mljf"] Oct 30 23:35:54.951683 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.951643 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 23:35:54.951683 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.951647 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 23:35:54.951867 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.951724 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 23:35:54.951867 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.951770 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:54.951867 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.951795 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8ljqd\"" Oct 30 23:35:54.951867 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.951858 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:54.952058 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.951937 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 23:35:54.952058 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.951980 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 23:35:54.952058 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.951985 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mp8rg\"" Oct 30 23:35:54.952058 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.951985 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 23:35:54.952058 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952035 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 23:35:54.952320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952069 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 23:35:54.952320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952074 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 23:35:54.952320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952072 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 23:35:54.952320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952090 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 23:35:54.952320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952131 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jsrq7\"" Oct 30 23:35:54.952320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952131 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 23:35:54.952320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952180 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 23:35:54.952320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952190 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-5t726\"" Oct 30 23:35:54.952320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952192 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 23:35:54.952320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952206 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 23:35:54.952320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952282 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 23:35:54.952320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952300 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 23:35:54.952696 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.952675 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l52wg\"" Oct 30 23:35:54.962500 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.962477 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 30 23:35:54.963195 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.963179 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 23:35:54.963313 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.963295 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 23:35:54.963363 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.963339 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 23:35:54.963472 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.963453 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 23:35:54.963472 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.963467 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 23:35:54.963644 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.963613 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 23:35:54.963757 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.963740 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 23:35:54.964043 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.964024 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 23:35:54.964125 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.964073 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 23:35:54.964125 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.964076 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Oct 30 23:35:54.964269 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.964253 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9kbs4\"" Oct 30 23:35:54.964753 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.964735 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 23:35:54.965016 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.964997 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 30 23:35:54.965016 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.964993 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jdw7v\"" Oct 30 23:35:54.965199 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965036 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 23:35:54.965199 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965114 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 30 23:35:54.965199 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965125 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 23:35:54.965199 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965148 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 23:35:54.965199 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965198 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b99jz\"" Oct 30 23:35:54.965455 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965444 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 23:35:54.965594 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965571 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tzsrk\"" Oct 30 23:35:54.965594 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965588 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 23:35:54.965752 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965634 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-p2ccw\"" Oct 30 23:35:54.965752 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965659 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 23:35:54.965864 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965763 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 23:35:54.965864 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965766 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-lgp55\"" Oct 30 23:35:54.965864 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965807 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 30 23:35:54.965864 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965768 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dqbbs\"" Oct 30 23:35:54.965864 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965819 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 30 23:35:54.966093 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965907 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 23:35:54.966093 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965933 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 23:35:54.966093 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965946 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 23:35:54.966093 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965948 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 23:35:54.966093 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965957 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2bmqg\"" Oct 30 23:35:54.966093 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.965978 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 23:35:54.966093 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966013 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 23:35:54.966093 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966013 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 23:35:54.966093 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966078 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 23:35:54.966508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966146 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 23:35:54.966508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966187 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 23:35:54.966508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966275 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 23:35:54.966508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966302 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 23:35:54.966508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966331 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 23:35:54.966508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966415 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 30 23:35:54.966508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966447 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 30 23:35:54.966508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966448 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4mrbk\"" Oct 30 23:35:54.966508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966456 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-65zfb\"" Oct 30 23:35:54.966508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966451 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 23:35:54.966508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966492 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 23:35:54.966928 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966578 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c8cbk\"" Oct 30 23:35:54.966928 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966578 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vskkf\"" Oct 30 23:35:54.966928 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966611 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 23:35:54.966928 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966606 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-rvj77\"" Oct 30 23:35:54.966928 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966622 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 23:35:54.966928 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966642 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-swxmn\"" Oct 30 23:35:54.966928 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966649 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 23:35:54.966928 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966656 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wrqrm\"" Oct 30 23:35:54.966928 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966678 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 23:35:54.966928 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.966661 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-wj7js\"" Oct 30 23:35:54.975573 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.975554 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 23:35:54.978305 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.978286 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 23:35:54.978388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:54.978308 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 30 23:35:55.002918 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.002887 6174 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 23:35:55.042099 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042076 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-etc-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.042238 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042109 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49jkb\" (UniqueName: \"kubernetes.io/projected/00844e37-d582-444e-ae95-a498060b4519-kube-api-access-49jkb\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.042238 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042126 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-service-ca\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.042238 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042147 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.042412 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042238 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysctl-conf\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.042412 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042283 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-tmp\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.042412 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042311 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16cf618c-6b7c-463c-9501-b27e41b837cc-iptables-alerter-script\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:35:55.042412 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042337 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24d5c\" (UniqueName: \"kubernetes.io/projected/48c3e89e-58f0-40af-9c40-63be495d5482-kube-api-access-24d5c\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:55.042412 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042364 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-wtmp\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.042412 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042373 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.042412 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042394 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-cni-binary-copy\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042413 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-service-ca\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042420 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042488 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-ovn\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042515 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-netns\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042545 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042570 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-run\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042603 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042628 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-sys\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042635 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042656 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-textfile\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042685 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee4cfb5e-2b2a-4831-8114-e57970cb7569-config-volume\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042710 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16cf618c-6b7c-463c-9501-b27e41b837cc-iptables-alerter-script\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:35:55.042743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042714 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-serving-cert\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042791 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-tmp\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042806 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-tls\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042830 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-env-overrides\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042867 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx8xl\" (UniqueName: \"kubernetes.io/projected/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f-kube-api-access-hx8xl\") pod \"downloads-6dd789c8b7-ljn2m\" (UID: \"dca9509b-a5f9-4afd-baff-f10b6a9b0c7f\") " pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.042953 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043050 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-textfile\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043053 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-cni-binary-copy\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043108 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-systemd-units\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043116 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-env-overrides\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043233 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee4cfb5e-2b2a-4831-8114-e57970cb7569-config-volume\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043299 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-tls\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043291 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovnkube-script-lib\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043314 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-serving-cert\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.043403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043356 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-cni-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.043991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043461 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fbw2\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-kube-api-access-4fbw2\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.043991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043508 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjvrc\" (UniqueName: \"kubernetes.io/projected/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-kube-api-access-wjvrc\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.043991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043520 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovnkube-script-lib\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.043991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043542 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-data-volume\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:55.043991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043626 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-cnibin\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.043991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043664 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-system-cni-dir\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.043991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043679 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-data-volume\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:55.043991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043732 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d559e44-7c9d-464e-be57-884cff742118-serviceca\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:35:55.043991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043777 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:55.043991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043843 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovnkube-config\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.043991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043938 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-system-cni-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.043991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.043985 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-oauth-config\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044016 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkf2k\" (UniqueName: \"kubernetes.io/projected/3eff329b-439c-49f0-9325-f4111a5fc659-kube-api-access-gkf2k\") pod \"monitoring-plugin-77f4f76594-tnlqc\" (UID: \"3eff329b-439c-49f0-9325-f4111a5fc659\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044119 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovnkube-config\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044119 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1cc7c057-2789-4df5-8370-2244dc2f5d8b-original-pull-secret\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044136 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044213 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-oauth-config\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044257 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-oauth-serving-cert\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044298 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgpxd\" (UniqueName: \"kubernetes.io/projected/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-kube-api-access-xgpxd\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044327 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-oauth-config\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044346 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-registration-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044385 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwxrr\" (UniqueName: \"kubernetes.io/projected/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-kube-api-access-mwxrr\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044411 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-cni-netd\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044438 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044450 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48c3e89e-58f0-40af-9c40-63be495d5482-metrics-certs\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044476 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d559e44-7c9d-464e-be57-884cff742118-serviceca\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044503 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-oauth-serving-cert\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044516 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-etc-kubernetes\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044554 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-cnibin\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044581 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-oauth-config\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.044652 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044598 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-out\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044662 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-multus-certs\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044737 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-out\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044744 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-systemd\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044781 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-kubelet\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044806 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-slash\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044838 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044892 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f-tmp\") pod \"downloads-6dd789c8b7-ljn2m\" (UID: \"dca9509b-a5f9-4afd-baff-f10b6a9b0c7f\") " pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.044982 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f-tmp\") pod \"downloads-6dd789c8b7-ljn2m\" (UID: \"dca9509b-a5f9-4afd-baff-f10b6a9b0c7f\") " pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045017 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-kubernetes\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045042 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-crio-socket\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045069 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/377989f5-3ed6-4546-9722-b341f03c8e39-cni-binary-copy\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045118 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa89d93c-3459-445c-a4ad-2afc60b41ded-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045149 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3eff329b-439c-49f0-9325-f4111a5fc659-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-tnlqc\" (UID: \"3eff329b-439c-49f0-9325-f4111a5fc659\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045198 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysconfig\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045224 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/377989f5-3ed6-4546-9722-b341f03c8e39-multus-daemon-config\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045248 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa89d93c-3459-445c-a4ad-2afc60b41ded-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045275 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045299 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-lib-modules\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045325 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-serving-cert\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045334 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/377989f5-3ed6-4546-9722-b341f03c8e39-cni-binary-copy\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045349 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-var-lib-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045358 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa89d93c-3459-445c-a4ad-2afc60b41ded-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045375 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-kubelet\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045431 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1cc7c057-2789-4df5-8370-2244dc2f5d8b-dbus\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045428 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3eff329b-439c-49f0-9325-f4111a5fc659-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-tnlqc\" (UID: \"3eff329b-439c-49f0-9325-f4111a5fc659\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045495 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-config\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045521 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa89d93c-3459-445c-a4ad-2afc60b41ded-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045528 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltd62\" (UniqueName: \"kubernetes.io/projected/377989f5-3ed6-4546-9722-b341f03c8e39-kube-api-access-ltd62\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.045572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045556 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045597 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/377989f5-3ed6-4546-9722-b341f03c8e39-multus-daemon-config\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045700 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045727 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-config\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045776 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-host\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045808 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045827 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-socket-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045889 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045924 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-node-log\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045889 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-serving-cert\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045961 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-volume\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.045998 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-sys-fs\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046027 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovn-node-metrics-cert\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046054 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-k8s-cni-cncf-io\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046073 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046091 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1cc7c057-2789-4df5-8370-2244dc2f5d8b-kubelet-config\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046183 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-volume\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046237 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046269 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf-agent-certs\") pod \"konnectivity-agent-rbrcx\" (UID: \"e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf\") " pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046317 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4cfb5e-2b2a-4831-8114-e57970cb7569-metrics-tls\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046342 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-trusted-ca-bundle\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046368 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046392 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c018322-20cb-470c-ae55-7eaddfbb60ea-ovn-node-metrics-cert\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046395 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-cni-bin\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046587 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf-agent-certs\") pod \"konnectivity-agent-rbrcx\" (UID: \"e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf\") " pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046596 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046720 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046747 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmmrq\" (UniqueName: \"kubernetes.io/projected/d221531c-2ebd-483d-8456-254ae91c3f85-kube-api-access-hmmrq\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046770 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-web-config\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046785 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-systemd\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046800 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-tuned\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046856 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw585\" (UniqueName: \"kubernetes.io/projected/9d559e44-7c9d-464e-be57-884cff742118-kube-api-access-gw585\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:35:55.046882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046885 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prrbs\" (UniqueName: \"kubernetes.io/projected/16cf618c-6b7c-463c-9501-b27e41b837cc-kube-api-access-prrbs\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046885 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-tuned\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046885 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-trusted-ca-bundle\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046921 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-log-socket\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046948 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf-konnectivity-ca\") pod \"konnectivity-agent-rbrcx\" (UID: \"e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf\") " pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.046974 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n97r4\" (UniqueName: \"kubernetes.io/projected/aa89d93c-3459-445c-a4ad-2afc60b41ded-kube-api-access-n97r4\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047001 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-console-config\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047064 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b44eee82-b560-4cab-8804-b1e77523635b-hosts-file\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047093 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v45fc\" (UniqueName: \"kubernetes.io/projected/b44eee82-b560-4cab-8804-b1e77523635b-kube-api-access-v45fc\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047119 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-etc-selinux\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047228 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047293 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-modprobe-d\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047313 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf-konnectivity-ca\") pod \"konnectivity-agent-rbrcx\" (UID: \"e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf\") " pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047122 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-web-config\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047451 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-var-lib-kubelet\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047478 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-tmp\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047504 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-cni-bin\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047454 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee4cfb5e-2b2a-4831-8114-e57970cb7569-metrics-tls\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047658 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047678 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnjfx\" (UniqueName: \"kubernetes.io/projected/ee4cfb5e-2b2a-4831-8114-e57970cb7569-kube-api-access-nnjfx\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047707 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-sys\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047826 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-hostroot\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047857 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047882 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d559e44-7c9d-464e-be57-884cff742118-host\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:35:55.047968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047887 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-console-config\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.047989 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048008 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048025 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rqmv\" (UniqueName: \"kubernetes.io/projected/1fe30e1c-b403-4aca-868f-5bbc23f99e77-kube-api-access-2rqmv\") pod \"ingress-canary-hbf9l\" (UID: \"1fe30e1c-b403-4aca-868f-5bbc23f99e77\") " pod="openshift-ingress-canary/ingress-canary-hbf9l" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048043 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6m2\" (UniqueName: \"kubernetes.io/projected/0c018322-20cb-470c-ae55-7eaddfbb60ea-kube-api-access-jx6m2\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048119 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048172 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b44eee82-b560-4cab-8804-b1e77523635b-tmp-dir\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048205 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-device-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048241 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-run-netns\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048269 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048317 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-tmp\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048361 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4cfb5e-2b2a-4831-8114-e57970cb7569-tmp-dir\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048389 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048416 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7l82\" (UniqueName: \"kubernetes.io/projected/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-kube-api-access-q7l82\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048441 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9rpw\" (UniqueName: \"kubernetes.io/projected/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-kube-api-access-b9rpw\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048467 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-conf-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048510 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048534 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048565 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa89d93c-3459-445c-a4ad-2afc60b41ded-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048600 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048617 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-oauth-serving-cert\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048633 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-root\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048649 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-metrics-client-ca\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048668 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d221531c-2ebd-483d-8456-254ae91c3f85-tmp\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048683 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048702 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysctl-d\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048719 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbfk\" (UniqueName: \"kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk\") pod \"network-check-target-d7mfp\" (UID: \"c3fdf510-52fb-4e1e-92c9-5208cb680d05\") " pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048792 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-socket-dir-parent\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048817 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-cni-multus\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048840 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-service-ca\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048856 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16cf618c-6b7c-463c-9501-b27e41b837cc-host-slash\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048872 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fe30e1c-b403-4aca-868f-5bbc23f99e77-cert\") pod \"ingress-canary-hbf9l\" (UID: \"1fe30e1c-b403-4aca-868f-5bbc23f99e77\") " pod="openshift-ingress-canary/ingress-canary-hbf9l" Oct 30 23:35:55.048900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.048915 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-metrics-client-ca\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.050348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.049080 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa89d93c-3459-445c-a4ad-2afc60b41ded-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:55.050348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.049089 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.050348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.049126 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b44eee82-b560-4cab-8804-b1e77523635b-tmp-dir\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:35:55.050348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.049201 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4cfb5e-2b2a-4831-8114-e57970cb7569-tmp-dir\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:55.050348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.049228 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-oauth-serving-cert\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.050348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.049291 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fe30e1c-b403-4aca-868f-5bbc23f99e77-cert\") pod \"ingress-canary-hbf9l\" (UID: \"1fe30e1c-b403-4aca-868f-5bbc23f99e77\") " pod="openshift-ingress-canary/ingress-canary-hbf9l" Oct 30 23:35:55.050348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.049410 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.050348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.049445 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d221531c-2ebd-483d-8456-254ae91c3f85-tmp\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.050348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.049501 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-service-ca\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.050348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.049565 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.050348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.049633 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/00844e37-d582-444e-ae95-a498060b4519-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.051560 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.051537 6174 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:35:55.051718 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.051701 6174 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:35:55.059485 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.059469 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24d5c\" (UniqueName: \"kubernetes.io/projected/48c3e89e-58f0-40af-9c40-63be495d5482-kube-api-access-24d5c\") pod \"network-metrics-daemon-bgt8k\" (UID: \"48c3e89e-58f0-40af-9c40-63be495d5482\") " pod="openshift-multus/network-metrics-daemon-bgt8k" Oct 30 23:35:55.059603 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.059585 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49jkb\" (UniqueName: \"kubernetes.io/projected/00844e37-d582-444e-ae95-a498060b4519-kube-api-access-49jkb\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.060697 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.060681 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx8xl\" (UniqueName: \"kubernetes.io/projected/dca9509b-a5f9-4afd-baff-f10b6a9b0c7f-kube-api-access-hx8xl\") pod \"downloads-6dd789c8b7-ljn2m\" (UID: \"dca9509b-a5f9-4afd-baff-f10b6a9b0c7f\") " pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:35:55.060889 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.060870 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjvrc\" (UniqueName: \"kubernetes.io/projected/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-kube-api-access-wjvrc\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.063277 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.063260 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fbw2\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-kube-api-access-4fbw2\") pod \"alertmanager-main-0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:35:55.065729 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.065706 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwxrr\" (UniqueName: \"kubernetes.io/projected/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-kube-api-access-mwxrr\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.065830 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.065803 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltd62\" (UniqueName: \"kubernetes.io/projected/377989f5-3ed6-4546-9722-b341f03c8e39-kube-api-access-ltd62\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.066138 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.066113 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgpxd\" (UniqueName: \"kubernetes.io/projected/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-kube-api-access-xgpxd\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.066237 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.066208 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmmrq\" (UniqueName: \"kubernetes.io/projected/d221531c-2ebd-483d-8456-254ae91c3f85-kube-api-access-hmmrq\") pod \"console-75578f867d-n2cxw\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:55.066333 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.066317 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkf2k\" (UniqueName: \"kubernetes.io/projected/3eff329b-439c-49f0-9325-f4111a5fc659-kube-api-access-gkf2k\") pod \"monitoring-plugin-77f4f76594-tnlqc\" (UID: \"3eff329b-439c-49f0-9325-f4111a5fc659\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:55.066625 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.066605 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw585\" (UniqueName: \"kubernetes.io/projected/9d559e44-7c9d-464e-be57-884cff742118-kube-api-access-gw585\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:35:55.066743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.066718 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n97r4\" (UniqueName: \"kubernetes.io/projected/aa89d93c-3459-445c-a4ad-2afc60b41ded-kube-api-access-n97r4\") pod \"prometheus-operator-9cd89b74c-mpdlf\" (UID: \"aa89d93c-3459-445c-a4ad-2afc60b41ded\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-mpdlf" Oct 30 23:35:55.067087 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.067069 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v45fc\" (UniqueName: \"kubernetes.io/projected/b44eee82-b560-4cab-8804-b1e77523635b-kube-api-access-v45fc\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:35:55.067125 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.067089 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnjfx\" (UniqueName: \"kubernetes.io/projected/ee4cfb5e-2b2a-4831-8114-e57970cb7569-kube-api-access-nnjfx\") pod \"dns-default-xpf7m\" (UID: \"ee4cfb5e-2b2a-4831-8114-e57970cb7569\") " pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:55.069372 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.069349 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prrbs\" (UniqueName: \"kubernetes.io/projected/16cf618c-6b7c-463c-9501-b27e41b837cc-kube-api-access-prrbs\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:35:55.069481 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.069357 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rqmv\" (UniqueName: \"kubernetes.io/projected/1fe30e1c-b403-4aca-868f-5bbc23f99e77-kube-api-access-2rqmv\") pod \"ingress-canary-hbf9l\" (UID: \"1fe30e1c-b403-4aca-868f-5bbc23f99e77\") " pod="openshift-ingress-canary/ingress-canary-hbf9l" Oct 30 23:35:55.069481 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.069442 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx6m2\" (UniqueName: \"kubernetes.io/projected/0c018322-20cb-470c-ae55-7eaddfbb60ea-kube-api-access-jx6m2\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.069610 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.069539 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9rpw\" (UniqueName: \"kubernetes.io/projected/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-kube-api-access-b9rpw\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:55.069610 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.069539 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7l82\" (UniqueName: \"kubernetes.io/projected/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-kube-api-access-q7l82\") pod \"console-6dbcd5d88c-jnld8\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.069920 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.069901 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rbfk\" (UniqueName: \"kubernetes.io/projected/c3fdf510-52fb-4e1e-92c9-5208cb680d05-kube-api-access-5rbfk\") pod \"network-check-target-d7mfp\" (UID: \"c3fdf510-52fb-4e1e-92c9-5208cb680d05\") " pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:35:55.071623 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.071608 6174 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 23:35:55.071704 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:35:55.071648 6174 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-47.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-47.ec2.internal" Oct 30 23:35:55.072115 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.072100 6174 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 23:35:55.072210 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:35:55.072137 6174 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-47.ec2.internal" Oct 30 23:35:55.150226 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150151 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-device-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.150226 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150200 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-run-netns\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150225 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150251 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-conf-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150272 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-root\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150295 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysctl-d\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150306 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-conf-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150318 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-socket-dir-parent\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150271 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-run-netns\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150354 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-cni-multus\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150355 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-root\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150373 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-socket-dir-parent\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150271 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-device-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150378 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16cf618c-6b7c-463c-9501-b27e41b837cc-host-slash\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150306 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150407 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16cf618c-6b7c-463c-9501-b27e41b837cc-host-slash\") pod \"iptables-alerter-9mljf\" (UID: \"16cf618c-6b7c-463c-9501-b27e41b837cc\") " pod="openshift-network-operator/iptables-alerter-9mljf" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150412 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-etc-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150423 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysctl-d\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150429 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-cni-multus\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.150442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150450 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysctl-conf\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150476 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-wtmp\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150507 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-etc-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150502 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-ovn\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150539 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-netns\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150556 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-node-exporter-wtmp\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150563 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150566 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-ovn\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150573 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-netns\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150589 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-run\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150597 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysctl-conf\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150608 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150614 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-sys\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150643 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd63f30a-bd74-47e5-9692-e6a41b88ad6c-sys\") pod \"node-exporter-z2tf6\" (UID: \"dd63f30a-bd74-47e5-9692-e6a41b88ad6c\") " pod="openshift-monitoring/node-exporter-z2tf6" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150648 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-run\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150641 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-systemd-units\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150679 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-systemd-units\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150680 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-cni-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150704 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-cnibin\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150717 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-multus-cni-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150718 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-system-cni-dir\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150735 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-system-cni-dir\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150747 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-system-cni-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150763 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-cnibin\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150766 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-registration-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150783 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-cni-netd\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150798 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150820 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-etc-kubernetes\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150829 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-registration-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150836 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-cnibin\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150854 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-cni-netd\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150865 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00844e37-d582-444e-ae95-a498060b4519-cnibin\") pod \"multus-additional-cni-plugins-gx66m\" (UID: \"00844e37-d582-444e-ae95-a498060b4519\") " pod="openshift-multus/multus-additional-cni-plugins-gx66m" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150860 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150872 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-etc-kubernetes\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150863 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-system-cni-dir\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150895 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-multus-certs\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150911 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-systemd\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150941 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-multus-certs\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150942 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-kubelet\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150960 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-kubelet\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150969 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-slash\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150986 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.150987 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-systemd\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151021 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-slash\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151031 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-run-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151048 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-kubernetes\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151068 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-crio-socket\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151084 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysconfig\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151090 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-kubernetes\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.151091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151116 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-lib-modules\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151126 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf-crio-socket\") pod \"insights-runtime-extractor-b2gj4\" (UID: \"c78c4a1f-3d9d-46de-90a2-d5c6b16a62cf\") " pod="openshift-insights/insights-runtime-extractor-b2gj4" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151142 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-var-lib-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151150 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-sysconfig\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151188 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-kubelet\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151205 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-var-lib-openvswitch\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151212 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1cc7c057-2789-4df5-8370-2244dc2f5d8b-dbus\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151223 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-lib-modules\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151237 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-host\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151241 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-kubelet\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151261 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-socket-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151268 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1cc7c057-2789-4df5-8370-2244dc2f5d8b-dbus\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151279 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-node-log\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151289 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-host\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151301 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-node-log\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151307 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-sys-fs\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151340 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-k8s-cni-cncf-io\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151365 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1cc7c057-2789-4df5-8370-2244dc2f5d8b-kubelet-config\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151371 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-run-k8s-cni-cncf-io\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151394 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-cni-bin\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151411 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-systemd\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151344 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-sys-fs\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151341 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-socket-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151433 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1cc7c057-2789-4df5-8370-2244dc2f5d8b-kubelet-config\") pod \"global-pull-secret-syncer-dhk5w\" (UID: \"1cc7c057-2789-4df5-8370-2244dc2f5d8b\") " pod="kube-system/global-pull-secret-syncer-dhk5w" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151434 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-log-socket\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151453 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-host-cni-bin\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151467 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b44eee82-b560-4cab-8804-b1e77523635b-hosts-file\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151472 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-systemd\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151468 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c018322-20cb-470c-ae55-7eaddfbb60ea-log-socket\") pod \"ovnkube-node-jxjlg\" (UID: \"0c018322-20cb-470c-ae55-7eaddfbb60ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151495 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-etc-selinux\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151527 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b44eee82-b560-4cab-8804-b1e77523635b-hosts-file\") pod \"node-resolver-czdjt\" (UID: \"b44eee82-b560-4cab-8804-b1e77523635b\") " pod="openshift-dns/node-resolver-czdjt" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151552 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-modprobe-d\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151576 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-etc-selinux\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151600 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-var-lib-kubelet\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151621 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-cni-bin\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151644 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-etc-modprobe-d\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151658 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-var-lib-kubelet\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151658 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-sys\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151676 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-host-var-lib-cni-bin\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151690 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-hostroot\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151701 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04a4d6df-3ad8-44f6-9f53-4760069a9b9d-sys\") pod \"tuned-zvhlw\" (UID: \"04a4d6df-3ad8-44f6-9f53-4760069a9b9d\") " pod="openshift-cluster-node-tuning-operator/tuned-zvhlw" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151715 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d559e44-7c9d-464e-be57-884cff742118-host\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151740 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151744 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/377989f5-3ed6-4546-9722-b341f03c8e39-hostroot\") pod \"multus-rh7rt\" (UID: \"377989f5-3ed6-4546-9722-b341f03c8e39\") " pod="openshift-multus/multus-rh7rt" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151807 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d559e44-7c9d-464e-be57-884cff742118-host\") pod \"node-ca-hszwb\" (UID: \"9d559e44-7c9d-464e-be57-884cff742118\") " pod="openshift-image-registry/node-ca-hszwb" Oct 30 23:35:55.152615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.151821 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04e0565a-5dc8-4461-87fe-6f9dcb2a1468-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h5cgh\" (UID: \"04e0565a-5dc8-4461-87fe-6f9dcb2a1468\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5cgh" Oct 30 23:35:55.253933 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.253908 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75578f867d-n2cxw"] Oct 30 23:35:55.363614 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.363584 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:55.368126 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:55.368102 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:35:57.639591 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:57.639561 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:57.885513 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:57.885482 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-tnlqc" Oct 30 23:35:57.995823 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:57.995759 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xpf7m" Oct 30 23:35:58.514051 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:58.514024 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:35:59.267237 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:35:59.267205 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:35:59.985590 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:59.985561 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:35:59.985828 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:35:59.985812 6174 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 23:36:02.974070 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:02.973989 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:36:02.975183 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:02.975150 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-ljn2m" Oct 30 23:36:03.887880 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:03.887849 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rbrcx" Oct 30 23:36:04.090131 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:04.090104 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjlg" Oct 30 23:36:04.995317 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:04.995285 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:36:05.247056 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:05.246983 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:36:15.252121 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:15.252092 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:36:21.073944 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.073908 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-75578f867d-n2cxw" podUID="d221531c-2ebd-483d-8456-254ae91c3f85" containerName="console" containerID="cri-o://25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b" gracePeriod=15 Oct 30 23:36:21.345498 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.345439 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:36:21.528049 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.528014 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-oauth-config\") pod \"d221531c-2ebd-483d-8456-254ae91c3f85\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " Oct 30 23:36:21.528049 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.528052 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-service-ca\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-service-ca\") pod \"d221531c-2ebd-483d-8456-254ae91c3f85\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " Oct 30 23:36:21.528281 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.528080 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-oauth-serving-cert\") pod \"d221531c-2ebd-483d-8456-254ae91c3f85\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " Oct 30 23:36:21.528281 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.528110 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d221531c-2ebd-483d-8456-254ae91c3f85-tmp\" (UniqueName: \"kubernetes.io/empty-dir/d221531c-2ebd-483d-8456-254ae91c3f85-tmp\") pod \"d221531c-2ebd-483d-8456-254ae91c3f85\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " Oct 30 23:36:21.528281 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.528180 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d221531c-2ebd-483d-8456-254ae91c3f85-kube-api-access-hmmrq\" (UniqueName: \"kubernetes.io/projected/d221531c-2ebd-483d-8456-254ae91c3f85-kube-api-access-hmmrq\") pod \"d221531c-2ebd-483d-8456-254ae91c3f85\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " Oct 30 23:36:21.528281 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.528212 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-console-config\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-console-config\") pod \"d221531c-2ebd-483d-8456-254ae91c3f85\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " Oct 30 23:36:21.528281 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.528265 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-serving-cert\") pod \"d221531c-2ebd-483d-8456-254ae91c3f85\" (UID: \"d221531c-2ebd-483d-8456-254ae91c3f85\") " Oct 30 23:36:21.528738 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.528478 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d221531c-2ebd-483d-8456-254ae91c3f85-tmp" pod "d221531c-2ebd-483d-8456-254ae91c3f85" (UID: "d221531c-2ebd-483d-8456-254ae91c3f85"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:36:21.528738 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.528631 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-oauth-serving-cert" pod "d221531c-2ebd-483d-8456-254ae91c3f85" (UID: "d221531c-2ebd-483d-8456-254ae91c3f85"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:36:21.528738 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.528637 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-service-ca" pod "d221531c-2ebd-483d-8456-254ae91c3f85" (UID: "d221531c-2ebd-483d-8456-254ae91c3f85"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:36:21.528738 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.528680 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-console-config" pod "d221531c-2ebd-483d-8456-254ae91c3f85" (UID: "d221531c-2ebd-483d-8456-254ae91c3f85"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:36:21.530598 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.530567 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-serving-cert" pod "d221531c-2ebd-483d-8456-254ae91c3f85" (UID: "d221531c-2ebd-483d-8456-254ae91c3f85"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:36:21.530598 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.530591 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d221531c-2ebd-483d-8456-254ae91c3f85-kube-api-access-hmmrq" pod "d221531c-2ebd-483d-8456-254ae91c3f85" (UID: "d221531c-2ebd-483d-8456-254ae91c3f85"). InnerVolumeSpecName "kube-api-access-hmmrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:36:21.530735 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.530602 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-oauth-config" pod "d221531c-2ebd-483d-8456-254ae91c3f85" (UID: "d221531c-2ebd-483d-8456-254ae91c3f85"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:36:21.628960 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.628913 6174 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-oauth-config\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:21.628960 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.628934 6174 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-service-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:21.628960 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.628943 6174 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-oauth-serving-cert\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:21.628960 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.628952 6174 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d221531c-2ebd-483d-8456-254ae91c3f85-tmp\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:21.628960 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.628961 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmmrq\" (UniqueName: \"kubernetes.io/projected/d221531c-2ebd-483d-8456-254ae91c3f85-kube-api-access-hmmrq\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:21.629154 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.628992 6174 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d221531c-2ebd-483d-8456-254ae91c3f85-console-config\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:21.629154 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:21.629001 6174 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d221531c-2ebd-483d-8456-254ae91c3f85-console-serving-cert\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:22.143924 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:22.143891 6174 generic.go:356] "Generic (PLEG): container finished" podID="d221531c-2ebd-483d-8456-254ae91c3f85" containerID="25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b" exitCode=0 Oct 30 23:36:22.144442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:22.143933 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75578f867d-n2cxw" event={"ID":"d221531c-2ebd-483d-8456-254ae91c3f85","Type":"ContainerDied","Data":"25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b"} Oct 30 23:36:22.144442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:22.143959 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75578f867d-n2cxw" Oct 30 23:36:22.144442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:22.144001 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75578f867d-n2cxw" event={"ID":"d221531c-2ebd-483d-8456-254ae91c3f85","Type":"ContainerDied","Data":"23894e914379904a5c7ea7ff6b349d59f6a4f7dd9bcb7b25673bca68722a8a76"} Oct 30 23:36:22.144442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:22.144022 6174 scope.go:122] "RemoveContainer" containerID="25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b" Oct 30 23:36:22.151665 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:22.151644 6174 scope.go:122] "RemoveContainer" containerID="25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b" Oct 30 23:36:22.151914 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:36:22.151894 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b\": container with ID starting with 25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b not found: ID does not exist" containerID="25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b" Oct 30 23:36:22.151964 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:22.151922 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b"} err="failed to get container status \"25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b\": rpc error: code = NotFound desc = could not find container \"25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b\": container with ID starting with 25acd4e95e0c5fd4d4a7bb2b28bfc3a2df717b71e34dec78001ed7d5d853392b not found: ID does not exist" Oct 30 23:36:22.191735 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:22.191714 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75578f867d-n2cxw"] Oct 30 23:36:22.203454 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:22.203429 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75578f867d-n2cxw"] Oct 30 23:36:23.947577 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:23.947543 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d221531c-2ebd-483d-8456-254ae91c3f85" path="/var/lib/kubelet/pods/d221531c-2ebd-483d-8456-254ae91c3f85/volumes" Oct 30 23:36:24.997587 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:24.997559 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d7mfp" Oct 30 23:36:27.753952 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:27.753920 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 23:36:27.754470 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:27.754261 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="alertmanager" containerID="cri-o://e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864" gracePeriod=120 Oct 30 23:36:27.754470 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:27.754348 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="kube-rbac-proxy" containerID="cri-o://ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134" gracePeriod=120 Oct 30 23:36:27.754470 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:27.754334 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="kube-rbac-proxy-web" containerID="cri-o://cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca" gracePeriod=120 Oct 30 23:36:27.754470 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:27.754383 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="config-reloader" containerID="cri-o://a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb" gracePeriod=120 Oct 30 23:36:27.754470 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:27.754397 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="prom-label-proxy" containerID="cri-o://cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4" gracePeriod=120 Oct 30 23:36:27.754470 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:27.754333 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="kube-rbac-proxy-metric" containerID="cri-o://4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4" gracePeriod=120 Oct 30 23:36:28.170117 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:28.170083 6174 generic.go:356] "Generic (PLEG): container finished" podID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerID="cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4" exitCode=0 Oct 30 23:36:28.170117 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:28.170109 6174 generic.go:356] "Generic (PLEG): container finished" podID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerID="4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4" exitCode=0 Oct 30 23:36:28.170117 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:28.170116 6174 generic.go:356] "Generic (PLEG): container finished" podID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerID="ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134" exitCode=0 Oct 30 23:36:28.170117 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:28.170122 6174 generic.go:356] "Generic (PLEG): container finished" podID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerID="a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb" exitCode=0 Oct 30 23:36:28.170117 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:28.170128 6174 generic.go:356] "Generic (PLEG): container finished" podID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerID="e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864" exitCode=0 Oct 30 23:36:28.170415 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:28.170177 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerDied","Data":"cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4"} Oct 30 23:36:28.170415 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:28.170239 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerDied","Data":"4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4"} Oct 30 23:36:28.170415 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:28.170271 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerDied","Data":"ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134"} Oct 30 23:36:28.170415 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:28.170297 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerDied","Data":"a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb"} Oct 30 23:36:28.170415 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:28.170322 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerDied","Data":"e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864"} Oct 30 23:36:29.028220 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.028194 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.176198 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.176111 6174 generic.go:356] "Generic (PLEG): container finished" podID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerID="cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca" exitCode=0 Oct 30 23:36:29.176198 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.176189 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerDied","Data":"cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca"} Oct 30 23:36:29.176371 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.176220 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.176371 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.176288 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"03b37470-09fd-4ec5-8cff-c4b840d49ef0","Type":"ContainerDied","Data":"e4fc9dadb24dd9e62999cc340212c8b225132620b5e3a25f0f95a4d1da78d825"} Oct 30 23:36:29.176371 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.176327 6174 scope.go:122] "RemoveContainer" containerID="cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4" Oct 30 23:36:29.183104 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.183088 6174 scope.go:122] "RemoveContainer" containerID="4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4" Oct 30 23:36:29.185087 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185064 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-trusted-ca-bundle\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185225 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185095 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-web-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-web-config\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185225 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185114 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185225 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185146 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-tls-assets\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-tls-assets\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185225 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185219 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-cluster-tls-config\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185435 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185257 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185435 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185340 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-main-tls\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185435 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185381 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-metrics-client-ca\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185587 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185447 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-main-db\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185587 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185461 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-trusted-ca-bundle" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:36:29.185587 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185490 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-kube-api-access-4fbw2\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-kube-api-access-4fbw2\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185587 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185523 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-web\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185587 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185549 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-out\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-out\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185587 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185583 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-volume\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-volume\") pod \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\" (UID: \"03b37470-09fd-4ec5-8cff-c4b840d49ef0\") " Oct 30 23:36:29.185902 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185796 6174 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.185902 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.185884 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-metrics-client-ca" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:36:29.186742 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.186715 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-main-db" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:36:29.189790 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.189759 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-kube-api-access-4fbw2" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "kube-api-access-4fbw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:36:29.191241 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.191213 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:36:29.191343 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.191286 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-tls-assets" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:36:29.191431 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.191410 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-volume" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:36:29.191547 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.191514 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-main-tls" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:36:29.191650 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.191611 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-web" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:36:29.191774 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.191733 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-metric" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:36:29.191963 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.191942 6174 scope.go:122] "RemoveContainer" containerID="ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134" Oct 30 23:36:29.192051 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.191981 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-out" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:36:29.194279 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.194242 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-cluster-tls-config" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:36:29.200356 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.200336 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-web-config" pod "03b37470-09fd-4ec5-8cff-c4b840d49ef0" (UID: "03b37470-09fd-4ec5-8cff-c4b840d49ef0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:36:29.205843 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.205827 6174 scope.go:122] "RemoveContainer" containerID="cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca" Oct 30 23:36:29.211744 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.211728 6174 scope.go:122] "RemoveContainer" containerID="a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb" Oct 30 23:36:29.217915 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.217898 6174 scope.go:122] "RemoveContainer" containerID="e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864" Oct 30 23:36:29.224185 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.224165 6174 scope.go:122] "RemoveContainer" containerID="44f667879e12356a502010043bd0f4849b75bc3697ad71c8bc251079d05b6038" Oct 30 23:36:29.230112 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.230096 6174 scope.go:122] "RemoveContainer" containerID="cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4" Oct 30 23:36:29.230373 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:36:29.230355 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4\": container with ID starting with cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4 not found: ID does not exist" containerID="cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4" Oct 30 23:36:29.230429 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.230381 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4"} err="failed to get container status \"cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4\": rpc error: code = NotFound desc = could not find container \"cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4\": container with ID starting with cc631a7460ad452e032a71814848bf1e6e35b22a25185d7ee42c293581c66cb4 not found: ID does not exist" Oct 30 23:36:29.230429 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.230403 6174 scope.go:122] "RemoveContainer" containerID="4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4" Oct 30 23:36:29.230640 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:36:29.230621 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4\": container with ID starting with 4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4 not found: ID does not exist" containerID="4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4" Oct 30 23:36:29.230704 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.230653 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4"} err="failed to get container status \"4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4\": rpc error: code = NotFound desc = could not find container \"4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4\": container with ID starting with 4c87136f28a50ee8c7fb77e9fd21b2521d6d89392ff1bc623d8eb7737f28f1e4 not found: ID does not exist" Oct 30 23:36:29.230704 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.230677 6174 scope.go:122] "RemoveContainer" containerID="ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134" Oct 30 23:36:29.230916 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:36:29.230900 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134\": container with ID starting with ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134 not found: ID does not exist" containerID="ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134" Oct 30 23:36:29.230951 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.230922 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134"} err="failed to get container status \"ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134\": rpc error: code = NotFound desc = could not find container \"ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134\": container with ID starting with ac3c29002b312310aeeef7a0bbf9b05f73985a4be1d38b70212f2d57f117c134 not found: ID does not exist" Oct 30 23:36:29.230951 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.230936 6174 scope.go:122] "RemoveContainer" containerID="cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca" Oct 30 23:36:29.231250 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:36:29.231145 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca\": container with ID starting with cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca not found: ID does not exist" containerID="cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca" Oct 30 23:36:29.231250 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.231180 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca"} err="failed to get container status \"cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca\": rpc error: code = NotFound desc = could not find container \"cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca\": container with ID starting with cd7fcfce37702d171804f67a2ef74269c6b5812880396d6d396f177d5eb895ca not found: ID does not exist" Oct 30 23:36:29.231250 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.231199 6174 scope.go:122] "RemoveContainer" containerID="a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb" Oct 30 23:36:29.231426 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:36:29.231409 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb\": container with ID starting with a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb not found: ID does not exist" containerID="a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb" Oct 30 23:36:29.231465 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.231430 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb"} err="failed to get container status \"a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb\": rpc error: code = NotFound desc = could not find container \"a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb\": container with ID starting with a8635d7dc4a46bec73c3b7194a3bf723630ae99feb40cb231a881d287fc7dbcb not found: ID does not exist" Oct 30 23:36:29.231465 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.231444 6174 scope.go:122] "RemoveContainer" containerID="e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864" Oct 30 23:36:29.231666 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:36:29.231650 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864\": container with ID starting with e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864 not found: ID does not exist" containerID="e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864" Oct 30 23:36:29.231736 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.231673 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864"} err="failed to get container status \"e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864\": rpc error: code = NotFound desc = could not find container \"e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864\": container with ID starting with e3614a568fd0c6635736c0f5aae63f8162121c70ac039efa6027abe38d16f864 not found: ID does not exist" Oct 30 23:36:29.231736 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.231691 6174 scope.go:122] "RemoveContainer" containerID="44f667879e12356a502010043bd0f4849b75bc3697ad71c8bc251079d05b6038" Oct 30 23:36:29.231934 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:36:29.231917 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44f667879e12356a502010043bd0f4849b75bc3697ad71c8bc251079d05b6038\": container with ID starting with 44f667879e12356a502010043bd0f4849b75bc3697ad71c8bc251079d05b6038 not found: ID does not exist" containerID="44f667879e12356a502010043bd0f4849b75bc3697ad71c8bc251079d05b6038" Oct 30 23:36:29.231977 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.231940 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44f667879e12356a502010043bd0f4849b75bc3697ad71c8bc251079d05b6038"} err="failed to get container status \"44f667879e12356a502010043bd0f4849b75bc3697ad71c8bc251079d05b6038\": rpc error: code = NotFound desc = could not find container \"44f667879e12356a502010043bd0f4849b75bc3697ad71c8bc251079d05b6038\": container with ID starting with 44f667879e12356a502010043bd0f4849b75bc3697ad71c8bc251079d05b6038 not found: ID does not exist" Oct 30 23:36:29.266337 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:36:29.266310 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:36:29.286729 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.286707 6174 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-cluster-tls-config\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.286826 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.286733 6174 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.286826 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.286753 6174 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-main-tls\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.286826 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.286767 6174 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03b37470-09fd-4ec5-8cff-c4b840d49ef0-metrics-client-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.286826 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.286781 6174 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-alertmanager-main-db\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.286826 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.286794 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fbw2\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-kube-api-access-4fbw2\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.286826 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.286806 6174 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.286826 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.286819 6174 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-out\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.287080 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.286832 6174 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-config-volume\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.287080 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.286870 6174 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-web-config\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.287080 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.286885 6174 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/03b37470-09fd-4ec5-8cff-c4b840d49ef0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.287080 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.286899 6174 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/03b37470-09fd-4ec5-8cff-c4b840d49ef0-tls-assets\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:36:29.519502 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.519476 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 23:36:29.531370 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.531348 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 23:36:29.548463 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548441 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 23:36:29.548703 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548689 6174 cpu_manager.go:414] "containerMap: removing container" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="config-reloader" Oct 30 23:36:29.548773 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548706 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="config-reloader" Oct 30 23:36:29.548773 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548758 6174 cpu_manager.go:414] "containerMap: removing container" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="kube-rbac-proxy-metric" Oct 30 23:36:29.548773 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548768 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="kube-rbac-proxy-metric" Oct 30 23:36:29.548925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548780 6174 cpu_manager.go:414] "containerMap: removing container" podUID="d221531c-2ebd-483d-8456-254ae91c3f85" containerName="console" Oct 30 23:36:29.548925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548787 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d221531c-2ebd-483d-8456-254ae91c3f85" containerName="console" Oct 30 23:36:29.548925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548799 6174 cpu_manager.go:414] "containerMap: removing container" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="prom-label-proxy" Oct 30 23:36:29.548925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548808 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="prom-label-proxy" Oct 30 23:36:29.548925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548818 6174 cpu_manager.go:414] "containerMap: removing container" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="alertmanager" Oct 30 23:36:29.548925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548825 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="alertmanager" Oct 30 23:36:29.548925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548839 6174 cpu_manager.go:414] "containerMap: removing container" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="kube-rbac-proxy-web" Oct 30 23:36:29.548925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548847 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="kube-rbac-proxy-web" Oct 30 23:36:29.548925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548862 6174 cpu_manager.go:414] "containerMap: removing container" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="kube-rbac-proxy" Oct 30 23:36:29.548925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548869 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="kube-rbac-proxy" Oct 30 23:36:29.548925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548889 6174 cpu_manager.go:414] "containerMap: removing container" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="init-config-reloader" Oct 30 23:36:29.548925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548897 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="init-config-reloader" Oct 30 23:36:29.549516 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548957 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="kube-rbac-proxy-metric" Oct 30 23:36:29.549516 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548970 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="d221531c-2ebd-483d-8456-254ae91c3f85" containerName="console" Oct 30 23:36:29.549516 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548978 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="prom-label-proxy" Oct 30 23:36:29.549516 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548986 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="alertmanager" Oct 30 23:36:29.549516 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.548994 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="kube-rbac-proxy-web" Oct 30 23:36:29.549516 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.549003 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="kube-rbac-proxy" Oct 30 23:36:29.549516 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.549012 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="init-config-reloader" Oct 30 23:36:29.549516 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.549021 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" containerName="config-reloader" Oct 30 23:36:29.565555 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.565536 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.580534 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.580516 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 23:36:29.580824 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.580806 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 23:36:29.580927 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.580835 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 23:36:29.582551 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.582531 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 23:36:29.593406 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.593387 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 23:36:29.593406 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.593382 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 23:36:29.680926 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.680903 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 23:36:29.680926 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.680917 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 23:36:29.681079 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.680958 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 23:36:29.681079 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.680966 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 23:36:29.681079 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.681065 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-c8cbk\"" Oct 30 23:36:29.689340 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689324 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.689401 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689349 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.689401 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689371 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.689401 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689390 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ada8ced-a063-4061-9aa9-d7a374a71ec8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.689544 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689508 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.689544 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689533 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ada8ced-a063-4061-9aa9-d7a374a71ec8-config-out\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.689618 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689595 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.689618 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689613 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ada8ced-a063-4061-9aa9-d7a374a71ec8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.689719 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689630 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zzqq\" (UniqueName: \"kubernetes.io/projected/8ada8ced-a063-4061-9aa9-d7a374a71ec8-kube-api-access-8zzqq\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.689719 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689647 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ada8ced-a063-4061-9aa9-d7a374a71ec8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.689719 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689695 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.689856 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689751 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-web-config\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.689856 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.689789 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ada8ced-a063-4061-9aa9-d7a374a71ec8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.790077 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790054 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.790185 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790083 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ada8ced-a063-4061-9aa9-d7a374a71ec8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.790185 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790100 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zzqq\" (UniqueName: \"kubernetes.io/projected/8ada8ced-a063-4061-9aa9-d7a374a71ec8-kube-api-access-8zzqq\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.790269 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790223 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ada8ced-a063-4061-9aa9-d7a374a71ec8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.790269 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790249 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.790369 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790281 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-web-config\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.790420 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790400 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ada8ced-a063-4061-9aa9-d7a374a71ec8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.790469 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790447 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.790520 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790470 6174 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 23:36:29.790764 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790743 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ada8ced-a063-4061-9aa9-d7a374a71ec8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.790918 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790475 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.791024 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790944 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.791024 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790984 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ada8ced-a063-4061-9aa9-d7a374a71ec8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.791024 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.791021 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.791204 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.791048 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ada8ced-a063-4061-9aa9-d7a374a71ec8-config-out\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.791830 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.790833 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ada8ced-a063-4061-9aa9-d7a374a71ec8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.792602 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.792553 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ada8ced-a063-4061-9aa9-d7a374a71ec8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.793307 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.793280 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-web-config\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.793389 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.793365 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.793498 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.793478 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.793766 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.793717 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ada8ced-a063-4061-9aa9-d7a374a71ec8-config-out\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.793901 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.793878 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ada8ced-a063-4061-9aa9-d7a374a71ec8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.793971 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.793912 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.794225 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.794206 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.794468 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.794443 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.794937 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.794918 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ada8ced-a063-4061-9aa9-d7a374a71ec8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.808678 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.808661 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zzqq\" (UniqueName: \"kubernetes.io/projected/8ada8ced-a063-4061-9aa9-d7a374a71ec8-kube-api-access-8zzqq\") pod \"alertmanager-main-0\" (UID: \"8ada8ced-a063-4061-9aa9-d7a374a71ec8\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:29.948898 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.948870 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="03b37470-09fd-4ec5-8cff-c4b840d49ef0" path="/var/lib/kubelet/pods/03b37470-09fd-4ec5-8cff-c4b840d49ef0/volumes" Oct 30 23:36:29.997297 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:29.997269 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 23:36:30.342742 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:30.342667 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 23:36:30.347857 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:36:30.347828 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ada8ced_a063_4061_9aa9_d7a374a71ec8.slice/crio-6cb1fd8d4301fce5544b7b31f65097a8dcd77b53e7042cd53caae11e4fd5cddf WatchSource:0}: Error finding container 6cb1fd8d4301fce5544b7b31f65097a8dcd77b53e7042cd53caae11e4fd5cddf: Status 404 returned error can't find the container with id 6cb1fd8d4301fce5544b7b31f65097a8dcd77b53e7042cd53caae11e4fd5cddf Oct 30 23:36:31.188395 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.188362 6174 generic.go:356] "Generic (PLEG): container finished" podID="8ada8ced-a063-4061-9aa9-d7a374a71ec8" containerID="a3c734c81bfe7e2092992712b489dadf3725d7caeec6a4ebdfecb8017b0cc727" exitCode=0 Oct 30 23:36:31.188553 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.188427 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ada8ced-a063-4061-9aa9-d7a374a71ec8","Type":"ContainerDied","Data":"a3c734c81bfe7e2092992712b489dadf3725d7caeec6a4ebdfecb8017b0cc727"} Oct 30 23:36:31.188553 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.188501 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ada8ced-a063-4061-9aa9-d7a374a71ec8","Type":"ContainerStarted","Data":"6cb1fd8d4301fce5544b7b31f65097a8dcd77b53e7042cd53caae11e4fd5cddf"} Oct 30 23:36:31.735309 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.733542 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-848b854bb9-m9nsx"] Oct 30 23:36:31.759514 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.759487 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.777138 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.777088 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Oct 30 23:36:31.777138 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.777093 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Oct 30 23:36:31.777324 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.777196 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Oct 30 23:36:31.777501 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.777482 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Oct 30 23:36:31.777607 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.777502 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-l7qr6\"" Oct 30 23:36:31.778591 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.778570 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-848b854bb9-m9nsx"] Oct 30 23:36:31.805344 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.805308 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ac8687ac-f591-479c-9bc2-e2557f9fcc85-federate-client-tls\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.805485 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.805354 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ac8687ac-f591-479c-9bc2-e2557f9fcc85-telemeter-client-tls\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.805485 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.805452 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac8687ac-f591-479c-9bc2-e2557f9fcc85-metrics-client-ca\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.805485 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.805481 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8687ac-f591-479c-9bc2-e2557f9fcc85-telemeter-trusted-ca-bundle\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.805589 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.805521 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxmv8\" (UniqueName: \"kubernetes.io/projected/ac8687ac-f591-479c-9bc2-e2557f9fcc85-kube-api-access-xxmv8\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.805624 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.805613 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ac8687ac-f591-479c-9bc2-e2557f9fcc85-secret-telemeter-client\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.805666 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.805631 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac8687ac-f591-479c-9bc2-e2557f9fcc85-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.805666 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.805653 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8687ac-f591-479c-9bc2-e2557f9fcc85-serving-certs-ca-bundle\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.849529 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.849502 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Oct 30 23:36:31.861891 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.861867 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Oct 30 23:36:31.906518 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.906493 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ac8687ac-f591-479c-9bc2-e2557f9fcc85-federate-client-tls\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.906622 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.906531 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ac8687ac-f591-479c-9bc2-e2557f9fcc85-telemeter-client-tls\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.906622 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.906558 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac8687ac-f591-479c-9bc2-e2557f9fcc85-metrics-client-ca\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.906622 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.906579 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8687ac-f591-479c-9bc2-e2557f9fcc85-telemeter-trusted-ca-bundle\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.906622 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.906617 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxmv8\" (UniqueName: \"kubernetes.io/projected/ac8687ac-f591-479c-9bc2-e2557f9fcc85-kube-api-access-xxmv8\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.906847 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.906640 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ac8687ac-f591-479c-9bc2-e2557f9fcc85-secret-telemeter-client\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.906847 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.906657 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac8687ac-f591-479c-9bc2-e2557f9fcc85-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.906847 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.906686 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8687ac-f591-479c-9bc2-e2557f9fcc85-serving-certs-ca-bundle\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.907469 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.907440 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8687ac-f591-479c-9bc2-e2557f9fcc85-serving-certs-ca-bundle\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.907563 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.907443 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac8687ac-f591-479c-9bc2-e2557f9fcc85-metrics-client-ca\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.907713 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.907696 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8687ac-f591-479c-9bc2-e2557f9fcc85-telemeter-trusted-ca-bundle\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.909527 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.909507 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ac8687ac-f591-479c-9bc2-e2557f9fcc85-federate-client-tls\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.909621 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.909578 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ac8687ac-f591-479c-9bc2-e2557f9fcc85-telemeter-client-tls\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.909718 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.909695 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac8687ac-f591-479c-9bc2-e2557f9fcc85-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.909786 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.909771 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ac8687ac-f591-479c-9bc2-e2557f9fcc85-secret-telemeter-client\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:31.924981 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:31.924955 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxmv8\" (UniqueName: \"kubernetes.io/projected/ac8687ac-f591-479c-9bc2-e2557f9fcc85-kube-api-access-xxmv8\") pod \"telemeter-client-848b854bb9-m9nsx\" (UID: \"ac8687ac-f591-479c-9bc2-e2557f9fcc85\") " pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:32.110057 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:32.110023 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" Oct 30 23:36:32.196267 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:32.196226 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ada8ced-a063-4061-9aa9-d7a374a71ec8","Type":"ContainerStarted","Data":"461dedda0acdd693143ca083130f1bc09367f1b62a8a744d586f96094bd9423c"} Oct 30 23:36:32.196377 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:32.196303 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ada8ced-a063-4061-9aa9-d7a374a71ec8","Type":"ContainerStarted","Data":"52e592059e780cbcbc7bc1f655af4a87fa6182c4a2e7e362b6742bf0dbe42870"} Oct 30 23:36:32.196377 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:32.196336 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ada8ced-a063-4061-9aa9-d7a374a71ec8","Type":"ContainerStarted","Data":"a64d47f71a2826efe296c074a7e48ef82b4f2961442b374f907ede65f84bac6b"} Oct 30 23:36:32.196377 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:32.196364 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ada8ced-a063-4061-9aa9-d7a374a71ec8","Type":"ContainerStarted","Data":"6b396692f7d7fb1d248fb28bb93282426fce4abeeae37676dd07b1486be1b71c"} Oct 30 23:36:32.196476 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:32.196388 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ada8ced-a063-4061-9aa9-d7a374a71ec8","Type":"ContainerStarted","Data":"900a55caa1ffae96f05169e2d8cbb501dae6d7fb123200358eca99da3a94f17f"} Oct 30 23:36:32.196476 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:32.196416 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ada8ced-a063-4061-9aa9-d7a374a71ec8","Type":"ContainerStarted","Data":"3466ca3caeb8146e8f4572e596e5f6f0ce22c2f2a6b22c2172c6f37ba5a09b59"} Oct 30 23:36:32.242189 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:32.242126 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.229092202 podStartE2EDuration="3.242112564s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.020362ms" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:32.240977409 +0000 UTC m=+38.451563910" watchObservedRunningTime="2026-10-30 23:36:32.242112564 +0000 UTC m=+38.452699058" Oct 30 23:36:32.441870 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:32.441776 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-848b854bb9-m9nsx"] Oct 30 23:36:32.452730 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:36:32.452689 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8687ac_f591_479c_9bc2_e2557f9fcc85.slice/crio-ea5afefe3ca13fcdd99d728a614d3bc7d963b5a27cf71da739c115082d4790ba WatchSource:0}: Error finding container ea5afefe3ca13fcdd99d728a614d3bc7d963b5a27cf71da739c115082d4790ba: Status 404 returned error can't find the container with id ea5afefe3ca13fcdd99d728a614d3bc7d963b5a27cf71da739c115082d4790ba Oct 30 23:36:32.454705 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:32.454686 6174 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 23:36:33.207336 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:33.207290 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" event={"ID":"ac8687ac-f591-479c-9bc2-e2557f9fcc85","Type":"ContainerStarted","Data":"ea5afefe3ca13fcdd99d728a614d3bc7d963b5a27cf71da739c115082d4790ba"} Oct 30 23:36:35.216128 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.216096 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" event={"ID":"ac8687ac-f591-479c-9bc2-e2557f9fcc85","Type":"ContainerStarted","Data":"df0eed69801b411a6b075faca11e025cc826f2ea27162c65781d8cc8212bee81"} Oct 30 23:36:35.216572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.216148 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" event={"ID":"ac8687ac-f591-479c-9bc2-e2557f9fcc85","Type":"ContainerStarted","Data":"1366a78b17cdb7ec3f1ec802584c6c67f69b6261caa6b8edb287cdf090f1e413"} Oct 30 23:36:35.216572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.216183 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" event={"ID":"ac8687ac-f591-479c-9bc2-e2557f9fcc85","Type":"ContainerStarted","Data":"817955544f117045dd7636ffd9ac3162d702c57503de0e2560de772133b40e8e"} Oct 30 23:36:35.283658 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.283606 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-848b854bb9-m9nsx" podStartSLOduration=2.277410621 podStartE2EDuration="4.283592432s" totalImagesPullingTime="2.006181811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:35.268984776 +0000 UTC m=+41.479571278" watchObservedRunningTime="2026-10-30 23:36:35.283592432 +0000 UTC m=+41.494178928" Oct 30 23:36:35.441005 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.440978 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d6cc4759-qs8s6"] Oct 30 23:36:35.463440 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.463416 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.465514 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.465494 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d6cc4759-qs8s6"] Oct 30 23:36:35.539390 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.539360 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-service-ca\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.539503 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.539395 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-oauth-serving-cert\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.539503 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.539420 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b90c11-2400-4570-b184-c184e10fc984-tmp\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.539503 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.539463 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-trusted-ca-bundle\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.539608 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.539587 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-serving-cert\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.539647 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.539624 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-oauth-config\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.539647 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.539641 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v428b\" (UniqueName: \"kubernetes.io/projected/00b90c11-2400-4570-b184-c184e10fc984-kube-api-access-v428b\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.539766 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.539746 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-console-config\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.640139 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.640113 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-service-ca\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.640139 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.640140 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-oauth-serving-cert\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.640313 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.640182 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b90c11-2400-4570-b184-c184e10fc984-tmp\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.640313 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.640206 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-trusted-ca-bundle\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.640313 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.640237 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-serving-cert\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.640313 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.640269 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-oauth-config\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.640313 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.640295 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v428b\" (UniqueName: \"kubernetes.io/projected/00b90c11-2400-4570-b184-c184e10fc984-kube-api-access-v428b\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.640551 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.640329 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-console-config\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.640606 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.640579 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b90c11-2400-4570-b184-c184e10fc984-tmp\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.641255 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.641225 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-service-ca\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.641413 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.641322 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-oauth-serving-cert\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.641514 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.641485 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-console-config\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.641814 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.641786 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-trusted-ca-bundle\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.646247 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.646228 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-oauth-config\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.646423 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.646403 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-serving-cert\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.659418 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.659398 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v428b\" (UniqueName: \"kubernetes.io/projected/00b90c11-2400-4570-b184-c184e10fc984-kube-api-access-v428b\") pod \"console-75d6cc4759-qs8s6\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:35.786820 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:35.786793 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:36.110849 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:36.110776 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d6cc4759-qs8s6"] Oct 30 23:36:36.117319 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:36:36.117289 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b90c11_2400_4570_b184_c184e10fc984.slice/crio-595eeb31123f2e7ae906e46a38c72562acca02e3313ee2f5e7c1ce133b67a766 WatchSource:0}: Error finding container 595eeb31123f2e7ae906e46a38c72562acca02e3313ee2f5e7c1ce133b67a766: Status 404 returned error can't find the container with id 595eeb31123f2e7ae906e46a38c72562acca02e3313ee2f5e7c1ce133b67a766 Oct 30 23:36:36.222513 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:36.222478 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d6cc4759-qs8s6" event={"ID":"00b90c11-2400-4570-b184-c184e10fc984","Type":"ContainerStarted","Data":"d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829"} Oct 30 23:36:36.222941 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:36.222537 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d6cc4759-qs8s6" event={"ID":"00b90c11-2400-4570-b184-c184e10fc984","Type":"ContainerStarted","Data":"595eeb31123f2e7ae906e46a38c72562acca02e3313ee2f5e7c1ce133b67a766"} Oct 30 23:36:36.263542 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:36.263489 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-75d6cc4759-qs8s6" podStartSLOduration=1.263474486 podStartE2EDuration="1.263474486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:36:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:36:36.262894445 +0000 UTC m=+42.473480946" watchObservedRunningTime="2026-10-30 23:36:36.263474486 +0000 UTC m=+42.474060983" Oct 30 23:36:45.787879 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:45.787843 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:45.788394 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:45.787932 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:45.792476 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:45.792452 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:46.259871 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:46.259797 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:36:46.369093 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:36:46.369062 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dbcd5d88c-jnld8"] Oct 30 23:36:59.267102 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:36:59.267065 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:37:11.388692 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.388642 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6dbcd5d88c-jnld8" podUID="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" containerName="console" containerID="cri-o://c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6" gracePeriod=15 Oct 30 23:37:11.620734 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.620709 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:37:11.693998 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.693928 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-service-ca\") pod \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " Oct 30 23:37:11.693998 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.693966 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-kube-api-access-q7l82\" (UniqueName: \"kubernetes.io/projected/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-kube-api-access-q7l82\") pod \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " Oct 30 23:37:11.694226 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.694007 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-oauth-config\") pod \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " Oct 30 23:37:11.694226 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.694115 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-trusted-ca-bundle\") pod \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " Oct 30 23:37:11.694226 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.694149 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-config\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-config\") pod \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " Oct 30 23:37:11.694226 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.694200 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-oauth-serving-cert\") pod \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " Oct 30 23:37:11.694443 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.694247 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-tmp\") pod \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " Oct 30 23:37:11.694443 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.694287 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-serving-cert\") pod \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\" (UID: \"8eac4053-9b77-4a82-9b9c-2ad59058f1bb\") " Oct 30 23:37:11.694542 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.694439 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-service-ca" pod "8eac4053-9b77-4a82-9b9c-2ad59058f1bb" (UID: "8eac4053-9b77-4a82-9b9c-2ad59058f1bb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:37:11.694609 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.694587 6174 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-service-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:37:11.694691 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.694625 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-trusted-ca-bundle" pod "8eac4053-9b77-4a82-9b9c-2ad59058f1bb" (UID: "8eac4053-9b77-4a82-9b9c-2ad59058f1bb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:37:11.694691 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.694669 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-tmp" pod "8eac4053-9b77-4a82-9b9c-2ad59058f1bb" (UID: "8eac4053-9b77-4a82-9b9c-2ad59058f1bb"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:37:11.694772 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.694687 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-oauth-serving-cert" pod "8eac4053-9b77-4a82-9b9c-2ad59058f1bb" (UID: "8eac4053-9b77-4a82-9b9c-2ad59058f1bb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:37:11.694887 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.694850 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-config" pod "8eac4053-9b77-4a82-9b9c-2ad59058f1bb" (UID: "8eac4053-9b77-4a82-9b9c-2ad59058f1bb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:37:11.696249 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.696225 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-oauth-config" pod "8eac4053-9b77-4a82-9b9c-2ad59058f1bb" (UID: "8eac4053-9b77-4a82-9b9c-2ad59058f1bb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:37:11.696342 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.696329 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-kube-api-access-q7l82" pod "8eac4053-9b77-4a82-9b9c-2ad59058f1bb" (UID: "8eac4053-9b77-4a82-9b9c-2ad59058f1bb"). InnerVolumeSpecName "kube-api-access-q7l82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:37:11.696388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.696340 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-serving-cert" pod "8eac4053-9b77-4a82-9b9c-2ad59058f1bb" (UID: "8eac4053-9b77-4a82-9b9c-2ad59058f1bb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:37:11.795253 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.795219 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7l82\" (UniqueName: \"kubernetes.io/projected/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-kube-api-access-q7l82\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:37:11.795253 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.795246 6174 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-oauth-config\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:37:11.795253 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.795256 6174 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-trusted-ca-bundle\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:37:11.795456 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.795265 6174 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-config\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:37:11.795456 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.795276 6174 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-oauth-serving-cert\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:37:11.795456 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.795287 6174 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-tmp\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:37:11.795456 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:11.795297 6174 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eac4053-9b77-4a82-9b9c-2ad59058f1bb-console-serving-cert\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:37:12.350414 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:12.350383 6174 generic.go:356] "Generic (PLEG): container finished" podID="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" containerID="c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6" exitCode=0 Oct 30 23:37:12.350583 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:12.350429 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbcd5d88c-jnld8" event={"ID":"8eac4053-9b77-4a82-9b9c-2ad59058f1bb","Type":"ContainerDied","Data":"c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6"} Oct 30 23:37:12.350583 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:12.350434 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbcd5d88c-jnld8" Oct 30 23:37:12.350583 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:12.350469 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbcd5d88c-jnld8" event={"ID":"8eac4053-9b77-4a82-9b9c-2ad59058f1bb","Type":"ContainerDied","Data":"c24b668460a6b72acfa4ce7083af2881d761e54fdaf3434ed3f7be57744f391d"} Oct 30 23:37:12.350583 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:12.350489 6174 scope.go:122] "RemoveContainer" containerID="c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6" Oct 30 23:37:12.358080 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:12.358063 6174 scope.go:122] "RemoveContainer" containerID="c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6" Oct 30 23:37:12.358348 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:37:12.358329 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6\": container with ID starting with c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6 not found: ID does not exist" containerID="c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6" Oct 30 23:37:12.358414 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:12.358357 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6"} err="failed to get container status \"c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6\": rpc error: code = NotFound desc = could not find container \"c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6\": container with ID starting with c08b0dd0f52e6e72bb05549a96fdb62bce4c6682b5f394d64e43374411fc6fc6 not found: ID does not exist" Oct 30 23:37:12.398954 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:12.398930 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dbcd5d88c-jnld8"] Oct 30 23:37:12.410815 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:12.410793 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dbcd5d88c-jnld8"] Oct 30 23:37:13.947498 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:13.947466 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" path="/var/lib/kubelet/pods/8eac4053-9b77-4a82-9b9c-2ad59058f1bb/volumes" Oct 30 23:37:26.796512 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.796479 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-866655858d-ccc5l"] Oct 30 23:37:26.796927 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.796746 6174 cpu_manager.go:414] "containerMap: removing container" podUID="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" containerName="console" Oct 30 23:37:26.796927 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.796757 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" containerName="console" Oct 30 23:37:26.796927 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.796802 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="8eac4053-9b77-4a82-9b9c-2ad59058f1bb" containerName="console" Oct 30 23:37:26.801233 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.801214 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.828354 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.828333 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-866655858d-ccc5l"] Oct 30 23:37:26.894759 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.894719 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0c3823-66d8-4d83-a11d-35ce46a738c9-trusted-ca-bundle\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.894915 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.894769 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf0c3823-66d8-4d83-a11d-35ce46a738c9-console-config\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.894915 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.894820 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0c3823-66d8-4d83-a11d-35ce46a738c9-service-ca\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.894997 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.894931 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf0c3823-66d8-4d83-a11d-35ce46a738c9-console-serving-cert\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.894997 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.894956 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwp6l\" (UniqueName: \"kubernetes.io/projected/bf0c3823-66d8-4d83-a11d-35ce46a738c9-kube-api-access-xwp6l\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.894997 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.894976 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf0c3823-66d8-4d83-a11d-35ce46a738c9-oauth-serving-cert\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.895115 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.894999 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf0c3823-66d8-4d83-a11d-35ce46a738c9-console-oauth-config\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.895148 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.895110 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf0c3823-66d8-4d83-a11d-35ce46a738c9-tmp\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.996340 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.996295 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf0c3823-66d8-4d83-a11d-35ce46a738c9-console-serving-cert\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.996340 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.996346 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwp6l\" (UniqueName: \"kubernetes.io/projected/bf0c3823-66d8-4d83-a11d-35ce46a738c9-kube-api-access-xwp6l\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.996535 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.996367 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf0c3823-66d8-4d83-a11d-35ce46a738c9-oauth-serving-cert\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.996535 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.996417 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf0c3823-66d8-4d83-a11d-35ce46a738c9-console-oauth-config\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.996535 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.996455 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf0c3823-66d8-4d83-a11d-35ce46a738c9-tmp\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.996535 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.996508 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0c3823-66d8-4d83-a11d-35ce46a738c9-trusted-ca-bundle\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.996761 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.996543 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf0c3823-66d8-4d83-a11d-35ce46a738c9-console-config\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.996761 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.996567 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0c3823-66d8-4d83-a11d-35ce46a738c9-service-ca\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.996947 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.996919 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf0c3823-66d8-4d83-a11d-35ce46a738c9-tmp\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.997391 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.997368 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf0c3823-66d8-4d83-a11d-35ce46a738c9-console-config\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.997491 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.997437 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf0c3823-66d8-4d83-a11d-35ce46a738c9-service-ca\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.997553 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.997498 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf0c3823-66d8-4d83-a11d-35ce46a738c9-oauth-serving-cert\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.997730 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.997709 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0c3823-66d8-4d83-a11d-35ce46a738c9-trusted-ca-bundle\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.998920 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.998899 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf0c3823-66d8-4d83-a11d-35ce46a738c9-console-serving-cert\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:26.999021 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:26.998992 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf0c3823-66d8-4d83-a11d-35ce46a738c9-console-oauth-config\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:27.014197 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:27.014178 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwp6l\" (UniqueName: \"kubernetes.io/projected/bf0c3823-66d8-4d83-a11d-35ce46a738c9-kube-api-access-xwp6l\") pod \"console-866655858d-ccc5l\" (UID: \"bf0c3823-66d8-4d83-a11d-35ce46a738c9\") " pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:27.112294 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:27.112237 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:27.403416 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:27.403338 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-866655858d-ccc5l"] Oct 30 23:37:27.410669 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:37:27.410643 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0c3823_66d8_4d83_a11d_35ce46a738c9.slice/crio-33c4ffd7b178a9a6297824ab89fcb6363f654a77d528df420122a8375125adea WatchSource:0}: Error finding container 33c4ffd7b178a9a6297824ab89fcb6363f654a77d528df420122a8375125adea: Status 404 returned error can't find the container with id 33c4ffd7b178a9a6297824ab89fcb6363f654a77d528df420122a8375125adea Oct 30 23:37:28.407284 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:28.407246 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866655858d-ccc5l" event={"ID":"bf0c3823-66d8-4d83-a11d-35ce46a738c9","Type":"ContainerStarted","Data":"d6e47f9c5febfcae00e58d21f002fbe1413851510b24098bb1b15f86463bc8cb"} Oct 30 23:37:28.407661 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:28.407293 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866655858d-ccc5l" event={"ID":"bf0c3823-66d8-4d83-a11d-35ce46a738c9","Type":"ContainerStarted","Data":"33c4ffd7b178a9a6297824ab89fcb6363f654a77d528df420122a8375125adea"} Oct 30 23:37:28.445750 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:28.445702 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-866655858d-ccc5l" podStartSLOduration=2.445689242 podStartE2EDuration="2.445689242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:37:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:37:28.445328476 +0000 UTC m=+94.655914977" watchObservedRunningTime="2026-10-30 23:37:28.445689242 +0000 UTC m=+94.656275740" Oct 30 23:37:29.267786 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:37:29.267744 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:37:37.112505 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:37.112421 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:37.112505 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:37.112481 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:37.117495 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:37.117471 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:37.440838 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:37.440771 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-866655858d-ccc5l" Oct 30 23:37:37.507670 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:37:37.507648 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d6cc4759-qs8s6"] Oct 30 23:37:59.266780 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:37:59.266743 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:38:02.531311 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.531250 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-75d6cc4759-qs8s6" podUID="00b90c11-2400-4570-b184-c184e10fc984" containerName="console" containerID="cri-o://d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829" gracePeriod=15 Oct 30 23:38:02.765674 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.765651 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:38:02.867041 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867019 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00b90c11-2400-4570-b184-c184e10fc984-tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b90c11-2400-4570-b184-c184e10fc984-tmp\") pod \"00b90c11-2400-4570-b184-c184e10fc984\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " Oct 30 23:38:02.867182 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867066 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-console-config\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-console-config\") pod \"00b90c11-2400-4570-b184-c184e10fc984\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " Oct 30 23:38:02.867182 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867098 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-trusted-ca-bundle\") pod \"00b90c11-2400-4570-b184-c184e10fc984\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " Oct 30 23:38:02.867182 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867172 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-service-ca\") pod \"00b90c11-2400-4570-b184-c184e10fc984\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " Oct 30 23:38:02.867359 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867196 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-oauth-serving-cert\") pod \"00b90c11-2400-4570-b184-c184e10fc984\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " Oct 30 23:38:02.867359 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867215 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-serving-cert\") pod \"00b90c11-2400-4570-b184-c184e10fc984\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " Oct 30 23:38:02.867359 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867232 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00b90c11-2400-4570-b184-c184e10fc984-kube-api-access-v428b\" (UniqueName: \"kubernetes.io/projected/00b90c11-2400-4570-b184-c184e10fc984-kube-api-access-v428b\") pod \"00b90c11-2400-4570-b184-c184e10fc984\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " Oct 30 23:38:02.867359 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867260 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-oauth-config\") pod \"00b90c11-2400-4570-b184-c184e10fc984\" (UID: \"00b90c11-2400-4570-b184-c184e10fc984\") " Oct 30 23:38:02.867359 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867269 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00b90c11-2400-4570-b184-c184e10fc984-tmp" pod "00b90c11-2400-4570-b184-c184e10fc984" (UID: "00b90c11-2400-4570-b184-c184e10fc984"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:38:02.867609 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867432 6174 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b90c11-2400-4570-b184-c184e10fc984-tmp\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:38:02.867609 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867454 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-console-config" pod "00b90c11-2400-4570-b184-c184e10fc984" (UID: "00b90c11-2400-4570-b184-c184e10fc984"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:38:02.867691 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867621 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-trusted-ca-bundle" pod "00b90c11-2400-4570-b184-c184e10fc984" (UID: "00b90c11-2400-4570-b184-c184e10fc984"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:38:02.867691 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867646 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-oauth-serving-cert" pod "00b90c11-2400-4570-b184-c184e10fc984" (UID: "00b90c11-2400-4570-b184-c184e10fc984"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:38:02.867753 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.867697 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-service-ca" pod "00b90c11-2400-4570-b184-c184e10fc984" (UID: "00b90c11-2400-4570-b184-c184e10fc984"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:38:02.869371 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.869349 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b90c11-2400-4570-b184-c184e10fc984-kube-api-access-v428b" pod "00b90c11-2400-4570-b184-c184e10fc984" (UID: "00b90c11-2400-4570-b184-c184e10fc984"). InnerVolumeSpecName "kube-api-access-v428b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:38:02.869371 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.869357 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-oauth-config" pod "00b90c11-2400-4570-b184-c184e10fc984" (UID: "00b90c11-2400-4570-b184-c184e10fc984"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:38:02.869505 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.869428 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-serving-cert" pod "00b90c11-2400-4570-b184-c184e10fc984" (UID: "00b90c11-2400-4570-b184-c184e10fc984"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:38:02.967750 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.967724 6174 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-trusted-ca-bundle\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:38:02.967750 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.967747 6174 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-service-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:38:02.967902 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.967758 6174 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-oauth-serving-cert\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:38:02.967902 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.967766 6174 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-serving-cert\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:38:02.967902 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.967775 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v428b\" (UniqueName: \"kubernetes.io/projected/00b90c11-2400-4570-b184-c184e10fc984-kube-api-access-v428b\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:38:02.967902 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.967783 6174 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00b90c11-2400-4570-b184-c184e10fc984-console-oauth-config\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:38:02.967902 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:02.967791 6174 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00b90c11-2400-4570-b184-c184e10fc984-console-config\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:38:03.529046 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:03.529012 6174 generic.go:356] "Generic (PLEG): container finished" podID="00b90c11-2400-4570-b184-c184e10fc984" containerID="d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829" exitCode=0 Oct 30 23:38:03.529257 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:03.529065 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d6cc4759-qs8s6" Oct 30 23:38:03.529257 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:03.529082 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d6cc4759-qs8s6" event={"ID":"00b90c11-2400-4570-b184-c184e10fc984","Type":"ContainerDied","Data":"d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829"} Oct 30 23:38:03.529257 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:03.529122 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d6cc4759-qs8s6" event={"ID":"00b90c11-2400-4570-b184-c184e10fc984","Type":"ContainerDied","Data":"595eeb31123f2e7ae906e46a38c72562acca02e3313ee2f5e7c1ce133b67a766"} Oct 30 23:38:03.529257 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:03.529141 6174 scope.go:122] "RemoveContainer" containerID="d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829" Oct 30 23:38:03.537814 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:03.537647 6174 scope.go:122] "RemoveContainer" containerID="d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829" Oct 30 23:38:03.538062 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:38:03.537928 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829\": container with ID starting with d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829 not found: ID does not exist" containerID="d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829" Oct 30 23:38:03.538062 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:03.537961 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829"} err="failed to get container status \"d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829\": rpc error: code = NotFound desc = could not find container \"d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829\": container with ID starting with d174d9cf8770edda304b7732793f246bce91e7a24447aff85b5e74491e9a1829 not found: ID does not exist" Oct 30 23:38:03.577355 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:03.577330 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d6cc4759-qs8s6"] Oct 30 23:38:03.589035 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:03.589013 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75d6cc4759-qs8s6"] Oct 30 23:38:03.947801 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:38:03.947770 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="00b90c11-2400-4570-b184-c184e10fc984" path="/var/lib/kubelet/pods/00b90c11-2400-4570-b184-c184e10fc984/volumes" Oct 30 23:38:29.266625 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:38:29.266586 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:38:59.267534 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:38:59.267492 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:39:29.267544 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:39:29.267508 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:39:41.001989 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.001945 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7"] Oct 30 23:39:41.004490 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.002402 6174 cpu_manager.go:414] "containerMap: removing container" podUID="00b90c11-2400-4570-b184-c184e10fc984" containerName="console" Oct 30 23:39:41.004490 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.002420 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="00b90c11-2400-4570-b184-c184e10fc984" containerName="console" Oct 30 23:39:41.004490 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.002495 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="00b90c11-2400-4570-b184-c184e10fc984" containerName="console" Oct 30 23:39:41.005434 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.005415 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:41.032491 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.032469 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 30 23:39:41.032491 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.032470 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-wdl8c\"" Oct 30 23:39:41.032623 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.032525 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 30 23:39:41.036362 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.036343 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7"] Oct 30 23:39:41.149700 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.149672 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7\" (UID: \"f044a5e2-6190-4c03-8020-57d1760fa424\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:41.149854 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.149705 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7\" (UID: \"f044a5e2-6190-4c03-8020-57d1760fa424\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:41.149854 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.149724 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cllt9\" (UniqueName: \"kubernetes.io/projected/f044a5e2-6190-4c03-8020-57d1760fa424-kube-api-access-cllt9\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7\" (UID: \"f044a5e2-6190-4c03-8020-57d1760fa424\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:41.250846 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.250820 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7\" (UID: \"f044a5e2-6190-4c03-8020-57d1760fa424\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:41.250948 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.250854 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7\" (UID: \"f044a5e2-6190-4c03-8020-57d1760fa424\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:41.250948 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.250872 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cllt9\" (UniqueName: \"kubernetes.io/projected/f044a5e2-6190-4c03-8020-57d1760fa424-kube-api-access-cllt9\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7\" (UID: \"f044a5e2-6190-4c03-8020-57d1760fa424\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:41.251214 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.251193 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7\" (UID: \"f044a5e2-6190-4c03-8020-57d1760fa424\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:41.251300 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.251246 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7\" (UID: \"f044a5e2-6190-4c03-8020-57d1760fa424\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:41.274598 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.274539 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cllt9\" (UniqueName: \"kubernetes.io/projected/f044a5e2-6190-4c03-8020-57d1760fa424-kube-api-access-cllt9\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7\" (UID: \"f044a5e2-6190-4c03-8020-57d1760fa424\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:41.320108 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.320086 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:41.418058 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.418027 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g"] Oct 30 23:39:41.421382 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.421364 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.438238 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.438220 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Oct 30 23:39:41.439863 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.439845 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Oct 30 23:39:41.449587 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.449571 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Oct 30 23:39:41.449657 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.449590 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 23:39:41.449657 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.449601 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Oct 30 23:39:41.449657 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.449610 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 23:39:41.449657 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.449631 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7ghvr\"" Oct 30 23:39:41.457940 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.457921 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g"] Oct 30 23:39:41.552641 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.552619 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.552762 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.552651 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.552762 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.552682 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.552838 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.552769 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36482f51-dcd7-4e3c-a726-46564c8c3ea2-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.552838 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.552813 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4n7g\" (UniqueName: \"kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-kube-api-access-n4n7g\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.552903 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.552856 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.552945 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.552925 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.614345 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.614307 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7"] Oct 30 23:39:41.618541 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:39:41.618517 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf044a5e2_6190_4c03_8020_57d1760fa424.slice/crio-72a78c36cb093d9bde3a75ab44a5cb7f36f510f60ad3853c4f634d55f489de37 WatchSource:0}: Error finding container 72a78c36cb093d9bde3a75ab44a5cb7f36f510f60ad3853c4f634d55f489de37: Status 404 returned error can't find the container with id 72a78c36cb093d9bde3a75ab44a5cb7f36f510f60ad3853c4f634d55f489de37 Oct 30 23:39:41.653696 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.653674 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.653799 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.653703 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36482f51-dcd7-4e3c-a726-46564c8c3ea2-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.653799 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.653719 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4n7g\" (UniqueName: \"kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-kube-api-access-n4n7g\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.653799 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.653740 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.653934 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.653798 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.653934 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.653837 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.653934 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.653860 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.654494 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.654459 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.656050 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.656028 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.656135 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.656062 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36482f51-dcd7-4e3c-a726-46564c8c3ea2-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.656135 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.656087 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.656239 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.656203 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.675338 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.675310 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4n7g\" (UniqueName: \"kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-kube-api-access-n4n7g\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.675411 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.675318 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-48t7g\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.732292 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.732246 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:41.862477 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:41.862412 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" event={"ID":"f044a5e2-6190-4c03-8020-57d1760fa424","Type":"ContainerStarted","Data":"72a78c36cb093d9bde3a75ab44a5cb7f36f510f60ad3853c4f634d55f489de37"} Oct 30 23:39:42.042841 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:42.042807 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g"] Oct 30 23:39:42.048584 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:39:42.048555 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36482f51_dcd7_4e3c_a726_46564c8c3ea2.slice/crio-91d65439c3f4e3ff12b5be16553165bc1ac0ec5761e6ce4e9d12e134872a28e8 WatchSource:0}: Error finding container 91d65439c3f4e3ff12b5be16553165bc1ac0ec5761e6ce4e9d12e134872a28e8: Status 404 returned error can't find the container with id 91d65439c3f4e3ff12b5be16553165bc1ac0ec5761e6ce4e9d12e134872a28e8 Oct 30 23:39:42.870238 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:42.870169 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" event={"ID":"36482f51-dcd7-4e3c-a726-46564c8c3ea2","Type":"ContainerStarted","Data":"91d65439c3f4e3ff12b5be16553165bc1ac0ec5761e6ce4e9d12e134872a28e8"} Oct 30 23:39:44.862952 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:44.862895 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:39:44.863265 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:44.862985 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:39:45.885373 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:45.884856 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" event={"ID":"36482f51-dcd7-4e3c-a726-46564c8c3ea2","Type":"ContainerStarted","Data":"45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6"} Oct 30 23:39:45.885373 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:45.885031 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:45.886696 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:45.886667 6174 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-48t7g container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 23:39:45.886855 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:45.886727 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" podUID="36482f51-dcd7-4e3c-a726-46564c8c3ea2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 23:39:45.947633 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:45.947590 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" podStartSLOduration=2.136390513 podStartE2EDuration="4.947574972s" totalImagesPullingTime="2.811184459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:39:45.943074088 +0000 UTC m=+232.153660600" watchObservedRunningTime="2026-10-30 23:39:45.947574972 +0000 UTC m=+232.158161472" Oct 30 23:39:46.890379 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:46.890352 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:39:47.894705 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:47.894672 6174 generic.go:356] "Generic (PLEG): container finished" podID="f044a5e2-6190-4c03-8020-57d1760fa424" containerID="71f4ee385d4534b18d06c0a08f864ddb9ef2cd2370c450d10e0c08c27bf0bdd9" exitCode=0 Oct 30 23:39:47.895087 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:47.894755 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" event={"ID":"f044a5e2-6190-4c03-8020-57d1760fa424","Type":"ContainerDied","Data":"71f4ee385d4534b18d06c0a08f864ddb9ef2cd2370c450d10e0c08c27bf0bdd9"} Oct 30 23:39:49.904092 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:49.904030 6174 generic.go:356] "Generic (PLEG): container finished" podID="f044a5e2-6190-4c03-8020-57d1760fa424" containerID="3e10cfce03bc374515803ba8d14256db8f2f8f49e6db986fcc980f25b2ca82f5" exitCode=0 Oct 30 23:39:49.904402 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:49.904112 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" event={"ID":"f044a5e2-6190-4c03-8020-57d1760fa424","Type":"ContainerDied","Data":"3e10cfce03bc374515803ba8d14256db8f2f8f49e6db986fcc980f25b2ca82f5"} Oct 30 23:39:55.929381 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:55.929347 6174 generic.go:356] "Generic (PLEG): container finished" podID="f044a5e2-6190-4c03-8020-57d1760fa424" containerID="a2105c8223accba2243bd0f4b28b5249eb2a97de7c038e01a8f5fc0091035358" exitCode=0 Oct 30 23:39:55.929763 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:55.929440 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" event={"ID":"f044a5e2-6190-4c03-8020-57d1760fa424","Type":"ContainerDied","Data":"a2105c8223accba2243bd0f4b28b5249eb2a97de7c038e01a8f5fc0091035358"} Oct 30 23:39:57.055330 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.055290 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:57.078857 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.078833 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-bundle\" (UniqueName: \"kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-bundle\") pod \"f044a5e2-6190-4c03-8020-57d1760fa424\" (UID: \"f044a5e2-6190-4c03-8020-57d1760fa424\") " Oct 30 23:39:57.078959 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.078923 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f044a5e2-6190-4c03-8020-57d1760fa424-kube-api-access-cllt9\" (UniqueName: \"kubernetes.io/projected/f044a5e2-6190-4c03-8020-57d1760fa424-kube-api-access-cllt9\") pod \"f044a5e2-6190-4c03-8020-57d1760fa424\" (UID: \"f044a5e2-6190-4c03-8020-57d1760fa424\") " Oct 30 23:39:57.078959 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.078950 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-util\" (UniqueName: \"kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-util\") pod \"f044a5e2-6190-4c03-8020-57d1760fa424\" (UID: \"f044a5e2-6190-4c03-8020-57d1760fa424\") " Oct 30 23:39:57.079197 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.079172 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-bundle" pod "f044a5e2-6190-4c03-8020-57d1760fa424" (UID: "f044a5e2-6190-4c03-8020-57d1760fa424"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:39:57.080989 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.080964 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f044a5e2-6190-4c03-8020-57d1760fa424-kube-api-access-cllt9" pod "f044a5e2-6190-4c03-8020-57d1760fa424" (UID: "f044a5e2-6190-4c03-8020-57d1760fa424"). InnerVolumeSpecName "kube-api-access-cllt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:39:57.083169 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.083129 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-util" pod "f044a5e2-6190-4c03-8020-57d1760fa424" (UID: "f044a5e2-6190-4c03-8020-57d1760fa424"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:39:57.179801 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.179777 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cllt9\" (UniqueName: \"kubernetes.io/projected/f044a5e2-6190-4c03-8020-57d1760fa424-kube-api-access-cllt9\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:39:57.179801 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.179798 6174 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-util\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:39:57.179959 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.179809 6174 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f044a5e2-6190-4c03-8020-57d1760fa424-bundle\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:39:57.938499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.938468 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" Oct 30 23:39:57.938499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.938478 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644brhg7" event={"ID":"f044a5e2-6190-4c03-8020-57d1760fa424","Type":"ContainerDied","Data":"72a78c36cb093d9bde3a75ab44a5cb7f36f510f60ad3853c4f634d55f489de37"} Oct 30 23:39:57.938715 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:39:57.938526 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72a78c36cb093d9bde3a75ab44a5cb7f36f510f60ad3853c4f634d55f489de37" Oct 30 23:39:59.266410 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:39:59.266375 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:40:29.267541 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:40:29.267503 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:40:40.542358 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.542281 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t"] Oct 30 23:40:40.542733 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.542583 6174 cpu_manager.go:414] "containerMap: removing container" podUID="f044a5e2-6190-4c03-8020-57d1760fa424" containerName="extract" Oct 30 23:40:40.542733 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.542596 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f044a5e2-6190-4c03-8020-57d1760fa424" containerName="extract" Oct 30 23:40:40.542733 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.542615 6174 cpu_manager.go:414] "containerMap: removing container" podUID="f044a5e2-6190-4c03-8020-57d1760fa424" containerName="pull" Oct 30 23:40:40.542733 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.542622 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f044a5e2-6190-4c03-8020-57d1760fa424" containerName="pull" Oct 30 23:40:40.542733 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.542639 6174 cpu_manager.go:414] "containerMap: removing container" podUID="f044a5e2-6190-4c03-8020-57d1760fa424" containerName="util" Oct 30 23:40:40.542733 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.542644 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f044a5e2-6190-4c03-8020-57d1760fa424" containerName="util" Oct 30 23:40:40.542733 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.542687 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="f044a5e2-6190-4c03-8020-57d1760fa424" containerName="extract" Oct 30 23:40:40.545532 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.545516 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.585666 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.585626 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t"] Oct 30 23:40:40.619575 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.619552 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Oct 30 23:40:40.619575 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.619571 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Oct 30 23:40:40.619745 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.619672 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Oct 30 23:40:40.619745 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.619688 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Oct 30 23:40:40.619745 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.619729 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-c6nt4\"" Oct 30 23:40:40.620615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.620604 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Oct 30 23:40:40.702827 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.702795 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nllrf\" (UniqueName: \"kubernetes.io/projected/e3606a07-854e-45de-bb7f-6e60c1263478-kube-api-access-nllrf\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.702977 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.702845 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3606a07-854e-45de-bb7f-6e60c1263478-metrics-cert\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.702977 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.702905 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3606a07-854e-45de-bb7f-6e60c1263478-apiservice-cert\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.702977 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.702928 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3606a07-854e-45de-bb7f-6e60c1263478-webhook-cert\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.702977 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.702950 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3606a07-854e-45de-bb7f-6e60c1263478-tmp\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.702977 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.702969 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3606a07-854e-45de-bb7f-6e60c1263478-manifests\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.804091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.804023 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3606a07-854e-45de-bb7f-6e60c1263478-tmp\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.804091 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.804058 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3606a07-854e-45de-bb7f-6e60c1263478-manifests\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.804303 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.804104 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nllrf\" (UniqueName: \"kubernetes.io/projected/e3606a07-854e-45de-bb7f-6e60c1263478-kube-api-access-nllrf\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.804303 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.804134 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3606a07-854e-45de-bb7f-6e60c1263478-metrics-cert\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.804303 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.804149 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3606a07-854e-45de-bb7f-6e60c1263478-apiservice-cert\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.804303 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.804257 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3606a07-854e-45de-bb7f-6e60c1263478-webhook-cert\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.804540 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.804518 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3606a07-854e-45de-bb7f-6e60c1263478-manifests\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.806616 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.806590 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3606a07-854e-45de-bb7f-6e60c1263478-tmp\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.806616 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.806605 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3606a07-854e-45de-bb7f-6e60c1263478-apiservice-cert\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.806780 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.806678 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3606a07-854e-45de-bb7f-6e60c1263478-webhook-cert\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.806780 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.806758 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3606a07-854e-45de-bb7f-6e60c1263478-metrics-cert\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.838512 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.838483 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nllrf\" (UniqueName: \"kubernetes.io/projected/e3606a07-854e-45de-bb7f-6e60c1263478-kube-api-access-nllrf\") pod \"opendatahub-operator-controller-manager-776779f744-slh5t\" (UID: \"e3606a07-854e-45de-bb7f-6e60c1263478\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:40.859916 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:40.859899 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:41.249772 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:41.249686 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t"] Oct 30 23:40:41.253253 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:40:41.253225 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3606a07_854e_45de_bb7f_6e60c1263478.slice/crio-71cd43ee6c73cb6867ef9a5ff9aa91431125e9d449fb024e22adb7c4bcb63622 WatchSource:0}: Error finding container 71cd43ee6c73cb6867ef9a5ff9aa91431125e9d449fb024e22adb7c4bcb63622: Status 404 returned error can't find the container with id 71cd43ee6c73cb6867ef9a5ff9aa91431125e9d449fb024e22adb7c4bcb63622 Oct 30 23:40:42.088833 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:42.088788 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" event={"ID":"e3606a07-854e-45de-bb7f-6e60c1263478","Type":"ContainerStarted","Data":"71cd43ee6c73cb6867ef9a5ff9aa91431125e9d449fb024e22adb7c4bcb63622"} Oct 30 23:40:43.574269 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.574241 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-5jmbs"] Oct 30 23:40:43.578170 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.578136 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-5jmbs" Oct 30 23:40:43.607267 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.607247 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Oct 30 23:40:43.607398 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.607310 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Oct 30 23:40:43.607472 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.607427 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9xbq6\"" Oct 30 23:40:43.608483 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.608459 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-5jmbs"] Oct 30 23:40:43.730082 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.730048 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckpkk\" (UniqueName: \"kubernetes.io/projected/82094af2-8e11-4802-a21a-470ef0b2a1ac-kube-api-access-ckpkk\") pod \"cert-manager-597b95cb84-5jmbs\" (UID: \"82094af2-8e11-4802-a21a-470ef0b2a1ac\") " pod="cert-manager/cert-manager-597b95cb84-5jmbs" Oct 30 23:40:43.730082 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.730092 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82094af2-8e11-4802-a21a-470ef0b2a1ac-bound-sa-token\") pod \"cert-manager-597b95cb84-5jmbs\" (UID: \"82094af2-8e11-4802-a21a-470ef0b2a1ac\") " pod="cert-manager/cert-manager-597b95cb84-5jmbs" Oct 30 23:40:43.831390 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.831310 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82094af2-8e11-4802-a21a-470ef0b2a1ac-bound-sa-token\") pod \"cert-manager-597b95cb84-5jmbs\" (UID: \"82094af2-8e11-4802-a21a-470ef0b2a1ac\") " pod="cert-manager/cert-manager-597b95cb84-5jmbs" Oct 30 23:40:43.831568 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.831437 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckpkk\" (UniqueName: \"kubernetes.io/projected/82094af2-8e11-4802-a21a-470ef0b2a1ac-kube-api-access-ckpkk\") pod \"cert-manager-597b95cb84-5jmbs\" (UID: \"82094af2-8e11-4802-a21a-470ef0b2a1ac\") " pod="cert-manager/cert-manager-597b95cb84-5jmbs" Oct 30 23:40:43.850517 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.850493 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckpkk\" (UniqueName: \"kubernetes.io/projected/82094af2-8e11-4802-a21a-470ef0b2a1ac-kube-api-access-ckpkk\") pod \"cert-manager-597b95cb84-5jmbs\" (UID: \"82094af2-8e11-4802-a21a-470ef0b2a1ac\") " pod="cert-manager/cert-manager-597b95cb84-5jmbs" Oct 30 23:40:43.850727 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.850696 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82094af2-8e11-4802-a21a-470ef0b2a1ac-bound-sa-token\") pod \"cert-manager-597b95cb84-5jmbs\" (UID: \"82094af2-8e11-4802-a21a-470ef0b2a1ac\") " pod="cert-manager/cert-manager-597b95cb84-5jmbs" Oct 30 23:40:43.901887 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:43.901860 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-5jmbs" Oct 30 23:40:44.097519 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:44.097432 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" event={"ID":"e3606a07-854e-45de-bb7f-6e60c1263478","Type":"ContainerStarted","Data":"30401e9294d4bb1d2d2311665fea74c673fd6af1808d46ddc05a4ca84dbfb2ae"} Oct 30 23:40:44.217552 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:44.217519 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-5jmbs"] Oct 30 23:40:44.222536 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:40:44.222509 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82094af2_8e11_4802_a21a_470ef0b2a1ac.slice/crio-729ceac16f3f5852ce43e770521acc03cfce354b9fd5596f8476a2ada593881b WatchSource:0}: Error finding container 729ceac16f3f5852ce43e770521acc03cfce354b9fd5596f8476a2ada593881b: Status 404 returned error can't find the container with id 729ceac16f3f5852ce43e770521acc03cfce354b9fd5596f8476a2ada593881b Oct 30 23:40:45.106283 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:45.104804 6174 generic.go:356] "Generic (PLEG): container finished" podID="e3606a07-854e-45de-bb7f-6e60c1263478" containerID="30401e9294d4bb1d2d2311665fea74c673fd6af1808d46ddc05a4ca84dbfb2ae" exitCode=0 Oct 30 23:40:45.106283 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:45.105074 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" event={"ID":"e3606a07-854e-45de-bb7f-6e60c1263478","Type":"ContainerDied","Data":"30401e9294d4bb1d2d2311665fea74c673fd6af1808d46ddc05a4ca84dbfb2ae"} Oct 30 23:40:45.106750 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:45.106515 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-5jmbs" event={"ID":"82094af2-8e11-4802-a21a-470ef0b2a1ac","Type":"ContainerStarted","Data":"729ceac16f3f5852ce43e770521acc03cfce354b9fd5596f8476a2ada593881b"} Oct 30 23:40:46.113462 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:46.113426 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" event={"ID":"e3606a07-854e-45de-bb7f-6e60c1263478","Type":"ContainerStarted","Data":"29dee64893cac264c4c8b03b294e260168fa6c973e2996265c0b93a56e0a4ceb"} Oct 30 23:40:46.113935 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:46.113535 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:46.194267 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:46.194118 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" podStartSLOduration=2.6331674229999997 podStartE2EDuration="6.194098386s" totalImagesPullingTime="3.060482783s" totalInitContainerRuntime="500.44818ms" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:46.181635256 +0000 UTC m=+292.392221760" watchObservedRunningTime="2026-10-30 23:40:46.194098386 +0000 UTC m=+292.404684889" Oct 30 23:40:48.122565 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:48.122524 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-5jmbs" event={"ID":"82094af2-8e11-4802-a21a-470ef0b2a1ac","Type":"ContainerStarted","Data":"caeffc28638275eca07d5c100be156e86001b4a729715eab64db26f2265680a3"} Oct 30 23:40:48.160978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:48.160929 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-5jmbs" podStartSLOduration=2.101627757 podStartE2EDuration="5.160914737s" totalImagesPullingTime="3.05928698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:40:48.160400041 +0000 UTC m=+294.370986543" watchObservedRunningTime="2026-10-30 23:40:48.160914737 +0000 UTC m=+294.371501236" Oct 30 23:40:54.003026 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:54.002996 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:40:54.004051 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:54.004029 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:40:57.119112 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:40:57.119079 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-776779f744-slh5t" Oct 30 23:40:59.267956 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:40:59.267918 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:41:12.953981 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:12.953946 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-798f575fff-xvqvg"] Oct 30 23:41:12.957525 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:12.957495 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" Oct 30 23:41:12.985424 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:12.985393 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-798f575fff-xvqvg"] Oct 30 23:41:13.008850 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.008793 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Oct 30 23:41:13.009023 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.008843 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Oct 30 23:41:13.009090 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.008898 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8ckhq\"" Oct 30 23:41:13.052082 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.052055 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6021dc8a-cbd5-4915-bc65-fd5779f23087-tmp\") pod \"kube-auth-proxy-798f575fff-xvqvg\" (UID: \"6021dc8a-cbd5-4915-bc65-fd5779f23087\") " pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" Oct 30 23:41:13.052260 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.052096 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5xp4\" (UniqueName: \"kubernetes.io/projected/6021dc8a-cbd5-4915-bc65-fd5779f23087-kube-api-access-l5xp4\") pod \"kube-auth-proxy-798f575fff-xvqvg\" (UID: \"6021dc8a-cbd5-4915-bc65-fd5779f23087\") " pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" Oct 30 23:41:13.052260 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.052219 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6021dc8a-cbd5-4915-bc65-fd5779f23087-tls-certs\") pod \"kube-auth-proxy-798f575fff-xvqvg\" (UID: \"6021dc8a-cbd5-4915-bc65-fd5779f23087\") " pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" Oct 30 23:41:13.152757 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.152718 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6021dc8a-cbd5-4915-bc65-fd5779f23087-tmp\") pod \"kube-auth-proxy-798f575fff-xvqvg\" (UID: \"6021dc8a-cbd5-4915-bc65-fd5779f23087\") " pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" Oct 30 23:41:13.152953 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.152775 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5xp4\" (UniqueName: \"kubernetes.io/projected/6021dc8a-cbd5-4915-bc65-fd5779f23087-kube-api-access-l5xp4\") pod \"kube-auth-proxy-798f575fff-xvqvg\" (UID: \"6021dc8a-cbd5-4915-bc65-fd5779f23087\") " pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" Oct 30 23:41:13.152953 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.152816 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6021dc8a-cbd5-4915-bc65-fd5779f23087-tls-certs\") pod \"kube-auth-proxy-798f575fff-xvqvg\" (UID: \"6021dc8a-cbd5-4915-bc65-fd5779f23087\") " pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" Oct 30 23:41:13.154999 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.154965 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6021dc8a-cbd5-4915-bc65-fd5779f23087-tmp\") pod \"kube-auth-proxy-798f575fff-xvqvg\" (UID: \"6021dc8a-cbd5-4915-bc65-fd5779f23087\") " pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" Oct 30 23:41:13.155203 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.155179 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6021dc8a-cbd5-4915-bc65-fd5779f23087-tls-certs\") pod \"kube-auth-proxy-798f575fff-xvqvg\" (UID: \"6021dc8a-cbd5-4915-bc65-fd5779f23087\") " pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" Oct 30 23:41:13.171984 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.171955 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5xp4\" (UniqueName: \"kubernetes.io/projected/6021dc8a-cbd5-4915-bc65-fd5779f23087-kube-api-access-l5xp4\") pod \"kube-auth-proxy-798f575fff-xvqvg\" (UID: \"6021dc8a-cbd5-4915-bc65-fd5779f23087\") " pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" Oct 30 23:41:13.268572 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.268529 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" Oct 30 23:41:13.570376 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:13.570271 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-798f575fff-xvqvg"] Oct 30 23:41:13.574224 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:41:13.574191 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6021dc8a_cbd5_4915_bc65_fd5779f23087.slice/crio-a94de9961ff9c37bf711194e3494ed1f146ce8c97257bde1fd500e4effc2cdc5 WatchSource:0}: Error finding container a94de9961ff9c37bf711194e3494ed1f146ce8c97257bde1fd500e4effc2cdc5: Status 404 returned error can't find the container with id a94de9961ff9c37bf711194e3494ed1f146ce8c97257bde1fd500e4effc2cdc5 Oct 30 23:41:14.221821 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:14.221781 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" event={"ID":"6021dc8a-cbd5-4915-bc65-fd5779f23087","Type":"ContainerStarted","Data":"a94de9961ff9c37bf711194e3494ed1f146ce8c97257bde1fd500e4effc2cdc5"} Oct 30 23:41:16.231625 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:16.231595 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" event={"ID":"6021dc8a-cbd5-4915-bc65-fd5779f23087","Type":"ContainerStarted","Data":"bc0efefe936defb80482dd134d0531bc7d8a394e2864e4260311b91614b3c296"} Oct 30 23:41:16.270050 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:16.270007 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-798f575fff-xvqvg" podStartSLOduration=1.823150569 podStartE2EDuration="4.269993246s" totalImagesPullingTime="2.446842677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:41:16.269227118 +0000 UTC m=+322.479813618" watchObservedRunningTime="2026-10-30 23:41:16.269993246 +0000 UTC m=+322.480579744" Oct 30 23:41:20.430335 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.430304 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb"] Oct 30 23:41:20.433694 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.433674 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.451001 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.450977 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-f9b2h\"" Oct 30 23:41:20.463627 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.463603 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb"] Oct 30 23:41:20.470229 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.470207 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Oct 30 23:41:20.470394 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.470376 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Oct 30 23:41:20.494503 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.494477 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Oct 30 23:41:20.522842 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.522818 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47faafa4-be06-421d-ad43-72fa5db58157-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-rx9tb\" (UID: \"47faafa4-be06-421d-ad43-72fa5db58157\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.522930 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.522863 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47faafa4-be06-421d-ad43-72fa5db58157-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-rx9tb\" (UID: \"47faafa4-be06-421d-ad43-72fa5db58157\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.522969 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.522931 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47faafa4-be06-421d-ad43-72fa5db58157-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-rx9tb\" (UID: \"47faafa4-be06-421d-ad43-72fa5db58157\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.522969 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.522957 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg5pq\" (UniqueName: \"kubernetes.io/projected/47faafa4-be06-421d-ad43-72fa5db58157-kube-api-access-dg5pq\") pod \"kserve-module-controller-manager-7566cf5fc8-rx9tb\" (UID: \"47faafa4-be06-421d-ad43-72fa5db58157\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.624117 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.624091 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47faafa4-be06-421d-ad43-72fa5db58157-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-rx9tb\" (UID: \"47faafa4-be06-421d-ad43-72fa5db58157\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.624236 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.624123 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg5pq\" (UniqueName: \"kubernetes.io/projected/47faafa4-be06-421d-ad43-72fa5db58157-kube-api-access-dg5pq\") pod \"kserve-module-controller-manager-7566cf5fc8-rx9tb\" (UID: \"47faafa4-be06-421d-ad43-72fa5db58157\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.624236 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.624181 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47faafa4-be06-421d-ad43-72fa5db58157-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-rx9tb\" (UID: \"47faafa4-be06-421d-ad43-72fa5db58157\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.624318 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.624239 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47faafa4-be06-421d-ad43-72fa5db58157-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-rx9tb\" (UID: \"47faafa4-be06-421d-ad43-72fa5db58157\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.624662 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.624641 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47faafa4-be06-421d-ad43-72fa5db58157-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-rx9tb\" (UID: \"47faafa4-be06-421d-ad43-72fa5db58157\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.624662 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.624654 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47faafa4-be06-421d-ad43-72fa5db58157-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-rx9tb\" (UID: \"47faafa4-be06-421d-ad43-72fa5db58157\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.625038 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.625021 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47faafa4-be06-421d-ad43-72fa5db58157-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-rx9tb\" (UID: \"47faafa4-be06-421d-ad43-72fa5db58157\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.644852 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.644830 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg5pq\" (UniqueName: \"kubernetes.io/projected/47faafa4-be06-421d-ad43-72fa5db58157-kube-api-access-dg5pq\") pod \"kserve-module-controller-manager-7566cf5fc8-rx9tb\" (UID: \"47faafa4-be06-421d-ad43-72fa5db58157\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:20.745806 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:20.745733 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:21.055864 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:21.055699 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb"] Oct 30 23:41:21.060080 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:41:21.060051 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47faafa4_be06_421d_ad43_72fa5db58157.slice/crio-4fb65a1bdbda92b4d1f90f7e62a20b4755847041a9a09a2ca3cfe0b8ba81f8db WatchSource:0}: Error finding container 4fb65a1bdbda92b4d1f90f7e62a20b4755847041a9a09a2ca3cfe0b8ba81f8db: Status 404 returned error can't find the container with id 4fb65a1bdbda92b4d1f90f7e62a20b4755847041a9a09a2ca3cfe0b8ba81f8db Oct 30 23:41:21.252884 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:21.252852 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" event={"ID":"47faafa4-be06-421d-ad43-72fa5db58157","Type":"ContainerStarted","Data":"4fb65a1bdbda92b4d1f90f7e62a20b4755847041a9a09a2ca3cfe0b8ba81f8db"} Oct 30 23:41:21.505010 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:21.504935 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-kdtf6"] Oct 30 23:41:21.509445 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:21.509424 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-kdtf6" Oct 30 23:41:21.523633 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:21.523617 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gk475\"" Oct 30 23:41:21.526428 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:21.526413 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 30 23:41:21.526564 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:21.526546 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 30 23:41:21.527433 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:21.527417 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-kdtf6"] Oct 30 23:41:21.631503 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:21.631468 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52rx5\" (UniqueName: \"kubernetes.io/projected/3744d95e-78b7-49a3-8db4-7aedf4e41bd3-kube-api-access-52rx5\") pod \"authorino-57f7f8659f-kdtf6\" (UID: \"3744d95e-78b7-49a3-8db4-7aedf4e41bd3\") " pod="kuadrant-system/authorino-57f7f8659f-kdtf6" Oct 30 23:41:21.732250 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:21.732211 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52rx5\" (UniqueName: \"kubernetes.io/projected/3744d95e-78b7-49a3-8db4-7aedf4e41bd3-kube-api-access-52rx5\") pod \"authorino-57f7f8659f-kdtf6\" (UID: \"3744d95e-78b7-49a3-8db4-7aedf4e41bd3\") " pod="kuadrant-system/authorino-57f7f8659f-kdtf6" Oct 30 23:41:21.750946 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:21.750916 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52rx5\" (UniqueName: \"kubernetes.io/projected/3744d95e-78b7-49a3-8db4-7aedf4e41bd3-kube-api-access-52rx5\") pod \"authorino-57f7f8659f-kdtf6\" (UID: \"3744d95e-78b7-49a3-8db4-7aedf4e41bd3\") " pod="kuadrant-system/authorino-57f7f8659f-kdtf6" Oct 30 23:41:21.821559 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:21.821528 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-kdtf6" Oct 30 23:41:22.121392 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.121316 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-kdtf6"] Oct 30 23:41:22.127729 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:41:22.127690 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3744d95e_78b7_49a3_8db4_7aedf4e41bd3.slice/crio-8b4e004e1f4c4fecf8ba819d3387ba46cc37ebefb840e8cc2e4bb257b6222e06 WatchSource:0}: Error finding container 8b4e004e1f4c4fecf8ba819d3387ba46cc37ebefb840e8cc2e4bb257b6222e06: Status 404 returned error can't find the container with id 8b4e004e1f4c4fecf8ba819d3387ba46cc37ebefb840e8cc2e4bb257b6222e06 Oct 30 23:41:22.260623 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.259219 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:41:22.263868 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.263835 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-kdtf6" event={"ID":"3744d95e-78b7-49a3-8db4-7aedf4e41bd3","Type":"ContainerStarted","Data":"8b4e004e1f4c4fecf8ba819d3387ba46cc37ebefb840e8cc2e4bb257b6222e06"} Oct 30 23:41:22.264019 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.263915 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" Oct 30 23:41:22.285084 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.284491 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:41:22.285084 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.284623 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Oct 30 23:41:22.338249 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.338208 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v2rr\" (UniqueName: \"kubernetes.io/projected/f9ddefa2-c1ab-46cd-b2d3-e530e0138236-kube-api-access-5v2rr\") pod \"limitador-limitador-7c9b87d574-d52jw\" (UID: \"f9ddefa2-c1ab-46cd-b2d3-e530e0138236\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" Oct 30 23:41:22.338429 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.338262 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f9ddefa2-c1ab-46cd-b2d3-e530e0138236-config-file\") pod \"limitador-limitador-7c9b87d574-d52jw\" (UID: \"f9ddefa2-c1ab-46cd-b2d3-e530e0138236\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" Oct 30 23:41:22.338823 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.338796 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:41:22.381226 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.381138 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g7xw5\"" Oct 30 23:41:22.438789 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.438751 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v2rr\" (UniqueName: \"kubernetes.io/projected/f9ddefa2-c1ab-46cd-b2d3-e530e0138236-kube-api-access-5v2rr\") pod \"limitador-limitador-7c9b87d574-d52jw\" (UID: \"f9ddefa2-c1ab-46cd-b2d3-e530e0138236\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" Oct 30 23:41:22.438789 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.438789 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f9ddefa2-c1ab-46cd-b2d3-e530e0138236-config-file\") pod \"limitador-limitador-7c9b87d574-d52jw\" (UID: \"f9ddefa2-c1ab-46cd-b2d3-e530e0138236\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" Oct 30 23:41:22.439488 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.439463 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f9ddefa2-c1ab-46cd-b2d3-e530e0138236-config-file\") pod \"limitador-limitador-7c9b87d574-d52jw\" (UID: \"f9ddefa2-c1ab-46cd-b2d3-e530e0138236\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" Oct 30 23:41:22.457808 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.457775 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v2rr\" (UniqueName: \"kubernetes.io/projected/f9ddefa2-c1ab-46cd-b2d3-e530e0138236-kube-api-access-5v2rr\") pod \"limitador-limitador-7c9b87d574-d52jw\" (UID: \"f9ddefa2-c1ab-46cd-b2d3-e530e0138236\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" Oct 30 23:41:22.580445 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.580422 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" Oct 30 23:41:22.880925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:22.880890 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:41:22.886645 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:41:22.886606 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ddefa2_c1ab_46cd_b2d3_e530e0138236.slice/crio-713baca1a67c3ffd95d8cb9aa13479b6a6dc7a07e228a380b22d06da707065b5 WatchSource:0}: Error finding container 713baca1a67c3ffd95d8cb9aa13479b6a6dc7a07e228a380b22d06da707065b5: Status 404 returned error can't find the container with id 713baca1a67c3ffd95d8cb9aa13479b6a6dc7a07e228a380b22d06da707065b5 Oct 30 23:41:23.273105 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:23.273017 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" event={"ID":"47faafa4-be06-421d-ad43-72fa5db58157","Type":"ContainerStarted","Data":"9bc4f84941dd4b1d51838ed5acbb580611346e7e6735f3a29f4cff73546623d9"} Oct 30 23:41:23.273303 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:23.273137 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:23.274794 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:23.274754 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" event={"ID":"f9ddefa2-c1ab-46cd-b2d3-e530e0138236","Type":"ContainerStarted","Data":"713baca1a67c3ffd95d8cb9aa13479b6a6dc7a07e228a380b22d06da707065b5"} Oct 30 23:41:24.801854 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:24.801790 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" podStartSLOduration=3.303194883 podStartE2EDuration="4.801772382s" totalImagesPullingTime="1.498577499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:41:23.326353519 +0000 UTC m=+329.536940025" watchObservedRunningTime="2026-10-30 23:41:24.801772382 +0000 UTC m=+331.012358896" Oct 30 23:41:24.802323 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:24.802084 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-kdtf6"] Oct 30 23:41:25.286087 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:25.286055 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-kdtf6" event={"ID":"3744d95e-78b7-49a3-8db4-7aedf4e41bd3","Type":"ContainerStarted","Data":"9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970"} Oct 30 23:41:25.286274 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:25.286207 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-kdtf6" podUID="3744d95e-78b7-49a3-8db4-7aedf4e41bd3" containerName="authorino" containerID="cri-o://9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970" gracePeriod=30 Oct 30 23:41:25.322001 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:25.321958 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-kdtf6" podStartSLOduration=1.307599559 podStartE2EDuration="4.321944093s" totalImagesPullingTime="3.014344534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:41:25.321193285 +0000 UTC m=+331.531779788" watchObservedRunningTime="2026-10-30 23:41:25.321944093 +0000 UTC m=+331.532530588" Oct 30 23:41:25.594221 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:25.594196 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-kdtf6" Oct 30 23:41:25.671388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:25.671332 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3744d95e-78b7-49a3-8db4-7aedf4e41bd3-kube-api-access-52rx5\" (UniqueName: \"kubernetes.io/projected/3744d95e-78b7-49a3-8db4-7aedf4e41bd3-kube-api-access-52rx5\") pod \"3744d95e-78b7-49a3-8db4-7aedf4e41bd3\" (UID: \"3744d95e-78b7-49a3-8db4-7aedf4e41bd3\") " Oct 30 23:41:25.673270 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:25.673247 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3744d95e-78b7-49a3-8db4-7aedf4e41bd3-kube-api-access-52rx5" pod "3744d95e-78b7-49a3-8db4-7aedf4e41bd3" (UID: "3744d95e-78b7-49a3-8db4-7aedf4e41bd3"). InnerVolumeSpecName "kube-api-access-52rx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:41:25.772492 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:25.772461 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52rx5\" (UniqueName: \"kubernetes.io/projected/3744d95e-78b7-49a3-8db4-7aedf4e41bd3-kube-api-access-52rx5\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:41:26.291778 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:26.291743 6174 generic.go:356] "Generic (PLEG): container finished" podID="3744d95e-78b7-49a3-8db4-7aedf4e41bd3" containerID="9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970" exitCode=0 Oct 30 23:41:26.292312 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:26.291785 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-kdtf6" Oct 30 23:41:26.292312 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:26.291826 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-kdtf6" event={"ID":"3744d95e-78b7-49a3-8db4-7aedf4e41bd3","Type":"ContainerDied","Data":"9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970"} Oct 30 23:41:26.292312 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:26.291873 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-kdtf6" event={"ID":"3744d95e-78b7-49a3-8db4-7aedf4e41bd3","Type":"ContainerDied","Data":"8b4e004e1f4c4fecf8ba819d3387ba46cc37ebefb840e8cc2e4bb257b6222e06"} Oct 30 23:41:26.292312 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:26.291898 6174 scope.go:122] "RemoveContainer" containerID="9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970" Oct 30 23:41:26.293622 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:26.293572 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" event={"ID":"f9ddefa2-c1ab-46cd-b2d3-e530e0138236","Type":"ContainerStarted","Data":"6fb45be63153e65a14bbe8d7a3b0d5e1e6b0bb569b7e6f1bfaff48938e4b4f75"} Oct 30 23:41:26.293778 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:26.293737 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" Oct 30 23:41:26.300408 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:26.300390 6174 scope.go:122] "RemoveContainer" containerID="9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970" Oct 30 23:41:26.300699 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:41:26.300678 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970\": container with ID starting with 9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970 not found: ID does not exist" containerID="9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970" Oct 30 23:41:26.300761 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:26.300709 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970"} err="failed to get container status \"9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970\": rpc error: code = NotFound desc = could not find container \"9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970\": container with ID starting with 9d5c39c4a8b19311af160580985b0bd6cc40aa94ce147d60f737b1936a483970 not found: ID does not exist" Oct 30 23:41:26.345514 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:26.345475 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" podStartSLOduration=1.737686608 podStartE2EDuration="4.345463858s" totalImagesPullingTime="2.60777725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:41:26.345010663 +0000 UTC m=+332.555597165" watchObservedRunningTime="2026-10-30 23:41:26.345463858 +0000 UTC m=+332.556050361" Oct 30 23:41:26.379997 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:26.379976 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-kdtf6"] Oct 30 23:41:26.385763 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:26.385739 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-kdtf6"] Oct 30 23:41:27.949031 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:27.948996 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3744d95e-78b7-49a3-8db4-7aedf4e41bd3" path="/var/lib/kubelet/pods/3744d95e-78b7-49a3-8db4-7aedf4e41bd3/volumes" Oct 30 23:41:29.268417 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:41:29.268371 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:41:37.305342 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:37.305312 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-d52jw" Oct 30 23:41:44.281137 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:41:44.281103 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-rx9tb" Oct 30 23:41:59.268406 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:41:59.268360 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:42:14.250384 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.250355 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q"] Oct 30 23:42:14.250858 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.250712 6174 cpu_manager.go:414] "containerMap: removing container" podUID="3744d95e-78b7-49a3-8db4-7aedf4e41bd3" containerName="authorino" Oct 30 23:42:14.250858 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.250730 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3744d95e-78b7-49a3-8db4-7aedf4e41bd3" containerName="authorino" Oct 30 23:42:14.250858 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.250836 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="3744d95e-78b7-49a3-8db4-7aedf4e41bd3" containerName="authorino" Oct 30 23:42:14.256995 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.256974 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.303975 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.303947 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q"] Oct 30 23:42:14.375586 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.375555 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/00236c42-24f5-4c5f-b024-0c623076b037-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.375775 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.375593 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdxhg\" (UniqueName: \"kubernetes.io/projected/00236c42-24f5-4c5f-b024-0c623076b037-kube-api-access-vdxhg\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.375775 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.375623 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00236c42-24f5-4c5f-b024-0c623076b037-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.375891 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.375766 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/00236c42-24f5-4c5f-b024-0c623076b037-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.375891 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.375811 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/00236c42-24f5-4c5f-b024-0c623076b037-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.375891 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.375851 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/00236c42-24f5-4c5f-b024-0c623076b037-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.375995 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.375902 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/00236c42-24f5-4c5f-b024-0c623076b037-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.476693 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.476660 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/00236c42-24f5-4c5f-b024-0c623076b037-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.476839 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.476702 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/00236c42-24f5-4c5f-b024-0c623076b037-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.476839 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.476719 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdxhg\" (UniqueName: \"kubernetes.io/projected/00236c42-24f5-4c5f-b024-0c623076b037-kube-api-access-vdxhg\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.476839 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.476740 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00236c42-24f5-4c5f-b024-0c623076b037-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.476839 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.476786 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/00236c42-24f5-4c5f-b024-0c623076b037-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.476839 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.476818 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/00236c42-24f5-4c5f-b024-0c623076b037-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.477090 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.476850 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/00236c42-24f5-4c5f-b024-0c623076b037-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.477593 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.477564 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/00236c42-24f5-4c5f-b024-0c623076b037-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.479085 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.479060 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/00236c42-24f5-4c5f-b024-0c623076b037-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.479275 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.479117 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/00236c42-24f5-4c5f-b024-0c623076b037-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.479369 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.479353 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/00236c42-24f5-4c5f-b024-0c623076b037-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.479493 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.479476 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/00236c42-24f5-4c5f-b024-0c623076b037-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.503513 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.503459 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00236c42-24f5-4c5f-b024-0c623076b037-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.503963 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.503941 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdxhg\" (UniqueName: \"kubernetes.io/projected/00236c42-24f5-4c5f-b024-0c623076b037-kube-api-access-vdxhg\") pod \"istiod-openshift-gateway-7ddd9cfdc8-5rk8q\" (UID: \"00236c42-24f5-4c5f-b024-0c623076b037\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.568293 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.568271 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:14.898667 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.898609 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q"] Oct 30 23:42:14.904506 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.904469 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:42:14.904598 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:14.904532 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:42:15.497261 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:15.497227 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" event={"ID":"00236c42-24f5-4c5f-b024-0c623076b037","Type":"ContainerStarted","Data":"867b4cc72b7dd77c23c43a97cf8b86eccef9a4c992cb71fd434a5197e2c12a76"} Oct 30 23:42:15.497615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:15.497276 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" event={"ID":"00236c42-24f5-4c5f-b024-0c623076b037","Type":"ContainerStarted","Data":"8c9b99cf748828713c04b35e68df7b9059357f6dbf727debe064c5812727cfdd"} Oct 30 23:42:15.497615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:15.497467 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:15.499171 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:15.499140 6174 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-5rk8q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 23:42:15.499316 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:15.499208 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" podUID="00236c42-24f5-4c5f-b024-0c623076b037" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 23:42:15.564090 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:15.564020 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" podStartSLOduration=1.5639945480000002 podStartE2EDuration="1.563994548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:42:15.562652582 +0000 UTC m=+381.773239074" watchObservedRunningTime="2026-10-30 23:42:15.563994548 +0000 UTC m=+381.774581050" Oct 30 23:42:16.501593 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.501562 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-5rk8q" Oct 30 23:42:16.596392 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.596362 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g"] Oct 30 23:42:16.596853 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.596816 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" podUID="36482f51-dcd7-4e3c-a726-46564c8c3ea2" containerName="discovery" containerID="cri-o://45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6" gracePeriod=30 Oct 30 23:42:16.836528 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.836504 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:42:16.899323 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.899296 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-cacerts\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-cacerts\") pod \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " Oct 30 23:42:16.899479 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.899334 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-dns-cert\") pod \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " Oct 30 23:42:16.899479 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.899389 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-token\" (UniqueName: \"kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-token\") pod \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " Oct 30 23:42:16.899479 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.899432 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-kube-api-access-n4n7g\" (UniqueName: \"kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-kube-api-access-n4n7g\") pod \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " Oct 30 23:42:16.899479 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.899458 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-ca-configmap\") pod \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " Oct 30 23:42:16.899689 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.899514 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36482f51-dcd7-4e3c-a726-46564c8c3ea2-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36482f51-dcd7-4e3c-a726-46564c8c3ea2-local-certs\") pod \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " Oct 30 23:42:16.899689 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.899610 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-kubeconfig\") pod \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\" (UID: \"36482f51-dcd7-4e3c-a726-46564c8c3ea2\") " Oct 30 23:42:16.899917 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.899890 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-ca-configmap" pod "36482f51-dcd7-4e3c-a726-46564c8c3ea2" (UID: "36482f51-dcd7-4e3c-a726-46564c8c3ea2"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:42:16.902180 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.902133 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-kubeconfig" pod "36482f51-dcd7-4e3c-a726-46564c8c3ea2" (UID: "36482f51-dcd7-4e3c-a726-46564c8c3ea2"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:42:16.902311 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.902193 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-dns-cert" pod "36482f51-dcd7-4e3c-a726-46564c8c3ea2" (UID: "36482f51-dcd7-4e3c-a726-46564c8c3ea2"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:42:16.902311 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.902204 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-kube-api-access-n4n7g" pod "36482f51-dcd7-4e3c-a726-46564c8c3ea2" (UID: "36482f51-dcd7-4e3c-a726-46564c8c3ea2"). InnerVolumeSpecName "kube-api-access-n4n7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:42:16.902311 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.902255 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-cacerts" pod "36482f51-dcd7-4e3c-a726-46564c8c3ea2" (UID: "36482f51-dcd7-4e3c-a726-46564c8c3ea2"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:42:16.902477 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.902362 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-token" pod "36482f51-dcd7-4e3c-a726-46564c8c3ea2" (UID: "36482f51-dcd7-4e3c-a726-46564c8c3ea2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:42:16.903491 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:16.903461 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36482f51-dcd7-4e3c-a726-46564c8c3ea2-local-certs" pod "36482f51-dcd7-4e3c-a726-46564c8c3ea2" (UID: "36482f51-dcd7-4e3c-a726-46564c8c3ea2"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:42:17.000468 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.000432 6174 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-kubeconfig\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:42:17.000468 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.000463 6174 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-cacerts\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:42:17.000468 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.000473 6174 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-dns-cert\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:42:17.000687 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.000482 6174 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-token\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:42:17.000687 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.000491 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4n7g\" (UniqueName: \"kubernetes.io/projected/36482f51-dcd7-4e3c-a726-46564c8c3ea2-kube-api-access-n4n7g\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:42:17.000687 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.000500 6174 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36482f51-dcd7-4e3c-a726-46564c8c3ea2-istio-csr-ca-configmap\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:42:17.000687 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.000509 6174 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36482f51-dcd7-4e3c-a726-46564c8c3ea2-local-certs\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:42:17.506381 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.506337 6174 generic.go:356] "Generic (PLEG): container finished" podID="36482f51-dcd7-4e3c-a726-46564c8c3ea2" containerID="45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6" exitCode=0 Oct 30 23:42:17.506824 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.506409 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" Oct 30 23:42:17.506824 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.506425 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" event={"ID":"36482f51-dcd7-4e3c-a726-46564c8c3ea2","Type":"ContainerDied","Data":"45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6"} Oct 30 23:42:17.506824 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.506478 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g" event={"ID":"36482f51-dcd7-4e3c-a726-46564c8c3ea2","Type":"ContainerDied","Data":"91d65439c3f4e3ff12b5be16553165bc1ac0ec5761e6ce4e9d12e134872a28e8"} Oct 30 23:42:17.506824 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.506501 6174 scope.go:122] "RemoveContainer" containerID="45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6" Oct 30 23:42:17.515013 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.514996 6174 scope.go:122] "RemoveContainer" containerID="45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6" Oct 30 23:42:17.515329 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:42:17.515307 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6\": container with ID starting with 45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6 not found: ID does not exist" containerID="45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6" Oct 30 23:42:17.515429 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.515340 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6"} err="failed to get container status \"45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6\": rpc error: code = NotFound desc = could not find container \"45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6\": container with ID starting with 45611737e81aa65f9ae0654241648db57f27cf601311a649e1d1b748081066a6 not found: ID does not exist" Oct 30 23:42:17.568171 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.568056 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g"] Oct 30 23:42:17.579506 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.579480 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-48t7g"] Oct 30 23:42:17.949593 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:17.949561 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36482f51-dcd7-4e3c-a726-46564c8c3ea2" path="/var/lib/kubelet/pods/36482f51-dcd7-4e3c-a726-46564c8c3ea2/volumes" Oct 30 23:42:18.813313 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:18.813275 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Oct 30 23:42:18.813904 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:18.813785 6174 cpu_manager.go:414] "containerMap: removing container" podUID="36482f51-dcd7-4e3c-a726-46564c8c3ea2" containerName="discovery" Oct 30 23:42:18.813904 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:18.813806 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36482f51-dcd7-4e3c-a726-46564c8c3ea2" containerName="discovery" Oct 30 23:42:18.814017 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:18.813927 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="36482f51-dcd7-4e3c-a726-46564c8c3ea2" containerName="discovery" Oct 30 23:42:18.818366 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:18.818345 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Oct 30 23:42:18.844688 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:18.844667 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Oct 30 23:42:18.844688 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:18.844676 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Oct 30 23:42:18.844843 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:18.844738 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-nhqz8\"" Oct 30 23:42:18.844843 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:18.844747 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Oct 30 23:42:18.846177 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:18.846130 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Oct 30 23:42:18.917129 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:18.917092 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dhp6\" (UniqueName: \"kubernetes.io/projected/a5225e16-e65c-4e97-a7ff-764ed97be705-kube-api-access-9dhp6\") pod \"maas-keycloak-0\" (UID: \"a5225e16-e65c-4e97-a7ff-764ed97be705\") " pod="keycloak-system/maas-keycloak-0" Oct 30 23:42:19.017460 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:19.017431 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dhp6\" (UniqueName: \"kubernetes.io/projected/a5225e16-e65c-4e97-a7ff-764ed97be705-kube-api-access-9dhp6\") pod \"maas-keycloak-0\" (UID: \"a5225e16-e65c-4e97-a7ff-764ed97be705\") " pod="keycloak-system/maas-keycloak-0" Oct 30 23:42:19.040985 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:19.040953 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dhp6\" (UniqueName: \"kubernetes.io/projected/a5225e16-e65c-4e97-a7ff-764ed97be705-kube-api-access-9dhp6\") pod \"maas-keycloak-0\" (UID: \"a5225e16-e65c-4e97-a7ff-764ed97be705\") " pod="keycloak-system/maas-keycloak-0" Oct 30 23:42:19.129273 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:19.129205 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Oct 30 23:42:19.431952 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:19.431868 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Oct 30 23:42:19.436493 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:42:19.436457 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5225e16_e65c_4e97_a7ff_764ed97be705.slice/crio-3aa26d8b140adf360ef2baefc3ca40ec3923997be5d259ef3cd12dffb3de092c WatchSource:0}: Error finding container 3aa26d8b140adf360ef2baefc3ca40ec3923997be5d259ef3cd12dffb3de092c: Status 404 returned error can't find the container with id 3aa26d8b140adf360ef2baefc3ca40ec3923997be5d259ef3cd12dffb3de092c Oct 30 23:42:19.437963 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:19.437941 6174 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 23:42:19.517707 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:19.517681 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a5225e16-e65c-4e97-a7ff-764ed97be705","Type":"ContainerStarted","Data":"3aa26d8b140adf360ef2baefc3ca40ec3923997be5d259ef3cd12dffb3de092c"} Oct 30 23:42:24.546035 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:24.545989 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a5225e16-e65c-4e97-a7ff-764ed97be705","Type":"ContainerStarted","Data":"c85e36d527e52c001461df4b47bcc46064ada3c4dc18b01db4231c2ec81a0506"} Oct 30 23:42:24.595750 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:24.595697 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.997521081 podStartE2EDuration="6.595681304s" totalImagesPullingTime="4.598160223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:42:24.594515609 +0000 UTC m=+390.805102110" watchObservedRunningTime="2026-10-30 23:42:24.595681304 +0000 UTC m=+390.806267808" Oct 30 23:42:25.129767 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:25.129728 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Oct 30 23:42:25.131570 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:25.131532 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:26.130025 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:26.129972 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:27.129515 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:27.129474 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:28.129685 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:28.129634 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:29.129980 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:29.129939 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Oct 30 23:42:29.130508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:29.130258 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:29.287598 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:42:29.287559 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:42:30.135181 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:30.131598 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:31.130590 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:31.130547 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:32.130030 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:32.129980 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:33.129774 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:33.129723 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:34.130112 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:34.130066 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:35.130336 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:35.130290 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:36.129596 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:36.129548 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:37.129631 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:37.129583 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:38.130587 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:38.130536 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:39.130536 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:39.130446 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Oct 30 23:42:40.292787 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:40.292676 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Oct 30 23:42:40.308707 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:40.308460 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 23:42:50.299519 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:42:50.299488 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Oct 30 23:42:59.267779 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:42:59.267741 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:43:29.267206 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:43:29.267168 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:43:38.598674 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:38.598590 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:43:46.866804 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:46.866760 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-m7fd8"] Oct 30 23:43:46.870284 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:46.870262 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-m7fd8" Oct 30 23:43:46.891173 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:46.891128 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-m7fd8"] Oct 30 23:43:46.942231 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:46.942200 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gk475\"" Oct 30 23:43:46.942368 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:46.942241 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Oct 30 23:43:46.958966 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:46.958941 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/44fe74db-7d2d-4192-ae64-a2221f17d148-tls-cert\") pod \"authorino-6889cbd8c4-m7fd8\" (UID: \"44fe74db-7d2d-4192-ae64-a2221f17d148\") " pod="kuadrant-system/authorino-6889cbd8c4-m7fd8" Oct 30 23:43:46.959083 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:46.958989 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x25xb\" (UniqueName: \"kubernetes.io/projected/44fe74db-7d2d-4192-ae64-a2221f17d148-kube-api-access-x25xb\") pod \"authorino-6889cbd8c4-m7fd8\" (UID: \"44fe74db-7d2d-4192-ae64-a2221f17d148\") " pod="kuadrant-system/authorino-6889cbd8c4-m7fd8" Oct 30 23:43:46.998767 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:46.998744 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-m7fd8"] Oct 30 23:43:46.998947 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:43:46.998927 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-x25xb tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6889cbd8c4-m7fd8" podUID="44fe74db-7d2d-4192-ae64-a2221f17d148" Oct 30 23:43:47.060119 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:47.060087 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/44fe74db-7d2d-4192-ae64-a2221f17d148-tls-cert\") pod \"authorino-6889cbd8c4-m7fd8\" (UID: \"44fe74db-7d2d-4192-ae64-a2221f17d148\") " pod="kuadrant-system/authorino-6889cbd8c4-m7fd8" Oct 30 23:43:47.060289 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:47.060194 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x25xb\" (UniqueName: \"kubernetes.io/projected/44fe74db-7d2d-4192-ae64-a2221f17d148-kube-api-access-x25xb\") pod \"authorino-6889cbd8c4-m7fd8\" (UID: \"44fe74db-7d2d-4192-ae64-a2221f17d148\") " pod="kuadrant-system/authorino-6889cbd8c4-m7fd8" Oct 30 23:43:47.062659 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:47.062638 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/44fe74db-7d2d-4192-ae64-a2221f17d148-tls-cert\") pod \"authorino-6889cbd8c4-m7fd8\" (UID: \"44fe74db-7d2d-4192-ae64-a2221f17d148\") " pod="kuadrant-system/authorino-6889cbd8c4-m7fd8" Oct 30 23:43:47.087799 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:47.087770 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x25xb\" (UniqueName: \"kubernetes.io/projected/44fe74db-7d2d-4192-ae64-a2221f17d148-kube-api-access-x25xb\") pod \"authorino-6889cbd8c4-m7fd8\" (UID: \"44fe74db-7d2d-4192-ae64-a2221f17d148\") " pod="kuadrant-system/authorino-6889cbd8c4-m7fd8" Oct 30 23:43:47.919108 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:47.919070 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-m7fd8" Oct 30 23:43:47.925899 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:47.925877 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-m7fd8" Oct 30 23:43:48.069374 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:48.069341 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44fe74db-7d2d-4192-ae64-a2221f17d148-kube-api-access-x25xb\" (UniqueName: \"kubernetes.io/projected/44fe74db-7d2d-4192-ae64-a2221f17d148-kube-api-access-x25xb\") pod \"44fe74db-7d2d-4192-ae64-a2221f17d148\" (UID: \"44fe74db-7d2d-4192-ae64-a2221f17d148\") " Oct 30 23:43:48.069374 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:48.069378 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/44fe74db-7d2d-4192-ae64-a2221f17d148-tls-cert\" (UniqueName: \"kubernetes.io/secret/44fe74db-7d2d-4192-ae64-a2221f17d148-tls-cert\") pod \"44fe74db-7d2d-4192-ae64-a2221f17d148\" (UID: \"44fe74db-7d2d-4192-ae64-a2221f17d148\") " Oct 30 23:43:48.071390 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:48.071363 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44fe74db-7d2d-4192-ae64-a2221f17d148-tls-cert" pod "44fe74db-7d2d-4192-ae64-a2221f17d148" (UID: "44fe74db-7d2d-4192-ae64-a2221f17d148"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:43:48.071485 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:48.071412 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44fe74db-7d2d-4192-ae64-a2221f17d148-kube-api-access-x25xb" pod "44fe74db-7d2d-4192-ae64-a2221f17d148" (UID: "44fe74db-7d2d-4192-ae64-a2221f17d148"). InnerVolumeSpecName "kube-api-access-x25xb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:43:48.170117 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:48.170041 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x25xb\" (UniqueName: \"kubernetes.io/projected/44fe74db-7d2d-4192-ae64-a2221f17d148-kube-api-access-x25xb\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:43:48.170117 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:48.170069 6174 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/44fe74db-7d2d-4192-ae64-a2221f17d148-tls-cert\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:43:48.923084 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:48.923056 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-m7fd8" Oct 30 23:43:49.008243 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:49.008217 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-m7fd8"] Oct 30 23:43:49.011753 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:49.011722 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-m7fd8"] Oct 30 23:43:49.948766 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:49.948732 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="44fe74db-7d2d-4192-ae64-a2221f17d148" path="/var/lib/kubelet/pods/44fe74db-7d2d-4192-ae64-a2221f17d148/volumes" Oct 30 23:43:49.994446 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:49.994416 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Oct 30 23:43:49.994680 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:49.994649 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" containerID="cri-o://c85e36d527e52c001461df4b47bcc46064ada3c4dc18b01db4231c2ec81a0506" gracePeriod=30 Oct 30 23:43:50.296768 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:50.296723 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 23:43:51.937414 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:51.937379 6174 generic.go:356] "Generic (PLEG): container finished" podID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerID="c85e36d527e52c001461df4b47bcc46064ada3c4dc18b01db4231c2ec81a0506" exitCode=143 Oct 30 23:43:51.937794 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:51.937439 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a5225e16-e65c-4e97-a7ff-764ed97be705","Type":"ContainerDied","Data":"c85e36d527e52c001461df4b47bcc46064ada3c4dc18b01db4231c2ec81a0506"} Oct 30 23:43:52.025983 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:52.025959 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Oct 30 23:43:52.202738 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:52.202654 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a5225e16-e65c-4e97-a7ff-764ed97be705-kube-api-access-9dhp6\" (UniqueName: \"kubernetes.io/projected/a5225e16-e65c-4e97-a7ff-764ed97be705-kube-api-access-9dhp6\") pod \"a5225e16-e65c-4e97-a7ff-764ed97be705\" (UID: \"a5225e16-e65c-4e97-a7ff-764ed97be705\") " Oct 30 23:43:52.204654 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:52.204630 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5225e16-e65c-4e97-a7ff-764ed97be705-kube-api-access-9dhp6" pod "a5225e16-e65c-4e97-a7ff-764ed97be705" (UID: "a5225e16-e65c-4e97-a7ff-764ed97be705"). InnerVolumeSpecName "kube-api-access-9dhp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:43:52.304191 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:52.304149 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dhp6\" (UniqueName: \"kubernetes.io/projected/a5225e16-e65c-4e97-a7ff-764ed97be705-kube-api-access-9dhp6\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:43:52.942493 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:52.942463 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Oct 30 23:43:52.942493 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:52.942485 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a5225e16-e65c-4e97-a7ff-764ed97be705","Type":"ContainerDied","Data":"3aa26d8b140adf360ef2baefc3ca40ec3923997be5d259ef3cd12dffb3de092c"} Oct 30 23:43:52.943134 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:52.942548 6174 scope.go:122] "RemoveContainer" containerID="c85e36d527e52c001461df4b47bcc46064ada3c4dc18b01db4231c2ec81a0506" Oct 30 23:43:52.993083 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:52.993055 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Oct 30 23:43:53.004848 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.004816 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Oct 30 23:43:53.023573 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.023543 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Oct 30 23:43:53.023880 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.023864 6174 cpu_manager.go:414] "containerMap: removing container" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" Oct 30 23:43:53.023880 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.023880 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" Oct 30 23:43:53.024065 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.023975 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" containerName="keycloak" Oct 30 23:43:53.030306 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.030286 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Oct 30 23:43:53.044829 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.044810 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-nhqz8\"" Oct 30 23:43:53.045119 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.045106 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Oct 30 23:43:53.047606 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.047589 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Oct 30 23:43:53.049522 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.049500 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Oct 30 23:43:53.146280 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.146252 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Oct 30 23:43:53.146280 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.146278 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Oct 30 23:43:53.210978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.210910 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7bgw\" (UniqueName: \"kubernetes.io/projected/b738d9e9-9abc-4a3b-bf90-50f3074482f7-kube-api-access-g7bgw\") pod \"maas-keycloak-0\" (UID: \"b738d9e9-9abc-4a3b-bf90-50f3074482f7\") " pod="keycloak-system/maas-keycloak-0" Oct 30 23:43:53.210978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.210967 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b738d9e9-9abc-4a3b-bf90-50f3074482f7-test-realms\") pod \"maas-keycloak-0\" (UID: \"b738d9e9-9abc-4a3b-bf90-50f3074482f7\") " pod="keycloak-system/maas-keycloak-0" Oct 30 23:43:53.311537 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.311503 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b738d9e9-9abc-4a3b-bf90-50f3074482f7-test-realms\") pod \"maas-keycloak-0\" (UID: \"b738d9e9-9abc-4a3b-bf90-50f3074482f7\") " pod="keycloak-system/maas-keycloak-0" Oct 30 23:43:53.311698 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.311574 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7bgw\" (UniqueName: \"kubernetes.io/projected/b738d9e9-9abc-4a3b-bf90-50f3074482f7-kube-api-access-g7bgw\") pod \"maas-keycloak-0\" (UID: \"b738d9e9-9abc-4a3b-bf90-50f3074482f7\") " pod="keycloak-system/maas-keycloak-0" Oct 30 23:43:53.312272 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.312251 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b738d9e9-9abc-4a3b-bf90-50f3074482f7-test-realms\") pod \"maas-keycloak-0\" (UID: \"b738d9e9-9abc-4a3b-bf90-50f3074482f7\") " pod="keycloak-system/maas-keycloak-0" Oct 30 23:43:53.331939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.331918 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7bgw\" (UniqueName: \"kubernetes.io/projected/b738d9e9-9abc-4a3b-bf90-50f3074482f7-kube-api-access-g7bgw\") pod \"maas-keycloak-0\" (UID: \"b738d9e9-9abc-4a3b-bf90-50f3074482f7\") " pod="keycloak-system/maas-keycloak-0" Oct 30 23:43:53.341338 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.341320 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Oct 30 23:43:53.638425 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.638212 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Oct 30 23:43:53.642311 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:43:53.642284 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb738d9e9_9abc_4a3b_bf90_50f3074482f7.slice/crio-34c31f1343db233b23718dfb3509740c665fbcc446b4089cbf746ab30bdd5e53 WatchSource:0}: Error finding container 34c31f1343db233b23718dfb3509740c665fbcc446b4089cbf746ab30bdd5e53: Status 404 returned error can't find the container with id 34c31f1343db233b23718dfb3509740c665fbcc446b4089cbf746ab30bdd5e53 Oct 30 23:43:53.924357 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.924333 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Oct 30 23:43:53.949061 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.949030 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a5225e16-e65c-4e97-a7ff-764ed97be705" path="/var/lib/kubelet/pods/a5225e16-e65c-4e97-a7ff-764ed97be705/volumes" Oct 30 23:43:53.949631 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:53.949604 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b738d9e9-9abc-4a3b-bf90-50f3074482f7","Type":"ContainerStarted","Data":"34c31f1343db233b23718dfb3509740c665fbcc446b4089cbf746ab30bdd5e53"} Oct 30 23:43:54.956369 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:54.956333 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b738d9e9-9abc-4a3b-bf90-50f3074482f7","Type":"ContainerStarted","Data":"5848bf92c92912d2976d8242e74f947f53428cd44437e755b2e3722028e7961b"} Oct 30 23:43:55.000226 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:55.000146 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.732965821 podStartE2EDuration="2.000126943s" totalImagesPullingTime="267.161122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:43:54.999020586 +0000 UTC m=+481.209607088" watchObservedRunningTime="2026-10-30 23:43:55.000126943 +0000 UTC m=+481.210713446" Oct 30 23:43:55.342397 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:55.342351 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Oct 30 23:43:55.344407 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:55.344366 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:43:56.341956 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:56.341903 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:43:57.342144 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:57.342093 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:43:58.342590 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:58.342546 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:43:59.276856 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:43:59.276813 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:43:59.342559 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:43:59.342512 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:44:00.342605 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:00.342557 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:44:01.345625 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:01.345582 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:44:02.342423 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:02.342376 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:44:03.341718 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:03.341677 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Oct 30 23:44:03.342238 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:03.341989 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:44:04.341933 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:04.341888 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:44:05.342427 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:05.342377 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:44:06.342490 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:06.342443 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:44:07.344832 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:07.343614 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:44:08.342338 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:08.342283 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:44:09.342768 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:09.342711 6174 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.30:9000/health/started\": dial tcp 10.133.0.30:9000: connect: connection refused" Oct 30 23:44:10.491769 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:10.491727 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Oct 30 23:44:10.508707 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:10.508652 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b738d9e9-9abc-4a3b-bf90-50f3074482f7" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 23:44:20.497827 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:44:20.497794 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Oct 30 23:44:29.267081 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:44:29.267043 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:44:59.267908 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:44:59.267873 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:45:02.543283 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:02.543247 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-g2n6t"] Oct 30 23:45:02.546644 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:02.546623 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" Oct 30 23:45:02.572466 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:02.572444 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Oct 30 23:45:02.572466 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:02.572462 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xp5g5\"" Oct 30 23:45:02.574246 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:02.574223 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-g2n6t"] Oct 30 23:45:02.632838 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:02.632811 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbk9k\" (UniqueName: \"kubernetes.io/projected/61853f99-ead8-4955-b488-70176727c22f-kube-api-access-qbk9k\") pod \"payload-processing-5f78687d5b-g2n6t\" (UID: \"61853f99-ead8-4955-b488-70176727c22f\") " pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" Oct 30 23:45:02.633010 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:02.632862 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61853f99-ead8-4955-b488-70176727c22f-plugins-config-volume\") pod \"payload-processing-5f78687d5b-g2n6t\" (UID: \"61853f99-ead8-4955-b488-70176727c22f\") " pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" Oct 30 23:45:02.734119 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:02.734056 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61853f99-ead8-4955-b488-70176727c22f-plugins-config-volume\") pod \"payload-processing-5f78687d5b-g2n6t\" (UID: \"61853f99-ead8-4955-b488-70176727c22f\") " pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" Oct 30 23:45:02.734287 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:02.734192 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbk9k\" (UniqueName: \"kubernetes.io/projected/61853f99-ead8-4955-b488-70176727c22f-kube-api-access-qbk9k\") pod \"payload-processing-5f78687d5b-g2n6t\" (UID: \"61853f99-ead8-4955-b488-70176727c22f\") " pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" Oct 30 23:45:02.734800 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:02.734782 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61853f99-ead8-4955-b488-70176727c22f-plugins-config-volume\") pod \"payload-processing-5f78687d5b-g2n6t\" (UID: \"61853f99-ead8-4955-b488-70176727c22f\") " pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" Oct 30 23:45:02.753486 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:02.753463 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbk9k\" (UniqueName: \"kubernetes.io/projected/61853f99-ead8-4955-b488-70176727c22f-kube-api-access-qbk9k\") pod \"payload-processing-5f78687d5b-g2n6t\" (UID: \"61853f99-ead8-4955-b488-70176727c22f\") " pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" Oct 30 23:45:02.859044 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:02.858982 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" Oct 30 23:45:03.153514 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:03.153405 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-g2n6t"] Oct 30 23:45:03.157430 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:45:03.157402 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61853f99_ead8_4955_b488_70176727c22f.slice/crio-81152e4988fafab30ab67be038808df28a47080906b15c81ba45aee75ca0b71e WatchSource:0}: Error finding container 81152e4988fafab30ab67be038808df28a47080906b15c81ba45aee75ca0b71e: Status 404 returned error can't find the container with id 81152e4988fafab30ab67be038808df28a47080906b15c81ba45aee75ca0b71e Oct 30 23:45:03.268040 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:03.268012 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" event={"ID":"61853f99-ead8-4955-b488-70176727c22f","Type":"ContainerStarted","Data":"81152e4988fafab30ab67be038808df28a47080906b15c81ba45aee75ca0b71e"} Oct 30 23:45:05.278063 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:05.278034 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" event={"ID":"61853f99-ead8-4955-b488-70176727c22f","Type":"ContainerStarted","Data":"341bbb916b56b187281e4fb8b5dae7ab039da74a80908b49d1141638c652f463"} Oct 30 23:45:05.278470 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:05.278109 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" Oct 30 23:45:05.317978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:05.317907 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" podStartSLOduration=1.397065501 podStartE2EDuration="3.317890894s" totalImagesPullingTime="1.920825393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:05.316855937 +0000 UTC m=+551.527442437" watchObservedRunningTime="2026-10-30 23:45:05.317890894 +0000 UTC m=+551.528477414" Oct 30 23:45:14.913538 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:14.913505 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n"] Oct 30 23:45:14.917380 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:14.917352 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:14.968475 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:14.968446 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-consumer-portal-auth-proxy-tls\"" Oct 30 23:45:14.968627 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:14.968459 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-consumer-portal-auth-proxy-creds\"" Oct 30 23:45:14.969076 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:14.969054 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-consumer-portal-auth-proxy-dockercfg-qgk98\"" Oct 30 23:45:14.969320 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:14.969300 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"odh-trusted-ca-bundle\"" Oct 30 23:45:14.970258 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:14.970238 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n"] Oct 30 23:45:14.971001 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:14.970983 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:45:15.036473 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:15.036443 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8879af5d-1f13-4772-b12d-7670aaaf8573-trusted-ca\") pod \"maas-consumer-portal-auth-proxy-658b9c897-xbs4n\" (UID: \"8879af5d-1f13-4772-b12d-7670aaaf8573\") " pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:15.036610 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:15.036488 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8879af5d-1f13-4772-b12d-7670aaaf8573-tmp\") pod \"maas-consumer-portal-auth-proxy-658b9c897-xbs4n\" (UID: \"8879af5d-1f13-4772-b12d-7670aaaf8573\") " pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:15.036746 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:15.036722 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8879af5d-1f13-4772-b12d-7670aaaf8573-tls\") pod \"maas-consumer-portal-auth-proxy-658b9c897-xbs4n\" (UID: \"8879af5d-1f13-4772-b12d-7670aaaf8573\") " pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:15.137424 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:15.137388 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8879af5d-1f13-4772-b12d-7670aaaf8573-trusted-ca\") pod \"maas-consumer-portal-auth-proxy-658b9c897-xbs4n\" (UID: \"8879af5d-1f13-4772-b12d-7670aaaf8573\") " pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:15.137424 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:15.137426 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8879af5d-1f13-4772-b12d-7670aaaf8573-tmp\") pod \"maas-consumer-portal-auth-proxy-658b9c897-xbs4n\" (UID: \"8879af5d-1f13-4772-b12d-7670aaaf8573\") " pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:15.137661 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:15.137500 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8879af5d-1f13-4772-b12d-7670aaaf8573-tls\") pod \"maas-consumer-portal-auth-proxy-658b9c897-xbs4n\" (UID: \"8879af5d-1f13-4772-b12d-7670aaaf8573\") " pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:15.138267 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:15.138243 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8879af5d-1f13-4772-b12d-7670aaaf8573-trusted-ca\") pod \"maas-consumer-portal-auth-proxy-658b9c897-xbs4n\" (UID: \"8879af5d-1f13-4772-b12d-7670aaaf8573\") " pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:15.139768 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:15.139737 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8879af5d-1f13-4772-b12d-7670aaaf8573-tmp\") pod \"maas-consumer-portal-auth-proxy-658b9c897-xbs4n\" (UID: \"8879af5d-1f13-4772-b12d-7670aaaf8573\") " pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:15.139914 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:15.139899 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8879af5d-1f13-4772-b12d-7670aaaf8573-tls\") pod \"maas-consumer-portal-auth-proxy-658b9c897-xbs4n\" (UID: \"8879af5d-1f13-4772-b12d-7670aaaf8573\") " pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:15.229522 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:15.229450 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:15.532673 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:15.532511 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n"] Oct 30 23:45:15.536759 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:45:15.536731 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8879af5d_1f13_4772_b12d_7670aaaf8573.slice/crio-c71b2d1cec0dd0b3ba29fcc65ae0394567003f3804e7aeeea11d6c16485b932e WatchSource:0}: Error finding container c71b2d1cec0dd0b3ba29fcc65ae0394567003f3804e7aeeea11d6c16485b932e: Status 404 returned error can't find the container with id c71b2d1cec0dd0b3ba29fcc65ae0394567003f3804e7aeeea11d6c16485b932e Oct 30 23:45:16.286107 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:16.285789 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5f78687d5b-g2n6t" Oct 30 23:45:16.328692 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:16.328656 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" event={"ID":"8879af5d-1f13-4772-b12d-7670aaaf8573","Type":"ContainerStarted","Data":"c71b2d1cec0dd0b3ba29fcc65ae0394567003f3804e7aeeea11d6c16485b932e"} Oct 30 23:45:17.338659 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:17.338619 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:45:18.339303 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:18.339272 6174 generic.go:356] "Generic (PLEG): container finished" podID="8879af5d-1f13-4772-b12d-7670aaaf8573" containerID="d90cf8760857439cf8c664dd24df01d72e6ad5ca93e526beabe53838255846e1" exitCode=1 Oct 30 23:45:18.339685 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:18.339342 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" event={"ID":"8879af5d-1f13-4772-b12d-7670aaaf8573","Type":"ContainerDied","Data":"d90cf8760857439cf8c664dd24df01d72e6ad5ca93e526beabe53838255846e1"} Oct 30 23:45:18.339685 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:18.339576 6174 scope.go:122] "RemoveContainer" containerID="d90cf8760857439cf8c664dd24df01d72e6ad5ca93e526beabe53838255846e1" Oct 30 23:45:19.345626 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:19.345593 6174 generic.go:356] "Generic (PLEG): container finished" podID="8879af5d-1f13-4772-b12d-7670aaaf8573" containerID="83d6a61d111c0fac0ec105cabb1999ca7e186cff0230edd53eea63175d5e05c8" exitCode=1 Oct 30 23:45:19.346099 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:19.345662 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" event={"ID":"8879af5d-1f13-4772-b12d-7670aaaf8573","Type":"ContainerDied","Data":"83d6a61d111c0fac0ec105cabb1999ca7e186cff0230edd53eea63175d5e05c8"} Oct 30 23:45:19.346099 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:19.345707 6174 scope.go:122] "RemoveContainer" containerID="d90cf8760857439cf8c664dd24df01d72e6ad5ca93e526beabe53838255846e1" Oct 30 23:45:19.346099 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:19.345924 6174 scope.go:122] "RemoveContainer" containerID="83d6a61d111c0fac0ec105cabb1999ca7e186cff0230edd53eea63175d5e05c8" Oct 30 23:45:19.346285 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:45:19.346189 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:45:20.351758 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:20.351727 6174 scope.go:122] "RemoveContainer" containerID="83d6a61d111c0fac0ec105cabb1999ca7e186cff0230edd53eea63175d5e05c8" Oct 30 23:45:20.352138 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:45:20.351916 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:45:25.230248 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:25.230214 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:25.230639 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:25.230273 6174 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:25.230639 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:25.230557 6174 scope.go:122] "RemoveContainer" containerID="83d6a61d111c0fac0ec105cabb1999ca7e186cff0230edd53eea63175d5e05c8" Oct 30 23:45:25.230745 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:45:25.230717 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:45:28.943750 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:28.943718 6174 scope.go:122] "RemoveContainer" containerID="83d6a61d111c0fac0ec105cabb1999ca7e186cff0230edd53eea63175d5e05c8" Oct 30 23:45:29.267594 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:45:29.267510 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:45:29.390551 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:29.390520 6174 generic.go:356] "Generic (PLEG): container finished" podID="8879af5d-1f13-4772-b12d-7670aaaf8573" containerID="ea3344ad5f1deeded71577f3b65f93f66ac63bf79a79164e13f208ecf45152c5" exitCode=1 Oct 30 23:45:29.390767 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:29.390596 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" event={"ID":"8879af5d-1f13-4772-b12d-7670aaaf8573","Type":"ContainerDied","Data":"ea3344ad5f1deeded71577f3b65f93f66ac63bf79a79164e13f208ecf45152c5"} Oct 30 23:45:29.390767 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:29.390663 6174 scope.go:122] "RemoveContainer" containerID="83d6a61d111c0fac0ec105cabb1999ca7e186cff0230edd53eea63175d5e05c8" Oct 30 23:45:29.391030 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:29.391013 6174 scope.go:122] "RemoveContainer" containerID="ea3344ad5f1deeded71577f3b65f93f66ac63bf79a79164e13f208ecf45152c5" Oct 30 23:45:29.391258 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:45:29.391231 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:45:35.229992 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:35.229958 6174 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:35.230488 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:35.230014 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:45:35.230488 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:35.230299 6174 scope.go:122] "RemoveContainer" containerID="ea3344ad5f1deeded71577f3b65f93f66ac63bf79a79164e13f208ecf45152c5" Oct 30 23:45:35.230488 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:45:35.230468 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:45:35.417233 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:35.417211 6174 scope.go:122] "RemoveContainer" containerID="ea3344ad5f1deeded71577f3b65f93f66ac63bf79a79164e13f208ecf45152c5" Oct 30 23:45:35.417406 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:45:35.417387 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:45:48.665685 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:48.665649 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:45:50.226841 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.226801 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw"] Oct 30 23:45:50.234700 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.234674 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.260455 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.260429 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Oct 30 23:45:50.260455 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.260450 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nhgkf\"" Oct 30 23:45:50.260672 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.260515 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Oct 30 23:45:50.260672 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.260575 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Oct 30 23:45:50.261717 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.261696 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw"] Oct 30 23:45:50.327981 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.327944 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qthn\" (UniqueName: \"kubernetes.io/projected/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-kube-api-access-7qthn\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.327981 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.327983 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.328275 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.328005 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.328275 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.328124 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.328275 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.328221 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.328407 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.328291 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.428884 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.428854 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.429052 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.428908 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qthn\" (UniqueName: \"kubernetes.io/projected/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-kube-api-access-7qthn\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.429052 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.428939 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.429052 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.428964 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.429052 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.428995 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.429299 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.429115 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.429378 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.429353 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.429434 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.429377 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.429535 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.429519 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.431297 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.431274 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.431566 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.431546 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.447301 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.447280 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qthn\" (UniqueName: \"kubernetes.io/projected/94b8d0fe-9a44-4a77-8b04-96cb32d7e693-kube-api-access-7qthn\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-znckw\" (UID: \"94b8d0fe-9a44-4a77-8b04-96cb32d7e693\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.547888 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.547856 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:50.847469 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:50.847389 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw"] Oct 30 23:45:51.484621 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.484590 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" event={"ID":"94b8d0fe-9a44-4a77-8b04-96cb32d7e693","Type":"ContainerStarted","Data":"df3f8764381eb6f328401a94e20b4266d7fe001e5283c31f63133cbeb24affa2"} Oct 30 23:45:51.599792 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.599750 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:45:51.678931 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.678896 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb"] Oct 30 23:45:51.682879 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.682857 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.704677 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.704340 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb"] Oct 30 23:45:51.710641 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.710619 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Oct 30 23:45:51.737497 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.737410 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.737497 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.737449 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.737497 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.737474 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvpvq\" (UniqueName: \"kubernetes.io/projected/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-kube-api-access-vvpvq\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.737706 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.737556 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.737706 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.737583 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.737706 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.737618 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.838032 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.837998 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.838032 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.838039 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.838308 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.838059 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvpvq\" (UniqueName: \"kubernetes.io/projected/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-kube-api-access-vvpvq\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.838308 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.838089 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.838308 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.838112 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.838308 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.838143 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.838522 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.838391 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.838522 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.838460 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.838591 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.838523 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.840303 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.840278 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.840558 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.840541 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.856981 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.856949 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvpvq\" (UniqueName: \"kubernetes.io/projected/e50bf50b-d08f-4d61-bb8b-eb6c9691a56e-kube-api-access-vvpvq\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-h55jb\" (UID: \"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:51.997969 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:51.997898 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:52.295460 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:52.295427 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb"] Oct 30 23:45:52.300004 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:45:52.299971 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50bf50b_d08f_4d61_bb8b_eb6c9691a56e.slice/crio-25a7b12f922e0e6cfc23652c91f89ad4ef3e0cdfa3fd6078ad9c768f663dcd40 WatchSource:0}: Error finding container 25a7b12f922e0e6cfc23652c91f89ad4ef3e0cdfa3fd6078ad9c768f663dcd40: Status 404 returned error can't find the container with id 25a7b12f922e0e6cfc23652c91f89ad4ef3e0cdfa3fd6078ad9c768f663dcd40 Oct 30 23:45:52.489890 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:52.489817 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" event={"ID":"94b8d0fe-9a44-4a77-8b04-96cb32d7e693","Type":"ContainerStarted","Data":"257f3ea86214d3f36d91d5f7d52c5992e4aced02bcf40957e10d27c9f6f8c3d7"} Oct 30 23:45:52.491059 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:52.491036 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" event={"ID":"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e","Type":"ContainerStarted","Data":"25a7b12f922e0e6cfc23652c91f89ad4ef3e0cdfa3fd6078ad9c768f663dcd40"} Oct 30 23:45:52.528905 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:52.528862 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" podStartSLOduration=1.5076586509999998 podStartE2EDuration="2.528848571s" totalImagesPullingTime="1.02118992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:52.528331889 +0000 UTC m=+598.738918392" watchObservedRunningTime="2026-10-30 23:45:52.528848571 +0000 UTC m=+598.739435072" Oct 30 23:45:52.548617 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:52.548567 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:45:53.497463 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.497427 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" event={"ID":"e50bf50b-d08f-4d61-bb8b-eb6c9691a56e","Type":"ContainerStarted","Data":"4796560e9ddb5f1e73fdcdf7efa6e60e796e2344790851943936533cdda75a34"} Oct 30 23:45:53.526495 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.526466 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75"] Oct 30 23:45:53.531004 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.530977 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.540871 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.540825 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" podStartSLOduration=2.358240728 podStartE2EDuration="2.540807695s" totalImagesPullingTime="182.566967ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:53.537914431 +0000 UTC m=+599.748500946" watchObservedRunningTime="2026-10-30 23:45:53.540807695 +0000 UTC m=+599.751394198" Oct 30 23:45:53.546795 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.546773 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Oct 30 23:45:53.554634 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.554612 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75"] Oct 30 23:45:53.650098 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.650062 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e32aceb9-09d5-4eb7-a7dd-e4303654db59-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.650305 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.650114 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e32aceb9-09d5-4eb7-a7dd-e4303654db59-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.650305 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.650195 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts44r\" (UniqueName: \"kubernetes.io/projected/e32aceb9-09d5-4eb7-a7dd-e4303654db59-kube-api-access-ts44r\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.650432 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.650362 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e32aceb9-09d5-4eb7-a7dd-e4303654db59-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.650432 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.650390 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e32aceb9-09d5-4eb7-a7dd-e4303654db59-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.650540 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.650518 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e32aceb9-09d5-4eb7-a7dd-e4303654db59-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.751554 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.751458 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts44r\" (UniqueName: \"kubernetes.io/projected/e32aceb9-09d5-4eb7-a7dd-e4303654db59-kube-api-access-ts44r\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.751554 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.751541 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e32aceb9-09d5-4eb7-a7dd-e4303654db59-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.751799 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.751569 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e32aceb9-09d5-4eb7-a7dd-e4303654db59-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.751799 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.751597 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e32aceb9-09d5-4eb7-a7dd-e4303654db59-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.751799 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.751663 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e32aceb9-09d5-4eb7-a7dd-e4303654db59-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.751799 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.751699 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e32aceb9-09d5-4eb7-a7dd-e4303654db59-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.752095 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.752069 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e32aceb9-09d5-4eb7-a7dd-e4303654db59-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.752095 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.752085 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e32aceb9-09d5-4eb7-a7dd-e4303654db59-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.752203 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.752137 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e32aceb9-09d5-4eb7-a7dd-e4303654db59-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.753901 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.753872 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e32aceb9-09d5-4eb7-a7dd-e4303654db59-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.754377 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.754357 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e32aceb9-09d5-4eb7-a7dd-e4303654db59-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.770542 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.770519 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts44r\" (UniqueName: \"kubernetes.io/projected/e32aceb9-09d5-4eb7-a7dd-e4303654db59-kube-api-access-ts44r\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-x6m75\" (UID: \"e32aceb9-09d5-4eb7-a7dd-e4303654db59\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.849094 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.849064 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:53.998143 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:53.998115 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:45:54.029716 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:54.029644 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:45:54.031699 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:54.031678 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:45:54.147549 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:54.147484 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75"] Oct 30 23:45:54.151958 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:45:54.151933 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode32aceb9_09d5_4eb7_a7dd_e4303654db59.slice/crio-3619a01c555df6baa09bf335e7e4a05d7b800d0d2ea17c8952e1511f3b531bba WatchSource:0}: Error finding container 3619a01c555df6baa09bf335e7e4a05d7b800d0d2ea17c8952e1511f3b531bba: Status 404 returned error can't find the container with id 3619a01c555df6baa09bf335e7e4a05d7b800d0d2ea17c8952e1511f3b531bba Oct 30 23:45:54.503257 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:54.503208 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" event={"ID":"e32aceb9-09d5-4eb7-a7dd-e4303654db59","Type":"ContainerStarted","Data":"124e7f8b0591e60ad4b2a212dbf8bdc221ec211e906b3b7be22849ff82a74e76"} Oct 30 23:45:54.503694 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:54.503275 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" event={"ID":"e32aceb9-09d5-4eb7-a7dd-e4303654db59","Type":"ContainerStarted","Data":"3619a01c555df6baa09bf335e7e4a05d7b800d0d2ea17c8952e1511f3b531bba"} Oct 30 23:45:54.547584 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:54.547541 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" podStartSLOduration=1.364253339 podStartE2EDuration="1.547529494s" totalImagesPullingTime="183.276155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:54.544450306 +0000 UTC m=+600.755036806" watchObservedRunningTime="2026-10-30 23:45:54.547529494 +0000 UTC m=+600.758115994" Oct 30 23:45:54.849488 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:54.849462 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:45:54.944016 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:54.943993 6174 scope.go:122] "RemoveContainer" containerID="ea3344ad5f1deeded71577f3b65f93f66ac63bf79a79164e13f208ecf45152c5" Oct 30 23:45:55.509472 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:55.509441 6174 generic.go:356] "Generic (PLEG): container finished" podID="8879af5d-1f13-4772-b12d-7670aaaf8573" containerID="5f343cb3932324e5541d269e9147d7d37cc08f0516610f23160bf1424d9c4e25" exitCode=1 Oct 30 23:45:55.509874 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:55.509508 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" event={"ID":"8879af5d-1f13-4772-b12d-7670aaaf8573","Type":"ContainerDied","Data":"5f343cb3932324e5541d269e9147d7d37cc08f0516610f23160bf1424d9c4e25"} Oct 30 23:45:55.509874 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:55.509587 6174 scope.go:122] "RemoveContainer" containerID="ea3344ad5f1deeded71577f3b65f93f66ac63bf79a79164e13f208ecf45152c5" Oct 30 23:45:55.510017 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:55.509997 6174 scope.go:122] "RemoveContainer" containerID="5f343cb3932324e5541d269e9147d7d37cc08f0516610f23160bf1424d9c4e25" Oct 30 23:45:55.510221 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:45:55.510199 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:45:56.524440 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:56.524410 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:45:58.250466 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.250436 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz"] Oct 30 23:45:58.255288 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.255263 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.270584 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.270566 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Oct 30 23:45:58.283196 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.283171 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz"] Oct 30 23:45:58.286277 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.286255 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.286371 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.286292 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.286446 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.286427 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.286505 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.286488 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72gdv\" (UniqueName: \"kubernetes.io/projected/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-kube-api-access-72gdv\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.286561 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.286520 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.286561 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.286549 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.387249 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.387213 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.387401 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.387260 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72gdv\" (UniqueName: \"kubernetes.io/projected/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-kube-api-access-72gdv\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.387401 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.387278 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.387401 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.387293 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.387401 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.387318 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.387401 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.387349 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.387690 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.387672 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.387748 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.387723 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.387801 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.387751 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.389552 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.389534 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.389830 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.389812 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.406479 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.406454 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72gdv\" (UniqueName: \"kubernetes.io/projected/c0c7ac6e-b8e8-4398-82db-350d262ffd8d-kube-api-access-72gdv\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz\" (UID: \"c0c7ac6e-b8e8-4398-82db-350d262ffd8d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.568674 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.568650 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:58.862934 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:58.862829 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz"] Oct 30 23:45:58.867119 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:45:58.867086 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c7ac6e_b8e8_4398_82db_350d262ffd8d.slice/crio-4c10f9f2908c0fbad9f927b636c1fc3dc613c0308684b3c73156a3f875340b4e WatchSource:0}: Error finding container 4c10f9f2908c0fbad9f927b636c1fc3dc613c0308684b3c73156a3f875340b4e: Status 404 returned error can't find the container with id 4c10f9f2908c0fbad9f927b636c1fc3dc613c0308684b3c73156a3f875340b4e Oct 30 23:45:59.267869 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:45:59.267787 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:45:59.533574 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:59.533496 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" event={"ID":"c0c7ac6e-b8e8-4398-82db-350d262ffd8d","Type":"ContainerStarted","Data":"3fe1266fbda95cb62cbbf05804ef290a1d12741f534e269be26022a0479bc837"} Oct 30 23:45:59.533574 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:59.533549 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" event={"ID":"c0c7ac6e-b8e8-4398-82db-350d262ffd8d","Type":"ContainerStarted","Data":"4c10f9f2908c0fbad9f927b636c1fc3dc613c0308684b3c73156a3f875340b4e"} Oct 30 23:45:59.569782 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:59.569763 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:45:59.572428 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:45:59.572392 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" podStartSLOduration=1.394860859 podStartE2EDuration="1.572380803s" totalImagesPullingTime="177.519944ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:45:59.571407373 +0000 UTC m=+605.781993873" watchObservedRunningTime="2026-10-30 23:45:59.572380803 +0000 UTC m=+605.782967298" Oct 30 23:46:00.548224 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:00.548188 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:46:00.560736 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:00.560710 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:46:01.553774 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:01.553738 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-znckw" Oct 30 23:46:01.998104 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:01.998025 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:46:02.010422 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:02.010401 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:46:02.562230 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:02.562200 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-h55jb" Oct 30 23:46:03.428404 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:03.428363 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:46:03.849200 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:03.849146 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:46:03.861887 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:03.861860 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:46:04.566579 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:04.566553 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-x6m75" Oct 30 23:46:05.230127 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:05.230094 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:46:05.230624 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:05.230174 6174 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:46:05.230624 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:05.230565 6174 scope.go:122] "RemoveContainer" containerID="5f343cb3932324e5541d269e9147d7d37cc08f0516610f23160bf1424d9c4e25" Oct 30 23:46:05.230820 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:46:05.230796 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:46:08.568960 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:08.568928 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:46:08.581251 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:08.581229 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:46:08.592076 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:08.592058 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz" Oct 30 23:46:17.878492 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.878458 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz"] Oct 30 23:46:17.882105 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.882077 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:17.912098 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.912068 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz"] Oct 30 23:46:17.950916 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.950886 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:17.951071 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.950921 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:17.951071 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.950946 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:17.951071 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.951025 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-664ht\" (UniqueName: \"kubernetes.io/projected/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-kube-api-access-664ht\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:17.951071 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.951066 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:17.951270 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.951142 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:17.951270 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.951209 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:17.951344 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.951277 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:17.951344 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.951331 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:17.987996 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:17.987973 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9g9s6\"" Oct 30 23:46:18.051731 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.051706 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.051731 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.051738 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.051933 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.051771 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.051933 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.051910 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.052041 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.051966 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.052041 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.052002 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.052473 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.052045 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.052473 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.052072 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-664ht\" (UniqueName: \"kubernetes.io/projected/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-kube-api-access-664ht\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.052473 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.052100 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.052473 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.052125 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.052473 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.052384 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.052705 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.052505 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.052751 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.052723 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.053384 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.053362 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.054553 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.054529 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.055364 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.055342 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.075574 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.075538 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.075741 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.075722 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-664ht\" (UniqueName: \"kubernetes.io/projected/d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1-kube-api-access-664ht\") pod \"maas-default-gateway-openshift-default-7f5667f86c-bdfdz\" (UID: \"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.197664 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.197585 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:18.526783 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.526693 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz"] Oct 30 23:46:18.531031 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:46:18.531001 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f03d25_3b68_4cc8_9475_0a8eab9ba3b1.slice/crio-09e4ea132b775d099bde87252b64c871d95fc39e00d40b765b931c06730ef7c2 WatchSource:0}: Error finding container 09e4ea132b775d099bde87252b64c871d95fc39e00d40b765b931c06730ef7c2: Status 404 returned error can't find the container with id 09e4ea132b775d099bde87252b64c871d95fc39e00d40b765b931c06730ef7c2 Oct 30 23:46:18.619842 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:18.619811 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" event={"ID":"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1","Type":"ContainerStarted","Data":"09e4ea132b775d099bde87252b64c871d95fc39e00d40b765b931c06730ef7c2"} Oct 30 23:46:21.261544 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:21.261509 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:46:21.261845 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:21.261577 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:46:21.261845 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:21.261607 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:46:21.636463 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:21.636420 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" event={"ID":"d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1","Type":"ContainerStarted","Data":"075ff7b2088c6bc3638d387231db649992324b46eeeec338ec58bdb28077c3a7"} Oct 30 23:46:22.198147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:22.198102 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:22.199639 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:22.199611 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bdfdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 23:46:22.199794 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:22.199659 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" podUID="d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 23:46:23.198921 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:23.198887 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bdfdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 23:46:23.199348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:23.198955 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" podUID="d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 23:46:24.198737 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:24.198697 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bdfdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 23:46:24.198927 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:24.198757 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" podUID="d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 23:46:25.198151 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:25.198114 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bdfdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 23:46:25.198544 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:25.198200 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" podUID="d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 23:46:26.197927 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:26.197888 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bdfdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 23:46:26.198081 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:26.197959 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" podUID="d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 23:46:27.198145 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:27.198111 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bdfdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 23:46:27.198555 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:27.198182 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" podUID="d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 23:46:28.198780 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:28.198738 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bdfdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 23:46:28.199197 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:28.198800 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" podUID="d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 23:46:29.269010 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:46:29.268969 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:46:29.480010 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:29.479976 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:29.480433 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:29.480414 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:29.481214 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:29.481192 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" Oct 30 23:46:29.520962 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:29.520883 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" podStartSLOduration=9.793197756 podStartE2EDuration="12.520870551s" totalImagesPullingTime="2.727672795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:21.707494815 +0000 UTC m=+627.918081317" watchObservedRunningTime="2026-10-30 23:46:29.520870551 +0000 UTC m=+635.731457119" Oct 30 23:46:32.910628 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:32.910544 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk"] Oct 30 23:46:32.916409 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:32.916388 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:32.946549 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:32.946520 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk"] Oct 30 23:46:32.986986 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:32.986956 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:32.987126 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:32.986990 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:32.987126 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:32.987019 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:32.987259 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:32.987134 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:32.987259 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:32.987204 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:32.987259 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:32.987227 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bxgt\" (UniqueName: \"kubernetes.io/projected/3c1dad76-6b81-41d5-8a73-04b9a6818ece-kube-api-access-2bxgt\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:32.987259 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:32.987255 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:32.987382 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:32.987313 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:32.987382 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:32.987357 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.088264 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.088233 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.088264 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.088262 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.088446 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.088277 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bxgt\" (UniqueName: \"kubernetes.io/projected/3c1dad76-6b81-41d5-8a73-04b9a6818ece-kube-api-access-2bxgt\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.088446 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.088358 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.088446 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.088400 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.088601 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.088487 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.088665 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.088595 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.088665 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.088629 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.088665 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.088654 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.088818 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.088668 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.088818 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.088765 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.088946 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.088926 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.089018 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.089001 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.089350 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.089329 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.090683 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.090662 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.091075 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.091055 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.106890 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.106866 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c1dad76-6b81-41d5-8a73-04b9a6818ece-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.107022 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.107006 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bxgt\" (UniqueName: \"kubernetes.io/projected/3c1dad76-6b81-41d5-8a73-04b9a6818ece-kube-api-access-2bxgt\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hrcgk\" (UID: \"3c1dad76-6b81-41d5-8a73-04b9a6818ece\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.229510 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.229447 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:33.545641 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.542815 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk"] Oct 30 23:46:33.550988 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:46:33.550959 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1dad76_6b81_41d5_8a73_04b9a6818ece.slice/crio-c7d3c3aae00e26de826fe484eca7d70cd6c66afa6179354674e4d737c153811b WatchSource:0}: Error finding container c7d3c3aae00e26de826fe484eca7d70cd6c66afa6179354674e4d737c153811b: Status 404 returned error can't find the container with id c7d3c3aae00e26de826fe484eca7d70cd6c66afa6179354674e4d737c153811b Oct 30 23:46:33.553410 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.553371 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:46:33.553487 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.553454 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:46:33.553525 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.553491 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:46:33.720254 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.720220 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" event={"ID":"3c1dad76-6b81-41d5-8a73-04b9a6818ece","Type":"ContainerStarted","Data":"82cd083e4902c0c90a5628540f3155e2e90107c2a9512a0dabf179cd379975a2"} Oct 30 23:46:33.720415 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.720277 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" event={"ID":"3c1dad76-6b81-41d5-8a73-04b9a6818ece","Type":"ContainerStarted","Data":"c7d3c3aae00e26de826fe484eca7d70cd6c66afa6179354674e4d737c153811b"} Oct 30 23:46:33.764060 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:33.764011 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" podStartSLOduration=1.7639986680000002 podStartE2EDuration="1.763998668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:46:33.76301615 +0000 UTC m=+639.973602687" watchObservedRunningTime="2026-10-30 23:46:33.763998668 +0000 UTC m=+639.974585169" Oct 30 23:46:34.230555 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:34.230525 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:34.231963 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:34.231938 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hrcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 23:46:34.232083 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:34.231984 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" podUID="3c1dad76-6b81-41d5-8a73-04b9a6818ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 23:46:35.230243 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:35.230207 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hrcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 23:46:35.230420 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:35.230264 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" podUID="3c1dad76-6b81-41d5-8a73-04b9a6818ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 23:46:36.230388 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:36.230351 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hrcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 23:46:36.230790 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:36.230404 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" podUID="3c1dad76-6b81-41d5-8a73-04b9a6818ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 23:46:37.230524 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:37.230489 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hrcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 23:46:37.230910 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:37.230545 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" podUID="3c1dad76-6b81-41d5-8a73-04b9a6818ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 23:46:38.230685 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:38.230648 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hrcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 23:46:38.231083 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:38.230701 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" podUID="3c1dad76-6b81-41d5-8a73-04b9a6818ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 23:46:39.230222 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:39.230189 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hrcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 23:46:39.230391 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:39.230254 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" podUID="3c1dad76-6b81-41d5-8a73-04b9a6818ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 23:46:40.230209 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:40.230178 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hrcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 23:46:40.230664 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:40.230239 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" podUID="3c1dad76-6b81-41d5-8a73-04b9a6818ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 23:46:41.780110 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:41.780078 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:41.780595 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:41.780544 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:41.781413 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:41.781392 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" Oct 30 23:46:47.742583 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:47.742553 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:46:47.949859 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:47.949823 6174 scope.go:122] "RemoveContainer" containerID="5f343cb3932324e5541d269e9147d7d37cc08f0516610f23160bf1424d9c4e25" Oct 30 23:46:48.790704 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:48.790671 6174 generic.go:356] "Generic (PLEG): container finished" podID="8879af5d-1f13-4772-b12d-7670aaaf8573" containerID="fb7aa16d2fc32992ecceab4036c134fd54d5dad9d8029baf9e952fa238f7c21a" exitCode=1 Oct 30 23:46:48.791110 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:48.790751 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" event={"ID":"8879af5d-1f13-4772-b12d-7670aaaf8573","Type":"ContainerDied","Data":"fb7aa16d2fc32992ecceab4036c134fd54d5dad9d8029baf9e952fa238f7c21a"} Oct 30 23:46:48.791110 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:48.790802 6174 scope.go:122] "RemoveContainer" containerID="5f343cb3932324e5541d269e9147d7d37cc08f0516610f23160bf1424d9c4e25" Oct 30 23:46:48.791255 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:48.791209 6174 scope.go:122] "RemoveContainer" containerID="fb7aa16d2fc32992ecceab4036c134fd54d5dad9d8029baf9e952fa238f7c21a" Oct 30 23:46:48.791515 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:46:48.791488 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:46:54.400587 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:54.400554 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:46:55.229830 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:55.229779 6174 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:46:55.230047 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:55.229875 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:46:55.230229 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:46:55.230212 6174 scope.go:122] "RemoveContainer" containerID="fb7aa16d2fc32992ecceab4036c134fd54d5dad9d8029baf9e952fa238f7c21a" Oct 30 23:46:55.230432 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:46:55.230409 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:46:59.267646 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:46:59.267609 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:47:02.993620 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:02.993582 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7"] Oct 30 23:47:03.001799 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.001776 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.006176 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.006127 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5"] Oct 30 23:47:03.011397 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.011375 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.023016 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.022996 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7"] Oct 30 23:47:03.036332 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.036304 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5"] Oct 30 23:47:03.156834 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.156802 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.157026 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.156847 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.157026 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.156871 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.157026 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.156934 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7kpf\" (UniqueName: \"kubernetes.io/projected/6864b0d8-cf9b-4045-a1fb-cfba56df7059-kube-api-access-m7kpf\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.157026 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.156974 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.157276 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157029 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2h9d\" (UniqueName: \"kubernetes.io/projected/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-kube-api-access-h2h9d\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.157276 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157056 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.157276 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157075 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.157276 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157113 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.157276 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157211 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.157490 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157274 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.157490 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157304 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.157490 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157388 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.157490 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157412 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.157661 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157528 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.157661 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157556 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.157661 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157583 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.157661 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.157621 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.258329 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258252 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.258329 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258286 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.258329 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258304 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.258598 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258415 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.258598 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258562 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.258716 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258608 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.258716 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258641 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.258716 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258668 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.258716 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258678 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7kpf\" (UniqueName: \"kubernetes.io/projected/6864b0d8-cf9b-4045-a1fb-cfba56df7059-kube-api-access-m7kpf\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.258716 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258704 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.258978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258731 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2h9d\" (UniqueName: \"kubernetes.io/projected/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-kube-api-access-h2h9d\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.258978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258745 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.258978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258768 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.258978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258796 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.258978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258815 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.258978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258820 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.258978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258874 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.258978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258877 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istio-data\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.258978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258909 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.258978 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258936 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.259571 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.258988 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.259571 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.259031 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.259571 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.259253 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.259571 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.259259 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-workload-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.259571 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.259398 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-workload-certs\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.259571 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.259428 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.259908 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.259604 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-credential-socket\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.259908 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.259785 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.260825 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.260798 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.260929 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.260862 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.261544 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.261522 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.261544 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.261532 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.279671 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.279646 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.279816 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.279798 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6864b0d8-cf9b-4045-a1fb-cfba56df7059-istio-token\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.279958 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.279936 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7kpf\" (UniqueName: \"kubernetes.io/projected/6864b0d8-cf9b-4045-a1fb-cfba56df7059-kube-api-access-m7kpf\") pod \"maas-default-gateway-openshift-default-7f5667f86c-hcml7\" (UID: \"6864b0d8-cf9b-4045-a1fb-cfba56df7059\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.280068 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.280051 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2h9d\" (UniqueName: \"kubernetes.io/projected/d7f71b68-2967-4c7b-b81c-3f576fa2eeeb-kube-api-access-h2h9d\") pod \"maas-default-gateway-openshift-default-7f5667f86c-t7kc5\" (UID: \"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.314906 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.314882 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:03.323614 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.323597 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:03.642710 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.642684 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7"] Oct 30 23:47:03.644709 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.644686 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5"] Oct 30 23:47:03.646851 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:47:03.646664 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6864b0d8_cf9b_4045_a1fb_cfba56df7059.slice/crio-809a3810b70dff17eb45b27d6b779b0523aaab880fbfc7f950981ee07fb8c155 WatchSource:0}: Error finding container 809a3810b70dff17eb45b27d6b779b0523aaab880fbfc7f950981ee07fb8c155: Status 404 returned error can't find the container with id 809a3810b70dff17eb45b27d6b779b0523aaab880fbfc7f950981ee07fb8c155 Oct 30 23:47:03.648777 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:47:03.648752 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f71b68_2967_4c7b_b81c_3f576fa2eeeb.slice/crio-37ac5071892150b8de351e00985f4c288657e872b346b16e247cfc3f0b95f66e WatchSource:0}: Error finding container 37ac5071892150b8de351e00985f4c288657e872b346b16e247cfc3f0b95f66e: Status 404 returned error can't find the container with id 37ac5071892150b8de351e00985f4c288657e872b346b16e247cfc3f0b95f66e Oct 30 23:47:03.649140 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.649110 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:47:03.649245 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.649200 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:47:03.649307 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.649251 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:47:03.650842 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.650813 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:47:03.650931 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.650873 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:47:03.650931 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.650905 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:47:03.873330 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.873289 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" event={"ID":"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb","Type":"ContainerStarted","Data":"dcf5a397004e390f15e6a8aebf320e9dfd1eefdb69e0c518893f99342b0446d5"} Oct 30 23:47:03.873515 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.873350 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" event={"ID":"d7f71b68-2967-4c7b-b81c-3f576fa2eeeb","Type":"ContainerStarted","Data":"37ac5071892150b8de351e00985f4c288657e872b346b16e247cfc3f0b95f66e"} Oct 30 23:47:03.875220 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.875191 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" event={"ID":"6864b0d8-cf9b-4045-a1fb-cfba56df7059","Type":"ContainerStarted","Data":"8d29c0d29831ab1c014dbd9ab9da622305d46204b2ae36cd6ad8eb8ba6cd6f6b"} Oct 30 23:47:03.875338 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.875240 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" event={"ID":"6864b0d8-cf9b-4045-a1fb-cfba56df7059","Type":"ContainerStarted","Data":"809a3810b70dff17eb45b27d6b779b0523aaab880fbfc7f950981ee07fb8c155"} Oct 30 23:47:03.915896 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.915758 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" podStartSLOduration=1.9157388069999999 podStartE2EDuration="1.915738807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:47:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:47:03.913381728 +0000 UTC m=+670.123968230" watchObservedRunningTime="2026-10-30 23:47:03.915738807 +0000 UTC m=+670.126325309" Oct 30 23:47:03.954828 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:03.954770 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" podStartSLOduration=1.954752254 podStartE2EDuration="1.954752254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:47:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:47:03.952505711 +0000 UTC m=+670.163092212" watchObservedRunningTime="2026-10-30 23:47:03.954752254 +0000 UTC m=+670.165338754" Oct 30 23:47:04.315555 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:04.315521 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:04.316701 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:04.316679 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hcml7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Oct 30 23:47:04.316821 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:04.316717 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" podUID="6864b0d8-cf9b-4045-a1fb-cfba56df7059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Oct 30 23:47:04.324284 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:04.324266 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:04.325099 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:04.325080 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-t7kc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Oct 30 23:47:04.325195 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:04.325114 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" podUID="d7f71b68-2967-4c7b-b81c-3f576fa2eeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Oct 30 23:47:05.315714 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:05.315680 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hcml7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Oct 30 23:47:05.316077 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:05.315735 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" podUID="6864b0d8-cf9b-4045-a1fb-cfba56df7059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Oct 30 23:47:05.324437 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:05.324414 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-t7kc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Oct 30 23:47:05.324501 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:05.324455 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" podUID="d7f71b68-2967-4c7b-b81c-3f576fa2eeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Oct 30 23:47:06.315753 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:06.315721 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hcml7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Oct 30 23:47:06.316107 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:06.315769 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" podUID="6864b0d8-cf9b-4045-a1fb-cfba56df7059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Oct 30 23:47:06.324083 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:06.324059 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-t7kc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Oct 30 23:47:06.324197 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:06.324094 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" podUID="d7f71b68-2967-4c7b-b81c-3f576fa2eeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Oct 30 23:47:07.315253 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.315213 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hcml7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Oct 30 23:47:07.315450 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.315290 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" podUID="6864b0d8-cf9b-4045-a1fb-cfba56df7059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Oct 30 23:47:07.323969 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.323938 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-t7kc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Oct 30 23:47:07.324446 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.323979 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" podUID="d7f71b68-2967-4c7b-b81c-3f576fa2eeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Oct 30 23:47:07.846727 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.846695 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5"] Oct 30 23:47:07.861322 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.854391 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:07.873528 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.870818 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5"] Oct 30 23:47:07.898250 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.892681 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:47:07.898250 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.892824 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:47:07.898250 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.892972 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:47:07.898250 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.893071 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:47:07.923869 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.923826 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b86bdf7c-5wds5\" (UID: \"ef186c46-b922-41ba-a208-4d04dbda53f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:07.924037 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.923995 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b86bdf7c-5wds5\" (UID: \"ef186c46-b922-41ba-a208-4d04dbda53f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:07.924037 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:07.924027 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhzm7\" (UniqueName: \"kubernetes.io/projected/ef186c46-b922-41ba-a208-4d04dbda53f0-kube-api-access-vhzm7\") pod \"maas-api-revoke-sub-b86bdf7c-5wds5\" (UID: \"ef186c46-b922-41ba-a208-4d04dbda53f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:08.024739 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.024703 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b86bdf7c-5wds5\" (UID: \"ef186c46-b922-41ba-a208-4d04dbda53f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:08.024890 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.024811 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b86bdf7c-5wds5\" (UID: \"ef186c46-b922-41ba-a208-4d04dbda53f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:08.024890 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.024836 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhzm7\" (UniqueName: \"kubernetes.io/projected/ef186c46-b922-41ba-a208-4d04dbda53f0-kube-api-access-vhzm7\") pod \"maas-api-revoke-sub-b86bdf7c-5wds5\" (UID: \"ef186c46-b922-41ba-a208-4d04dbda53f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:08.025671 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.025645 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b86bdf7c-5wds5\" (UID: \"ef186c46-b922-41ba-a208-4d04dbda53f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:08.029552 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.029432 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b86bdf7c-5wds5\" (UID: \"ef186c46-b922-41ba-a208-4d04dbda53f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:08.043763 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.043744 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhzm7\" (UniqueName: \"kubernetes.io/projected/ef186c46-b922-41ba-a208-4d04dbda53f0-kube-api-access-vhzm7\") pod \"maas-api-revoke-sub-b86bdf7c-5wds5\" (UID: \"ef186c46-b922-41ba-a208-4d04dbda53f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:08.208308 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.208083 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:08.315886 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.315831 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hcml7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Oct 30 23:47:08.315951 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.315883 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" podUID="6864b0d8-cf9b-4045-a1fb-cfba56df7059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Oct 30 23:47:08.325184 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.324718 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-t7kc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Oct 30 23:47:08.325184 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.324782 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" podUID="d7f71b68-2967-4c7b-b81c-3f576fa2eeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Oct 30 23:47:08.575363 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.574741 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5"] Oct 30 23:47:08.605181 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:47:08.597604 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef186c46_b922_41ba_a208_4d04dbda53f0.slice/crio-fad41073085dc58aab155ca6d7112dc6f017b6112f35e86dea2bb0d01b0395f2 WatchSource:0}: Error finding container fad41073085dc58aab155ca6d7112dc6f017b6112f35e86dea2bb0d01b0395f2: Status 404 returned error can't find the container with id fad41073085dc58aab155ca6d7112dc6f017b6112f35e86dea2bb0d01b0395f2 Oct 30 23:47:08.929051 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:08.928965 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" event={"ID":"ef186c46-b922-41ba-a208-4d04dbda53f0","Type":"ContainerStarted","Data":"fad41073085dc58aab155ca6d7112dc6f017b6112f35e86dea2bb0d01b0395f2"} Oct 30 23:47:09.317190 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:09.315287 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hcml7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Oct 30 23:47:09.317190 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:09.315350 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" podUID="6864b0d8-cf9b-4045-a1fb-cfba56df7059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Oct 30 23:47:09.324933 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:09.324900 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-t7kc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Oct 30 23:47:09.325089 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:09.324946 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" podUID="d7f71b68-2967-4c7b-b81c-3f576fa2eeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Oct 30 23:47:10.315591 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:10.315548 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hcml7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Oct 30 23:47:10.316045 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:10.315618 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" podUID="6864b0d8-cf9b-4045-a1fb-cfba56df7059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Oct 30 23:47:10.324981 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:10.324951 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-t7kc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Oct 30 23:47:10.325117 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:10.325009 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" podUID="d7f71b68-2967-4c7b-b81c-3f576fa2eeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Oct 30 23:47:11.316259 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:11.316233 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hcml7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Oct 30 23:47:11.316697 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:11.316279 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" podUID="6864b0d8-cf9b-4045-a1fb-cfba56df7059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Oct 30 23:47:11.324585 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:11.324559 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-t7kc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Oct 30 23:47:11.324704 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:11.324599 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" podUID="d7f71b68-2967-4c7b-b81c-3f576fa2eeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Oct 30 23:47:11.954152 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:11.954060 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" event={"ID":"ef186c46-b922-41ba-a208-4d04dbda53f0","Type":"ContainerStarted","Data":"94c0e4d488a230c96d96efae9b6b34616eb30b9269e9036c4f983adf7651e772"} Oct 30 23:47:11.994995 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:11.994925 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" podStartSLOduration=2.359811202 podStartE2EDuration="4.994907541s" totalImagesPullingTime="2.635096339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:47:11.994348563 +0000 UTC m=+678.204935067" watchObservedRunningTime="2026-10-30 23:47:11.994907541 +0000 UTC m=+678.205494044" Oct 30 23:47:12.859980 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:12.859946 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:12.860489 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:12.860343 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:12.861208 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:12.861186 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" Oct 30 23:47:12.867990 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:12.867972 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:12.868312 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:12.868292 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:12.869025 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:12.869010 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" Oct 30 23:47:12.961041 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:12.961007 6174 generic.go:356] "Generic (PLEG): container finished" podID="ef186c46-b922-41ba-a208-4d04dbda53f0" containerID="94c0e4d488a230c96d96efae9b6b34616eb30b9269e9036c4f983adf7651e772" exitCode=0 Oct 30 23:47:12.961217 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:12.961078 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" event={"ID":"ef186c46-b922-41ba-a208-4d04dbda53f0","Type":"ContainerDied","Data":"94c0e4d488a230c96d96efae9b6b34616eb30b9269e9036c4f983adf7651e772"} Oct 30 23:47:14.093721 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.093694 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:14.190357 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.190322 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef186c46-b922-41ba-a208-4d04dbda53f0-kube-api-access-vhzm7\" (UniqueName: \"kubernetes.io/projected/ef186c46-b922-41ba-a208-4d04dbda53f0-kube-api-access-vhzm7\") pod \"ef186c46-b922-41ba-a208-4d04dbda53f0\" (UID: \"ef186c46-b922-41ba-a208-4d04dbda53f0\") " Oct 30 23:47:14.190549 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.190417 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-openshift-ca\") pod \"ef186c46-b922-41ba-a208-4d04dbda53f0\" (UID: \"ef186c46-b922-41ba-a208-4d04dbda53f0\") " Oct 30 23:47:14.190549 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.190486 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-xks-ca\") pod \"ef186c46-b922-41ba-a208-4d04dbda53f0\" (UID: \"ef186c46-b922-41ba-a208-4d04dbda53f0\") " Oct 30 23:47:14.190794 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.190771 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-openshift-ca" pod "ef186c46-b922-41ba-a208-4d04dbda53f0" (UID: "ef186c46-b922-41ba-a208-4d04dbda53f0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:47:14.190936 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.190918 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:14.192517 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.192486 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-xks-ca" pod "ef186c46-b922-41ba-a208-4d04dbda53f0" (UID: "ef186c46-b922-41ba-a208-4d04dbda53f0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:47:14.192637 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.192548 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef186c46-b922-41ba-a208-4d04dbda53f0-kube-api-access-vhzm7" pod "ef186c46-b922-41ba-a208-4d04dbda53f0" (UID: "ef186c46-b922-41ba-a208-4d04dbda53f0"). InnerVolumeSpecName "kube-api-access-vhzm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:47:14.292192 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.292143 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhzm7\" (UniqueName: \"kubernetes.io/projected/ef186c46-b922-41ba-a208-4d04dbda53f0-kube-api-access-vhzm7\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:14.292192 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.292194 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef186c46-b922-41ba-a208-4d04dbda53f0-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:14.970218 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.970192 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" Oct 30 23:47:14.970380 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.970188 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5" event={"ID":"ef186c46-b922-41ba-a208-4d04dbda53f0","Type":"ContainerDied","Data":"fad41073085dc58aab155ca6d7112dc6f017b6112f35e86dea2bb0d01b0395f2"} Oct 30 23:47:14.970380 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:14.970307 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fad41073085dc58aab155ca6d7112dc6f017b6112f35e86dea2bb0d01b0395f2" Oct 30 23:47:18.320559 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.320519 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6"] Oct 30 23:47:18.321080 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.321061 6174 cpu_manager.go:414] "containerMap: removing container" podUID="ef186c46-b922-41ba-a208-4d04dbda53f0" containerName="revoke-keys" Oct 30 23:47:18.321080 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.321077 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef186c46-b922-41ba-a208-4d04dbda53f0" containerName="revoke-keys" Oct 30 23:47:18.321183 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.321176 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef186c46-b922-41ba-a208-4d04dbda53f0" containerName="revoke-keys" Oct 30 23:47:18.324400 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.324383 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:18.351107 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.350962 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:47:18.351107 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.351077 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:47:18.351318 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.351139 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:47:18.351318 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.351185 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:47:18.352686 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.352665 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6"] Oct 30 23:47:18.429485 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.429455 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d7398db7-gzlx6\" (UID: \"2c56f7bd-60ce-4810-8031-e28fc469238a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:18.429639 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.429499 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtj7r\" (UniqueName: \"kubernetes.io/projected/2c56f7bd-60ce-4810-8031-e28fc469238a-kube-api-access-mtj7r\") pod \"maas-api-revoke-sub-d7398db7-gzlx6\" (UID: \"2c56f7bd-60ce-4810-8031-e28fc469238a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:18.429639 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.429601 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d7398db7-gzlx6\" (UID: \"2c56f7bd-60ce-4810-8031-e28fc469238a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:18.530982 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.530953 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d7398db7-gzlx6\" (UID: \"2c56f7bd-60ce-4810-8031-e28fc469238a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:18.531120 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.531018 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d7398db7-gzlx6\" (UID: \"2c56f7bd-60ce-4810-8031-e28fc469238a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:18.531120 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.531054 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtj7r\" (UniqueName: \"kubernetes.io/projected/2c56f7bd-60ce-4810-8031-e28fc469238a-kube-api-access-mtj7r\") pod \"maas-api-revoke-sub-d7398db7-gzlx6\" (UID: \"2c56f7bd-60ce-4810-8031-e28fc469238a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:18.531692 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.531668 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d7398db7-gzlx6\" (UID: \"2c56f7bd-60ce-4810-8031-e28fc469238a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:18.533419 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.533401 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d7398db7-gzlx6\" (UID: \"2c56f7bd-60ce-4810-8031-e28fc469238a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:18.551124 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.551092 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtj7r\" (UniqueName: \"kubernetes.io/projected/2c56f7bd-60ce-4810-8031-e28fc469238a-kube-api-access-mtj7r\") pod \"maas-api-revoke-sub-d7398db7-gzlx6\" (UID: \"2c56f7bd-60ce-4810-8031-e28fc469238a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:18.636395 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.636342 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:18.934789 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.934692 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6"] Oct 30 23:47:18.938688 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:47:18.938663 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c56f7bd_60ce_4810_8031_e28fc469238a.slice/crio-e2a829f1377205589ac1f4c43b99715662d493b512eb65d4e38ce1586c7024fa WatchSource:0}: Error finding container e2a829f1377205589ac1f4c43b99715662d493b512eb65d4e38ce1586c7024fa: Status 404 returned error can't find the container with id e2a829f1377205589ac1f4c43b99715662d493b512eb65d4e38ce1586c7024fa Oct 30 23:47:18.988451 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:18.988426 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" event={"ID":"2c56f7bd-60ce-4810-8031-e28fc469238a","Type":"ContainerStarted","Data":"e2a829f1377205589ac1f4c43b99715662d493b512eb65d4e38ce1586c7024fa"} Oct 30 23:47:19.995377 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:19.995345 6174 generic.go:356] "Generic (PLEG): container finished" podID="2c56f7bd-60ce-4810-8031-e28fc469238a" containerID="1c472305e37530dbda4931cb5a9d8551e2eae6be7fde64730fcb2e7349a658b3" exitCode=0 Oct 30 23:47:19.995815 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:19.995407 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" event={"ID":"2c56f7bd-60ce-4810-8031-e28fc469238a","Type":"ContainerDied","Data":"1c472305e37530dbda4931cb5a9d8551e2eae6be7fde64730fcb2e7349a658b3"} Oct 30 23:47:20.648105 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:20.648071 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:47:21.153875 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:21.153842 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:21.255951 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:21.255837 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-openshift-ca\") pod \"2c56f7bd-60ce-4810-8031-e28fc469238a\" (UID: \"2c56f7bd-60ce-4810-8031-e28fc469238a\") " Oct 30 23:47:21.255951 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:21.255922 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c56f7bd-60ce-4810-8031-e28fc469238a-kube-api-access-mtj7r\" (UniqueName: \"kubernetes.io/projected/2c56f7bd-60ce-4810-8031-e28fc469238a-kube-api-access-mtj7r\") pod \"2c56f7bd-60ce-4810-8031-e28fc469238a\" (UID: \"2c56f7bd-60ce-4810-8031-e28fc469238a\") " Oct 30 23:47:21.256208 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:21.256014 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-xks-ca\") pod \"2c56f7bd-60ce-4810-8031-e28fc469238a\" (UID: \"2c56f7bd-60ce-4810-8031-e28fc469238a\") " Oct 30 23:47:21.256473 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:21.256441 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-openshift-ca" pod "2c56f7bd-60ce-4810-8031-e28fc469238a" (UID: "2c56f7bd-60ce-4810-8031-e28fc469238a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:47:21.259044 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:21.258951 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c56f7bd-60ce-4810-8031-e28fc469238a-kube-api-access-mtj7r" pod "2c56f7bd-60ce-4810-8031-e28fc469238a" (UID: "2c56f7bd-60ce-4810-8031-e28fc469238a"). InnerVolumeSpecName "kube-api-access-mtj7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:47:21.259151 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:21.259046 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-xks-ca" pod "2c56f7bd-60ce-4810-8031-e28fc469238a" (UID: "2c56f7bd-60ce-4810-8031-e28fc469238a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:47:21.357615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:21.357548 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:21.357615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:21.357606 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtj7r\" (UniqueName: \"kubernetes.io/projected/2c56f7bd-60ce-4810-8031-e28fc469238a-kube-api-access-mtj7r\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:21.357615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:21.357624 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2c56f7bd-60ce-4810-8031-e28fc469238a-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:22.007627 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:22.007583 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" event={"ID":"2c56f7bd-60ce-4810-8031-e28fc469238a","Type":"ContainerDied","Data":"e2a829f1377205589ac1f4c43b99715662d493b512eb65d4e38ce1586c7024fa"} Oct 30 23:47:22.007826 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:22.007651 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2a829f1377205589ac1f4c43b99715662d493b512eb65d4e38ce1586c7024fa" Oct 30 23:47:22.007826 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:22.007724 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6" Oct 30 23:47:27.831945 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:27.831891 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hrcgk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:47:27.832616 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:27.832567 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" podUID="3c1dad76-6b81-41d5-8a73-04b9a6818ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:47:28.646293 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.646263 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4"] Oct 30 23:47:28.646696 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.646679 6174 cpu_manager.go:414] "containerMap: removing container" podUID="2c56f7bd-60ce-4810-8031-e28fc469238a" containerName="revoke-keys" Oct 30 23:47:28.646755 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.646699 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c56f7bd-60ce-4810-8031-e28fc469238a" containerName="revoke-keys" Oct 30 23:47:28.646806 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.646796 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c56f7bd-60ce-4810-8031-e28fc469238a" containerName="revoke-keys" Oct 30 23:47:28.650077 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.650061 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:28.668941 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.668915 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4"] Oct 30 23:47:28.678896 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.678856 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:47:28.678896 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.678888 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:47:28.679053 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.678908 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:47:28.679053 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.678970 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:47:28.745196 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.745141 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-517f1a26-p4fb4\" (UID: \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:28.745331 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.745203 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-xks-ca\") pod \"maas-api-revoke-sub-517f1a26-p4fb4\" (UID: \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:28.745331 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.745317 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk87l\" (UniqueName: \"kubernetes.io/projected/7cc5a566-ee81-406e-82e4-3263f1fe24ce-kube-api-access-qk87l\") pod \"maas-api-revoke-sub-517f1a26-p4fb4\" (UID: \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:28.846538 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.846505 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-517f1a26-p4fb4\" (UID: \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:28.846984 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.846544 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-xks-ca\") pod \"maas-api-revoke-sub-517f1a26-p4fb4\" (UID: \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:28.846984 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.846568 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk87l\" (UniqueName: \"kubernetes.io/projected/7cc5a566-ee81-406e-82e4-3263f1fe24ce-kube-api-access-qk87l\") pod \"maas-api-revoke-sub-517f1a26-p4fb4\" (UID: \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:28.847391 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.847365 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-517f1a26-p4fb4\" (UID: \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:28.848857 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.848836 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-xks-ca\") pod \"maas-api-revoke-sub-517f1a26-p4fb4\" (UID: \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:28.865337 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.865311 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk87l\" (UniqueName: \"kubernetes.io/projected/7cc5a566-ee81-406e-82e4-3263f1fe24ce-kube-api-access-qk87l\") pod \"maas-api-revoke-sub-517f1a26-p4fb4\" (UID: \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:28.962977 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:28.962914 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:29.259502 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:29.259384 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4"] Oct 30 23:47:29.264194 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:47:29.264145 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc5a566_ee81_406e_82e4_3263f1fe24ce.slice/crio-b31c4d3d70552e383c1622cdcfbab50840b5f044c68ad84c377e9077bc081d17 WatchSource:0}: Error finding container b31c4d3d70552e383c1622cdcfbab50840b5f044c68ad84c377e9077bc081d17: Status 404 returned error can't find the container with id b31c4d3d70552e383c1622cdcfbab50840b5f044c68ad84c377e9077bc081d17 Oct 30 23:47:29.271580 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:47:29.271548 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:47:30.094506 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:30.094475 6174 generic.go:356] "Generic (PLEG): container finished" podID="7cc5a566-ee81-406e-82e4-3263f1fe24ce" containerID="2d09a1917e2096dc151a808108460972b312e934059b07b954e0e11619d069ad" exitCode=0 Oct 30 23:47:30.094832 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:30.094530 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" event={"ID":"7cc5a566-ee81-406e-82e4-3263f1fe24ce","Type":"ContainerDied","Data":"2d09a1917e2096dc151a808108460972b312e934059b07b954e0e11619d069ad"} Oct 30 23:47:30.094832 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:30.094574 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" event={"ID":"7cc5a566-ee81-406e-82e4-3263f1fe24ce","Type":"ContainerStarted","Data":"b31c4d3d70552e383c1622cdcfbab50840b5f044c68ad84c377e9077bc081d17"} Oct 30 23:47:31.231204 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:31.231180 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:31.369196 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:31.369094 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7cc5a566-ee81-406e-82e4-3263f1fe24ce-kube-api-access-qk87l\" (UniqueName: \"kubernetes.io/projected/7cc5a566-ee81-406e-82e4-3263f1fe24ce-kube-api-access-qk87l\") pod \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\" (UID: \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\") " Oct 30 23:47:31.369196 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:31.369186 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-openshift-ca\") pod \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\" (UID: \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\") " Oct 30 23:47:31.369370 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:31.369270 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-xks-ca\") pod \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\" (UID: \"7cc5a566-ee81-406e-82e4-3263f1fe24ce\") " Oct 30 23:47:31.369580 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:31.369546 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-openshift-ca" pod "7cc5a566-ee81-406e-82e4-3263f1fe24ce" (UID: "7cc5a566-ee81-406e-82e4-3263f1fe24ce"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:47:31.371300 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:31.371280 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cc5a566-ee81-406e-82e4-3263f1fe24ce-kube-api-access-qk87l" pod "7cc5a566-ee81-406e-82e4-3263f1fe24ce" (UID: "7cc5a566-ee81-406e-82e4-3263f1fe24ce"). InnerVolumeSpecName "kube-api-access-qk87l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:47:31.371368 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:31.371307 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-xks-ca" pod "7cc5a566-ee81-406e-82e4-3263f1fe24ce" (UID: "7cc5a566-ee81-406e-82e4-3263f1fe24ce"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:47:31.470172 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:31.470131 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk87l\" (UniqueName: \"kubernetes.io/projected/7cc5a566-ee81-406e-82e4-3263f1fe24ce-kube-api-access-qk87l\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:31.470172 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:31.470153 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:31.470335 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:31.470179 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7cc5a566-ee81-406e-82e4-3263f1fe24ce-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:32.106119 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:32.106088 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" Oct 30 23:47:32.106290 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:32.106089 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4" event={"ID":"7cc5a566-ee81-406e-82e4-3263f1fe24ce","Type":"ContainerDied","Data":"b31c4d3d70552e383c1622cdcfbab50840b5f044c68ad84c377e9077bc081d17"} Oct 30 23:47:32.106290 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:32.106222 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b31c4d3d70552e383c1622cdcfbab50840b5f044c68ad84c377e9077bc081d17" Oct 30 23:47:39.109288 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.109255 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z"] Oct 30 23:47:39.109692 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.109682 6174 cpu_manager.go:414] "containerMap: removing container" podUID="7cc5a566-ee81-406e-82e4-3263f1fe24ce" containerName="revoke-keys" Oct 30 23:47:39.109730 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.109696 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7cc5a566-ee81-406e-82e4-3263f1fe24ce" containerName="revoke-keys" Oct 30 23:47:39.109785 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.109774 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="7cc5a566-ee81-406e-82e4-3263f1fe24ce" containerName="revoke-keys" Oct 30 23:47:39.112940 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.112918 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:39.139034 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.139006 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-932ad867-vqq8z\" (UID: \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:39.139179 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.139040 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwj7n\" (UniqueName: \"kubernetes.io/projected/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-kube-api-access-qwj7n\") pod \"maas-api-revoke-sub-932ad867-vqq8z\" (UID: \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:39.139243 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.139199 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-932ad867-vqq8z\" (UID: \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:39.142038 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.142018 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:47:39.142145 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.142079 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:47:39.143716 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.143696 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z"] Oct 30 23:47:39.149292 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.149272 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:47:39.149428 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.149413 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:47:39.240756 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.240720 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-932ad867-vqq8z\" (UID: \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:39.240925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.240766 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwj7n\" (UniqueName: \"kubernetes.io/projected/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-kube-api-access-qwj7n\") pod \"maas-api-revoke-sub-932ad867-vqq8z\" (UID: \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:39.240925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.240849 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-932ad867-vqq8z\" (UID: \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:39.241729 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.241709 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-932ad867-vqq8z\" (UID: \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:39.243191 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.243173 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-932ad867-vqq8z\" (UID: \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:39.259757 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.259726 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwj7n\" (UniqueName: \"kubernetes.io/projected/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-kube-api-access-qwj7n\") pod \"maas-api-revoke-sub-932ad867-vqq8z\" (UID: \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:39.427936 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.427854 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:39.727224 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:39.724804 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z"] Oct 30 23:47:39.731119 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:47:39.731086 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb0a6e7_a419_4076_9f4d_7f44aa9aa25e.slice/crio-3e2c62f9cf7b5521572a2c33a4e588c08de9b3eaa0f04f15c5c499bef8ab7858 WatchSource:0}: Error finding container 3e2c62f9cf7b5521572a2c33a4e588c08de9b3eaa0f04f15c5c499bef8ab7858: Status 404 returned error can't find the container with id 3e2c62f9cf7b5521572a2c33a4e588c08de9b3eaa0f04f15c5c499bef8ab7858 Oct 30 23:47:40.144375 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:40.144338 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" event={"ID":"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e","Type":"ContainerStarted","Data":"eb0dea17d60c4330e45bdc7b3a600813824a29f0c7ed50e118dc3ea6acfcabc0"} Oct 30 23:47:40.144769 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:40.144395 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" event={"ID":"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e","Type":"ContainerStarted","Data":"3e2c62f9cf7b5521572a2c33a4e588c08de9b3eaa0f04f15c5c499bef8ab7858"} Oct 30 23:47:40.184289 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:40.184245 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" podStartSLOduration=1.184231743 podStartE2EDuration="1.184231743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:47:40.182638747 +0000 UTC m=+706.393225247" watchObservedRunningTime="2026-10-30 23:47:40.184231743 +0000 UTC m=+706.394818245" Oct 30 23:47:41.153680 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:41.153638 6174 generic.go:356] "Generic (PLEG): container finished" podID="9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e" containerID="eb0dea17d60c4330e45bdc7b3a600813824a29f0c7ed50e118dc3ea6acfcabc0" exitCode=0 Oct 30 23:47:41.154175 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:41.153688 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" event={"ID":"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e","Type":"ContainerDied","Data":"eb0dea17d60c4330e45bdc7b3a600813824a29f0c7ed50e118dc3ea6acfcabc0"} Oct 30 23:47:43.048581 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.048254 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:43.198244 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.176924 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-kube-api-access-qwj7n\" (UniqueName: \"kubernetes.io/projected/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-kube-api-access-qwj7n\") pod \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\" (UID: \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\") " Oct 30 23:47:43.198654 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.198624 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-openshift-ca\") pod \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\" (UID: \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\") " Oct 30 23:47:43.210179 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.202535 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-xks-ca\") pod \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\" (UID: \"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e\") " Oct 30 23:47:43.210754 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.202332 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-openshift-ca" pod "9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e" (UID: "9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:47:43.242358 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.242302 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-xks-ca" pod "9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e" (UID: "9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:47:43.249622 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.249574 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-kube-api-access-qwj7n" pod "9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e" (UID: "9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e"). InnerVolumeSpecName "kube-api-access-qwj7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:47:43.269191 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.260527 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" event={"ID":"9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e","Type":"ContainerDied","Data":"3e2c62f9cf7b5521572a2c33a4e588c08de9b3eaa0f04f15c5c499bef8ab7858"} Oct 30 23:47:43.269191 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.260586 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e2c62f9cf7b5521572a2c33a4e588c08de9b3eaa0f04f15c5c499bef8ab7858" Oct 30 23:47:43.269191 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.260669 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z" Oct 30 23:47:43.312944 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.312910 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:43.313377 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.313358 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwj7n\" (UniqueName: \"kubernetes.io/projected/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-kube-api-access-qwj7n\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:43.313496 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.313481 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:43.933192 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.932035 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hcml7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:47:43.933192 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.932126 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" podUID="6864b0d8-cf9b-4045-a1fb-cfba56df7059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:47:43.933192 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.932518 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-t7kc5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:47:43.933192 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:43.932571 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" podUID="d7f71b68-2967-4c7b-b81c-3f576fa2eeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:47:49.487906 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.487863 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l"] Oct 30 23:47:49.488378 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.488343 6174 cpu_manager.go:414] "containerMap: removing container" podUID="9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e" containerName="revoke-keys" Oct 30 23:47:49.488378 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.488367 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e" containerName="revoke-keys" Oct 30 23:47:49.488506 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.488491 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e" containerName="revoke-keys" Oct 30 23:47:49.491747 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.491729 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:49.505696 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.505659 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:47:49.505810 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.505757 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:47:49.517676 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.517650 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:47:49.517799 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.517792 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:47:49.519535 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.519510 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l"] Oct 30 23:47:49.607014 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.606979 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b8b4d0dd-65v5l\" (UID: \"715e1e0e-f577-45b0-b774-7808363c1c87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:49.607205 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.607094 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b8b4d0dd-65v5l\" (UID: \"715e1e0e-f577-45b0-b774-7808363c1c87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:49.607205 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.607139 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsnd9\" (UniqueName: \"kubernetes.io/projected/715e1e0e-f577-45b0-b774-7808363c1c87-kube-api-access-lsnd9\") pod \"maas-api-revoke-sub-b8b4d0dd-65v5l\" (UID: \"715e1e0e-f577-45b0-b774-7808363c1c87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:49.708282 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.708254 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b8b4d0dd-65v5l\" (UID: \"715e1e0e-f577-45b0-b774-7808363c1c87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:49.708443 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.708301 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsnd9\" (UniqueName: \"kubernetes.io/projected/715e1e0e-f577-45b0-b774-7808363c1c87-kube-api-access-lsnd9\") pod \"maas-api-revoke-sub-b8b4d0dd-65v5l\" (UID: \"715e1e0e-f577-45b0-b774-7808363c1c87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:49.708443 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.708352 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b8b4d0dd-65v5l\" (UID: \"715e1e0e-f577-45b0-b774-7808363c1c87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:49.708881 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.708857 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b8b4d0dd-65v5l\" (UID: \"715e1e0e-f577-45b0-b774-7808363c1c87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:49.710570 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.710551 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b8b4d0dd-65v5l\" (UID: \"715e1e0e-f577-45b0-b774-7808363c1c87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:49.727576 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.727548 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsnd9\" (UniqueName: \"kubernetes.io/projected/715e1e0e-f577-45b0-b774-7808363c1c87-kube-api-access-lsnd9\") pod \"maas-api-revoke-sub-b8b4d0dd-65v5l\" (UID: \"715e1e0e-f577-45b0-b774-7808363c1c87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:49.806200 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:49.806182 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:50.100236 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:50.100141 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l"] Oct 30 23:47:50.109736 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:47:50.109703 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod715e1e0e_f577_45b0_b774_7808363c1c87.slice/crio-ed7a5ca0acdd068eaefb5ce19df3baa4399291a9db5b424b53eeb887742739df WatchSource:0}: Error finding container ed7a5ca0acdd068eaefb5ce19df3baa4399291a9db5b424b53eeb887742739df: Status 404 returned error can't find the container with id ed7a5ca0acdd068eaefb5ce19df3baa4399291a9db5b424b53eeb887742739df Oct 30 23:47:50.295224 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:50.295194 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" event={"ID":"715e1e0e-f577-45b0-b774-7808363c1c87","Type":"ContainerStarted","Data":"d5c86f29cf7ed62a70820ebee048611d27cb7c68c28dc3758260f13e8419e622"} Oct 30 23:47:50.295330 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:50.295279 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" event={"ID":"715e1e0e-f577-45b0-b774-7808363c1c87","Type":"ContainerStarted","Data":"ed7a5ca0acdd068eaefb5ce19df3baa4399291a9db5b424b53eeb887742739df"} Oct 30 23:47:50.333900 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:50.333855 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" podStartSLOduration=1.333842264 podStartE2EDuration="1.333842264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:47:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:47:50.333104882 +0000 UTC m=+716.543691383" watchObservedRunningTime="2026-10-30 23:47:50.333842264 +0000 UTC m=+716.544428765" Oct 30 23:47:51.304200 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:51.304146 6174 generic.go:356] "Generic (PLEG): container finished" podID="715e1e0e-f577-45b0-b774-7808363c1c87" containerID="d5c86f29cf7ed62a70820ebee048611d27cb7c68c28dc3758260f13e8419e622" exitCode=0 Oct 30 23:47:51.304686 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:51.304238 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" event={"ID":"715e1e0e-f577-45b0-b774-7808363c1c87","Type":"ContainerDied","Data":"d5c86f29cf7ed62a70820ebee048611d27cb7c68c28dc3758260f13e8419e622"} Oct 30 23:47:53.013181 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.010510 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:53.127477 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.127441 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-xks-ca\") pod \"715e1e0e-f577-45b0-b774-7808363c1c87\" (UID: \"715e1e0e-f577-45b0-b774-7808363c1c87\") " Oct 30 23:47:53.127807 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.127784 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/715e1e0e-f577-45b0-b774-7808363c1c87-kube-api-access-lsnd9\" (UniqueName: \"kubernetes.io/projected/715e1e0e-f577-45b0-b774-7808363c1c87-kube-api-access-lsnd9\") pod \"715e1e0e-f577-45b0-b774-7808363c1c87\" (UID: \"715e1e0e-f577-45b0-b774-7808363c1c87\") " Oct 30 23:47:53.127960 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.127943 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-openshift-ca\") pod \"715e1e0e-f577-45b0-b774-7808363c1c87\" (UID: \"715e1e0e-f577-45b0-b774-7808363c1c87\") " Oct 30 23:47:53.141606 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.141566 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-xks-ca" pod "715e1e0e-f577-45b0-b774-7808363c1c87" (UID: "715e1e0e-f577-45b0-b774-7808363c1c87"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:47:53.148180 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.142045 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-openshift-ca" pod "715e1e0e-f577-45b0-b774-7808363c1c87" (UID: "715e1e0e-f577-45b0-b774-7808363c1c87"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:47:53.196243 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.194881 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/715e1e0e-f577-45b0-b774-7808363c1c87-kube-api-access-lsnd9" pod "715e1e0e-f577-45b0-b774-7808363c1c87" (UID: "715e1e0e-f577-45b0-b774-7808363c1c87"). InnerVolumeSpecName "kube-api-access-lsnd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:47:53.240187 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.234788 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:53.240187 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.234830 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsnd9\" (UniqueName: \"kubernetes.io/projected/715e1e0e-f577-45b0-b774-7808363c1c87-kube-api-access-lsnd9\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:53.240187 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.234848 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/715e1e0e-f577-45b0-b774-7808363c1c87-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:47:53.369197 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.367429 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" event={"ID":"715e1e0e-f577-45b0-b774-7808363c1c87","Type":"ContainerDied","Data":"ed7a5ca0acdd068eaefb5ce19df3baa4399291a9db5b424b53eeb887742739df"} Oct 30 23:47:53.369197 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.367495 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed7a5ca0acdd068eaefb5ce19df3baa4399291a9db5b424b53eeb887742739df" Oct 30 23:47:53.369197 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:47:53.367565 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l" Oct 30 23:47:59.267353 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:47:59.267316 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:48:00.944452 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:00.944424 6174 scope.go:122] "RemoveContainer" containerID="fb7aa16d2fc32992ecceab4036c134fd54d5dad9d8029baf9e952fa238f7c21a" Oct 30 23:48:00.944826 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:48:00.944656 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:48:01.136223 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:01.136193 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:48:10.729764 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:10.729684 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:48:11.945507 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:11.945472 6174 scope.go:122] "RemoveContainer" containerID="fb7aa16d2fc32992ecceab4036c134fd54d5dad9d8029baf9e952fa238f7c21a" Oct 30 23:48:12.535407 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:12.533852 6174 generic.go:356] "Generic (PLEG): container finished" podID="8879af5d-1f13-4772-b12d-7670aaaf8573" containerID="ee9cb14dfc90caf2b7c4aeb84e3ccc56f38e5ea38f0ff66f641894bb508fa12b" exitCode=1 Oct 30 23:48:12.535407 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:12.533913 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" event={"ID":"8879af5d-1f13-4772-b12d-7670aaaf8573","Type":"ContainerDied","Data":"ee9cb14dfc90caf2b7c4aeb84e3ccc56f38e5ea38f0ff66f641894bb508fa12b"} Oct 30 23:48:12.535407 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:12.534002 6174 scope.go:122] "RemoveContainer" containerID="fb7aa16d2fc32992ecceab4036c134fd54d5dad9d8029baf9e952fa238f7c21a" Oct 30 23:48:12.535407 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:12.534484 6174 scope.go:122] "RemoveContainer" containerID="ee9cb14dfc90caf2b7c4aeb84e3ccc56f38e5ea38f0ff66f641894bb508fa12b" Oct 30 23:48:12.535407 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:48:12.534757 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:48:13.911181 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:13.907232 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hcml7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:48:13.911181 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:13.907290 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hcml7" podUID="6864b0d8-cf9b-4045-a1fb-cfba56df7059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:48:13.919319 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:13.919291 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-t7kc5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:48:13.919581 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:13.919551 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-t7kc5" podUID="d7f71b68-2967-4c7b-b81c-3f576fa2eeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:48:15.230334 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:15.230300 6174 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:48:15.230720 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:15.230366 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:48:15.230720 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:15.230688 6174 scope.go:122] "RemoveContainer" containerID="ee9cb14dfc90caf2b7c4aeb84e3ccc56f38e5ea38f0ff66f641894bb508fa12b" Oct 30 23:48:15.230923 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:48:15.230903 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:48:19.027494 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:19.027460 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:48:26.862177 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:26.862065 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:48:29.268153 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:48:29.268117 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:48:41.578580 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.578542 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd"] Oct 30 23:48:41.578997 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.578982 6174 cpu_manager.go:414] "containerMap: removing container" podUID="715e1e0e-f577-45b0-b774-7808363c1c87" containerName="revoke-keys" Oct 30 23:48:41.579040 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.578998 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="715e1e0e-f577-45b0-b774-7808363c1c87" containerName="revoke-keys" Oct 30 23:48:41.579089 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.579080 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="715e1e0e-f577-45b0-b774-7808363c1c87" containerName="revoke-keys" Oct 30 23:48:41.582364 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.582344 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.599100 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.599081 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-main-8d2ae1-openshift-default-dockercfg-nqrtj\"" Oct 30 23:48:41.610829 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.610801 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd"] Oct 30 23:48:41.653646 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.653621 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64d3f58-39cb-436f-b8c5-aad0ff964361-istiod-ca-cert\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.653793 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.653683 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-token\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.653843 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.653795 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-credential-socket\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.653843 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.653819 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-data\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.653843 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.653838 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-podinfo\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.653974 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.653855 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-certs\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.653974 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.653924 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-envoy\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.654050 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.653992 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75bnq\" (UniqueName: \"kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-kube-api-access-75bnq\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.654050 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.654034 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-socket\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.755226 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.755141 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-credential-socket\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.755226 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.755217 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-data\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.755489 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.755252 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-podinfo\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.755489 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.755282 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-certs\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.755489 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.755310 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-envoy\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.755489 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.755382 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75bnq\" (UniqueName: \"kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-kube-api-access-75bnq\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.755489 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.755430 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-socket\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.755489 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.755487 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64d3f58-39cb-436f-b8c5-aad0ff964361-istiod-ca-cert\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.755800 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.755552 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-token\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.756653 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.756614 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-credential-socket\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.757333 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.757295 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-socket\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.757639 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.757606 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-data\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.757939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.757907 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-certs\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.758018 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.757945 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64d3f58-39cb-436f-b8c5-aad0ff964361-istiod-ca-cert\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.763687 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.763658 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-envoy\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.767474 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.767438 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-podinfo\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.776184 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.776134 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-token\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.777773 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.777747 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75bnq\" (UniqueName: \"kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-kube-api-access-75bnq\") pod \"e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:41.897867 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:41.897794 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:42.214780 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:42.214686 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd"] Oct 30 23:48:42.218612 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:48:42.218586 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64d3f58_39cb_436f_b8c5_aad0ff964361.slice/crio-cb628ceb11f99fc7ac1ac1b72ff670e89a7a2416574d25076abf7b4972867d9b WatchSource:0}: Error finding container cb628ceb11f99fc7ac1ac1b72ff670e89a7a2416574d25076abf7b4972867d9b: Status 404 returned error can't find the container with id cb628ceb11f99fc7ac1ac1b72ff670e89a7a2416574d25076abf7b4972867d9b Oct 30 23:48:42.220804 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:42.220775 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:48:42.220897 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:42.220838 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:48:42.220897 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:42.220870 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:48:42.768092 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:42.768057 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" event={"ID":"a64d3f58-39cb-436f-b8c5-aad0ff964361","Type":"ContainerStarted","Data":"7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58"} Oct 30 23:48:42.768477 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:42.768106 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" event={"ID":"a64d3f58-39cb-436f-b8c5-aad0ff964361","Type":"ContainerStarted","Data":"cb628ceb11f99fc7ac1ac1b72ff670e89a7a2416574d25076abf7b4972867d9b"} Oct 30 23:48:42.811921 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:42.811877 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" podStartSLOduration=1.811865786 podStartE2EDuration="1.811865786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:42.810840724 +0000 UTC m=+769.021427224" watchObservedRunningTime="2026-10-30 23:48:42.811865786 +0000 UTC m=+769.022452287" Oct 30 23:48:42.898131 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:42.898102 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:43.903789 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:43.903761 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:44.776767 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:44.776736 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:44.777770 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:44.777753 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:48:47.488506 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.488464 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w"] Oct 30 23:48:47.492430 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.492410 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" Oct 30 23:48:47.513853 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.513831 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-main-8d2ae1\"" Oct 30 23:48:47.526499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.526475 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w"] Oct 30 23:48:47.568989 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.568966 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm"] Oct 30 23:48:47.572556 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.572516 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" Oct 30 23:48:47.602648 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.602629 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-main-8d2ae1-dockercfg-k6kqv\"" Oct 30 23:48:47.609127 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.609107 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30a3cc5b-6ced-488a-b7c7-dc6178930228-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w\" (UID: \"30a3cc5b-6ced-488a-b7c7-dc6178930228\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" Oct 30 23:48:47.609225 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.609180 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs4h7\" (UniqueName: \"kubernetes.io/projected/30a3cc5b-6ced-488a-b7c7-dc6178930228-kube-api-access-bs4h7\") pod \"payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w\" (UID: \"30a3cc5b-6ced-488a-b7c7-dc6178930228\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" Oct 30 23:48:47.609302 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.609280 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2vdk\" (UniqueName: \"kubernetes.io/projected/2b76f319-60e2-4d6c-9802-c93c82082533-kube-api-access-b2vdk\") pod \"payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm\" (UID: \"2b76f319-60e2-4d6c-9802-c93c82082533\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" Oct 30 23:48:47.609407 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.609391 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b76f319-60e2-4d6c-9802-c93c82082533-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm\" (UID: \"2b76f319-60e2-4d6c-9802-c93c82082533\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" Oct 30 23:48:47.647685 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.647628 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm"] Oct 30 23:48:47.710839 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.710810 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b76f319-60e2-4d6c-9802-c93c82082533-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm\" (UID: \"2b76f319-60e2-4d6c-9802-c93c82082533\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" Oct 30 23:48:47.710995 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.710950 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30a3cc5b-6ced-488a-b7c7-dc6178930228-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w\" (UID: \"30a3cc5b-6ced-488a-b7c7-dc6178930228\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" Oct 30 23:48:47.710995 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.710989 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs4h7\" (UniqueName: \"kubernetes.io/projected/30a3cc5b-6ced-488a-b7c7-dc6178930228-kube-api-access-bs4h7\") pod \"payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w\" (UID: \"30a3cc5b-6ced-488a-b7c7-dc6178930228\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" Oct 30 23:48:47.711069 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.711011 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2vdk\" (UniqueName: \"kubernetes.io/projected/2b76f319-60e2-4d6c-9802-c93c82082533-kube-api-access-b2vdk\") pod \"payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm\" (UID: \"2b76f319-60e2-4d6c-9802-c93c82082533\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" Oct 30 23:48:47.711554 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.711532 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b76f319-60e2-4d6c-9802-c93c82082533-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm\" (UID: \"2b76f319-60e2-4d6c-9802-c93c82082533\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" Oct 30 23:48:47.711667 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.711647 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30a3cc5b-6ced-488a-b7c7-dc6178930228-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w\" (UID: \"30a3cc5b-6ced-488a-b7c7-dc6178930228\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" Oct 30 23:48:47.749871 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.749808 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2vdk\" (UniqueName: \"kubernetes.io/projected/2b76f319-60e2-4d6c-9802-c93c82082533-kube-api-access-b2vdk\") pod \"payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm\" (UID: \"2b76f319-60e2-4d6c-9802-c93c82082533\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" Oct 30 23:48:47.761398 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.761371 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs4h7\" (UniqueName: \"kubernetes.io/projected/30a3cc5b-6ced-488a-b7c7-dc6178930228-kube-api-access-bs4h7\") pod \"payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w\" (UID: \"30a3cc5b-6ced-488a-b7c7-dc6178930228\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" Oct 30 23:48:47.805423 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.805397 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" Oct 30 23:48:47.886090 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:47.886059 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" Oct 30 23:48:48.105579 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:48.105547 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w"] Oct 30 23:48:48.108863 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:48:48.108837 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a3cc5b_6ced_488a_b7c7_dc6178930228.slice/crio-2e8bb7df8fc1bcc37e403e4f0209abb5120dbdf23afbd19ada0d5ee127063bea WatchSource:0}: Error finding container 2e8bb7df8fc1bcc37e403e4f0209abb5120dbdf23afbd19ada0d5ee127063bea: Status 404 returned error can't find the container with id 2e8bb7df8fc1bcc37e403e4f0209abb5120dbdf23afbd19ada0d5ee127063bea Oct 30 23:48:48.198541 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:48.198514 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm"] Oct 30 23:48:48.201655 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:48:48.201630 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b76f319_60e2_4d6c_9802_c93c82082533.slice/crio-12435d6b7425d022dc8fe9ca58b5954eee27900c3cc85e404c1a37723bbcd0da WatchSource:0}: Error finding container 12435d6b7425d022dc8fe9ca58b5954eee27900c3cc85e404c1a37723bbcd0da: Status 404 returned error can't find the container with id 12435d6b7425d022dc8fe9ca58b5954eee27900c3cc85e404c1a37723bbcd0da Oct 30 23:48:48.795617 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:48.795577 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" event={"ID":"30a3cc5b-6ced-488a-b7c7-dc6178930228","Type":"ContainerStarted","Data":"5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9"} Oct 30 23:48:48.796128 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:48.795646 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" event={"ID":"30a3cc5b-6ced-488a-b7c7-dc6178930228","Type":"ContainerStarted","Data":"2e8bb7df8fc1bcc37e403e4f0209abb5120dbdf23afbd19ada0d5ee127063bea"} Oct 30 23:48:48.796128 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:48.795736 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" Oct 30 23:48:48.797748 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:48.797722 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" event={"ID":"2b76f319-60e2-4d6c-9802-c93c82082533","Type":"ContainerStarted","Data":"4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb"} Oct 30 23:48:48.797847 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:48.797765 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" event={"ID":"2b76f319-60e2-4d6c-9802-c93c82082533","Type":"ContainerStarted","Data":"12435d6b7425d022dc8fe9ca58b5954eee27900c3cc85e404c1a37723bbcd0da"} Oct 30 23:48:48.797847 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:48.797786 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" Oct 30 23:48:48.840328 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:48.839231 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" podStartSLOduration=1.839211938 podStartE2EDuration="1.839211938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:48.837356791 +0000 UTC m=+775.047943293" watchObservedRunningTime="2026-10-30 23:48:48.839211938 +0000 UTC m=+775.049798442" Oct 30 23:48:48.881840 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:48.881794 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" podStartSLOduration=1.881782574 podStartE2EDuration="1.881782574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:48:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:48:48.880775745 +0000 UTC m=+775.091362246" watchObservedRunningTime="2026-10-30 23:48:48.881782574 +0000 UTC m=+775.092369072" Oct 30 23:48:52.067691 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:52.067655 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:48:59.267500 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:48:59.267410 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:48:59.806220 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:59.806179 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" Oct 30 23:48:59.806396 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:48:59.806268 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" Oct 30 23:49:00.818312 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:00.818280 6174 patch_prober.go:29] interesting pod/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:49:00.818701 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:00.818339 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:49:02.871558 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:02.871524 6174 generic.go:356] "Generic (PLEG): container finished" podID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerID="7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58" exitCode=0 Oct 30 23:49:02.871965 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:02.871599 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" event={"ID":"a64d3f58-39cb-436f-b8c5-aad0ff964361","Type":"ContainerDied","Data":"7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58"} Oct 30 23:49:02.872007 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:02.871992 6174 scope.go:122] "RemoveContainer" containerID="7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58" Oct 30 23:49:02.873293 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:02.873264 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:49:02.873380 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:02.873355 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:49:02.873417 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:02.873391 6174 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236056Ki","pods":"250"} Oct 30 23:49:03.881728 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:03.881695 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" event={"ID":"a64d3f58-39cb-436f-b8c5-aad0ff964361","Type":"ContainerStarted","Data":"7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919"} Oct 30 23:49:03.897987 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:03.897959 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:49:03.898122 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:03.898082 6174 patch_prober.go:29] interesting pod/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Oct 30 23:49:03.898235 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:03.898127 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Oct 30 23:49:04.899047 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:04.899019 6174 patch_prober.go:29] interesting pod/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Oct 30 23:49:04.899627 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:04.899543 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Oct 30 23:49:05.899056 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:05.899025 6174 patch_prober.go:29] interesting pod/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Oct 30 23:49:05.899438 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:05.899074 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Oct 30 23:49:06.898938 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:06.898905 6174 patch_prober.go:29] interesting pod/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Oct 30 23:49:06.899116 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:06.899004 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Oct 30 23:49:07.271478 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.271388 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr"] Oct 30 23:49:07.277997 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.277973 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" Oct 30 23:49:07.283713 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.283687 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sgh7\" (UniqueName: \"kubernetes.io/projected/1bb1a017-b255-4a2c-a1e9-c969dc56add7-kube-api-access-6sgh7\") pod \"payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr\" (UID: \"1bb1a017-b255-4a2c-a1e9-c969dc56add7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" Oct 30 23:49:07.283823 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.283790 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb1a017-b255-4a2c-a1e9-c969dc56add7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr\" (UID: \"1bb1a017-b255-4a2c-a1e9-c969dc56add7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" Oct 30 23:49:07.292515 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.292478 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr"] Oct 30 23:49:07.302289 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.302266 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-main-cd9099\"" Oct 30 23:49:07.302408 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.302313 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-main-cd9099-dockercfg-skjns\"" Oct 30 23:49:07.398184 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.397113 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sgh7\" (UniqueName: \"kubernetes.io/projected/1bb1a017-b255-4a2c-a1e9-c969dc56add7-kube-api-access-6sgh7\") pod \"payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr\" (UID: \"1bb1a017-b255-4a2c-a1e9-c969dc56add7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" Oct 30 23:49:07.398184 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.397223 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb1a017-b255-4a2c-a1e9-c969dc56add7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr\" (UID: \"1bb1a017-b255-4a2c-a1e9-c969dc56add7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" Oct 30 23:49:07.399205 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.398470 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb1a017-b255-4a2c-a1e9-c969dc56add7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr\" (UID: \"1bb1a017-b255-4a2c-a1e9-c969dc56add7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" Oct 30 23:49:07.402526 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.402504 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r"] Oct 30 23:49:07.431484 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.431448 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" Oct 30 23:49:07.441946 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.441910 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r"] Oct 30 23:49:07.450493 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.450461 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sgh7\" (UniqueName: \"kubernetes.io/projected/1bb1a017-b255-4a2c-a1e9-c969dc56add7-kube-api-access-6sgh7\") pod \"payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr\" (UID: \"1bb1a017-b255-4a2c-a1e9-c969dc56add7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" Oct 30 23:49:07.591203 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.591174 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" Oct 30 23:49:07.599596 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.599569 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r\" (UID: \"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" Oct 30 23:49:07.602126 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.599624 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvg6r\" (UniqueName: \"kubernetes.io/projected/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-kube-api-access-zvg6r\") pod \"payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r\" (UID: \"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" Oct 30 23:49:07.705064 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.705030 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r\" (UID: \"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" Oct 30 23:49:07.705474 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.705451 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvg6r\" (UniqueName: \"kubernetes.io/projected/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-kube-api-access-zvg6r\") pod \"payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r\" (UID: \"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" Oct 30 23:49:07.708650 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.708599 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r\" (UID: \"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" Oct 30 23:49:07.724656 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.724631 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvg6r\" (UniqueName: \"kubernetes.io/projected/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-kube-api-access-zvg6r\") pod \"payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r\" (UID: \"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" Oct 30 23:49:07.773177 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.772354 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" Oct 30 23:49:07.909539 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.908353 6174 patch_prober.go:29] interesting pod/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Oct 30 23:49:07.909539 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.908429 6174 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Oct 30 23:49:07.927455 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:07.927421 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr"] Oct 30 23:49:07.931509 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:49:07.931480 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb1a017_b255_4a2c_a1e9_c969dc56add7.slice/crio-9e43dcaf698b143d9a25768fea8b7277a8eb75141437479f198fa6596cc9689b WatchSource:0}: Error finding container 9e43dcaf698b143d9a25768fea8b7277a8eb75141437479f198fa6596cc9689b: Status 404 returned error can't find the container with id 9e43dcaf698b143d9a25768fea8b7277a8eb75141437479f198fa6596cc9689b Oct 30 23:49:08.081506 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:08.081473 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r"] Oct 30 23:49:08.084784 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:49:08.084760 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9feffccc_da7c_49f6_b4f3_e2bb95c13bb7.slice/crio-69a84dded3b5aea1ab207d0e3fbd807d4d21f439f4480ca491ef675292305972 WatchSource:0}: Error finding container 69a84dded3b5aea1ab207d0e3fbd807d4d21f439f4480ca491ef675292305972: Status 404 returned error can't find the container with id 69a84dded3b5aea1ab207d0e3fbd807d4d21f439f4480ca491ef675292305972 Oct 30 23:49:08.920027 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:08.919989 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" event={"ID":"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7","Type":"ContainerStarted","Data":"3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf"} Oct 30 23:49:08.920568 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:08.920049 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" event={"ID":"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7","Type":"ContainerStarted","Data":"69a84dded3b5aea1ab207d0e3fbd807d4d21f439f4480ca491ef675292305972"} Oct 30 23:49:08.920568 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:08.920179 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" Oct 30 23:49:08.921843 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:08.921811 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" event={"ID":"1bb1a017-b255-4a2c-a1e9-c969dc56add7","Type":"ContainerStarted","Data":"82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66"} Oct 30 23:49:08.921976 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:08.921868 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" event={"ID":"1bb1a017-b255-4a2c-a1e9-c969dc56add7","Type":"ContainerStarted","Data":"9e43dcaf698b143d9a25768fea8b7277a8eb75141437479f198fa6596cc9689b"} Oct 30 23:49:08.921976 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:08.921942 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" Oct 30 23:49:08.960754 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:08.960688 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" podStartSLOduration=1.9606678290000001 podStartE2EDuration="1.960667829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:49:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:49:08.958565608 +0000 UTC m=+795.169152109" watchObservedRunningTime="2026-10-30 23:49:08.960667829 +0000 UTC m=+795.171254331" Oct 30 23:49:08.966838 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:08.966801 6174 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:49:08.967520 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:08.967479 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:49:08.968663 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:08.968646 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:49:09.000915 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:09.000857 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" podStartSLOduration=2.000841055 podStartE2EDuration="2.000841055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:49:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:49:08.998479303 +0000 UTC m=+795.209065804" watchObservedRunningTime="2026-10-30 23:49:09.000841055 +0000 UTC m=+795.211427557" Oct 30 23:49:13.983497 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:13.983444 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:49:19.929734 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:19.929700 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" Oct 30 23:49:19.930205 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:19.929774 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" Oct 30 23:49:29.267817 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:49:29.267780 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:49:31.142767 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:31.142728 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:49:32.944485 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:32.944407 6174 scope.go:122] "RemoveContainer" containerID="ee9cb14dfc90caf2b7c4aeb84e3ccc56f38e5ea38f0ff66f641894bb508fa12b" Oct 30 23:49:32.944897 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:49:32.944613 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:49:46.821328 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:49:46.821277 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:49:59.268523 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:49:59.268484 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:50:04.785295 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.785259 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q"] Oct 30 23:50:04.790035 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.790019 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:04.816106 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.816084 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:50:04.816106 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.816082 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:50:04.816301 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.816085 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:50:04.819119 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.819097 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q"] Oct 30 23:50:04.830416 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.830390 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx4ts\" (UniqueName: \"kubernetes.io/projected/b636dc87-61da-402c-b2d3-8eee4d1b5561-kube-api-access-fx4ts\") pod \"maas-api-revoke-sub-465e2457-6hv9q\" (UID: \"b636dc87-61da-402c-b2d3-8eee4d1b5561\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:04.830512 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.830421 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-xks-ca\") pod \"maas-api-revoke-sub-465e2457-6hv9q\" (UID: \"b636dc87-61da-402c-b2d3-8eee4d1b5561\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:04.830512 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.830455 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-465e2457-6hv9q\" (UID: \"b636dc87-61da-402c-b2d3-8eee4d1b5561\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:04.904691 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.904668 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:50:04.931270 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.931245 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx4ts\" (UniqueName: \"kubernetes.io/projected/b636dc87-61da-402c-b2d3-8eee4d1b5561-kube-api-access-fx4ts\") pod \"maas-api-revoke-sub-465e2457-6hv9q\" (UID: \"b636dc87-61da-402c-b2d3-8eee4d1b5561\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:04.931365 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.931276 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-xks-ca\") pod \"maas-api-revoke-sub-465e2457-6hv9q\" (UID: \"b636dc87-61da-402c-b2d3-8eee4d1b5561\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:04.931365 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.931314 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-465e2457-6hv9q\" (UID: \"b636dc87-61da-402c-b2d3-8eee4d1b5561\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:04.932064 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.932042 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-465e2457-6hv9q\" (UID: \"b636dc87-61da-402c-b2d3-8eee4d1b5561\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:04.933548 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.933528 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-xks-ca\") pod \"maas-api-revoke-sub-465e2457-6hv9q\" (UID: \"b636dc87-61da-402c-b2d3-8eee4d1b5561\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:04.950702 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:04.950678 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx4ts\" (UniqueName: \"kubernetes.io/projected/b636dc87-61da-402c-b2d3-8eee4d1b5561-kube-api-access-fx4ts\") pod \"maas-api-revoke-sub-465e2457-6hv9q\" (UID: \"b636dc87-61da-402c-b2d3-8eee4d1b5561\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:05.102301 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:05.102273 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:05.399017 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:05.398944 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q"] Oct 30 23:50:05.402456 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:50:05.402432 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb636dc87_61da_402c_b2d3_8eee4d1b5561.slice/crio-e70cd8d724a49fea15c399e6bd7fbd1edbddd5fdc696edea888ab55e9070a81d WatchSource:0}: Error finding container e70cd8d724a49fea15c399e6bd7fbd1edbddd5fdc696edea888ab55e9070a81d: Status 404 returned error can't find the container with id e70cd8d724a49fea15c399e6bd7fbd1edbddd5fdc696edea888ab55e9070a81d Oct 30 23:50:06.252593 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:06.252563 6174 generic.go:356] "Generic (PLEG): container finished" podID="b636dc87-61da-402c-b2d3-8eee4d1b5561" containerID="8fc3efad06072c54b35a7d2956b0980c9f9fd2492c8a9eb0a743cd1791f3fdd5" exitCode=0 Oct 30 23:50:06.252991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:06.252629 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" event={"ID":"b636dc87-61da-402c-b2d3-8eee4d1b5561","Type":"ContainerDied","Data":"8fc3efad06072c54b35a7d2956b0980c9f9fd2492c8a9eb0a743cd1791f3fdd5"} Oct 30 23:50:06.252991 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:06.252668 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" event={"ID":"b636dc87-61da-402c-b2d3-8eee4d1b5561","Type":"ContainerStarted","Data":"e70cd8d724a49fea15c399e6bd7fbd1edbddd5fdc696edea888ab55e9070a81d"} Oct 30 23:50:07.398219 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:07.398191 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:07.453982 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:07.453951 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b636dc87-61da-402c-b2d3-8eee4d1b5561-kube-api-access-fx4ts\" (UniqueName: \"kubernetes.io/projected/b636dc87-61da-402c-b2d3-8eee4d1b5561-kube-api-access-fx4ts\") pod \"b636dc87-61da-402c-b2d3-8eee4d1b5561\" (UID: \"b636dc87-61da-402c-b2d3-8eee4d1b5561\") " Oct 30 23:50:07.454143 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:07.454009 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-xks-ca\") pod \"b636dc87-61da-402c-b2d3-8eee4d1b5561\" (UID: \"b636dc87-61da-402c-b2d3-8eee4d1b5561\") " Oct 30 23:50:07.454143 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:07.454055 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-openshift-ca\") pod \"b636dc87-61da-402c-b2d3-8eee4d1b5561\" (UID: \"b636dc87-61da-402c-b2d3-8eee4d1b5561\") " Oct 30 23:50:07.454530 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:07.454502 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-openshift-ca" pod "b636dc87-61da-402c-b2d3-8eee4d1b5561" (UID: "b636dc87-61da-402c-b2d3-8eee4d1b5561"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:50:07.456297 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:07.456272 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b636dc87-61da-402c-b2d3-8eee4d1b5561-kube-api-access-fx4ts" pod "b636dc87-61da-402c-b2d3-8eee4d1b5561" (UID: "b636dc87-61da-402c-b2d3-8eee4d1b5561"). InnerVolumeSpecName "kube-api-access-fx4ts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:50:07.456393 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:07.456325 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-xks-ca" pod "b636dc87-61da-402c-b2d3-8eee4d1b5561" (UID: "b636dc87-61da-402c-b2d3-8eee4d1b5561"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:50:07.555501 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:07.555469 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx4ts\" (UniqueName: \"kubernetes.io/projected/b636dc87-61da-402c-b2d3-8eee4d1b5561-kube-api-access-fx4ts\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:07.555501 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:07.555504 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:07.555687 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:07.555534 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b636dc87-61da-402c-b2d3-8eee4d1b5561-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:08.263442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:08.263357 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" Oct 30 23:50:08.263442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:08.263368 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-465e2457-6hv9q" event={"ID":"b636dc87-61da-402c-b2d3-8eee4d1b5561","Type":"ContainerDied","Data":"e70cd8d724a49fea15c399e6bd7fbd1edbddd5fdc696edea888ab55e9070a81d"} Oct 30 23:50:08.263442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:08.263417 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e70cd8d724a49fea15c399e6bd7fbd1edbddd5fdc696edea888ab55e9070a81d" Oct 30 23:50:18.007674 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.007640 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls"] Oct 30 23:50:18.008062 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.008026 6174 cpu_manager.go:414] "containerMap: removing container" podUID="b636dc87-61da-402c-b2d3-8eee4d1b5561" containerName="revoke-keys" Oct 30 23:50:18.008062 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.008038 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b636dc87-61da-402c-b2d3-8eee4d1b5561" containerName="revoke-keys" Oct 30 23:50:18.008141 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.008131 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="b636dc87-61da-402c-b2d3-8eee4d1b5561" containerName="revoke-keys" Oct 30 23:50:18.011327 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.011310 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:18.026249 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.026232 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:50:18.038354 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.038332 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:50:18.038503 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.038353 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:50:18.038503 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.038362 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:50:18.040295 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.040273 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls"] Oct 30 23:50:18.057030 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.057001 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2d6202f-bshls\" (UID: \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:18.057128 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.057067 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-825s7\" (UniqueName: \"kubernetes.io/projected/e082341a-d9eb-466f-b8a4-de9bd08a1f70-kube-api-access-825s7\") pod \"maas-api-revoke-sub-d2d6202f-bshls\" (UID: \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:18.057271 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.057252 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2d6202f-bshls\" (UID: \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:18.158377 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.158348 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2d6202f-bshls\" (UID: \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:18.158514 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.158419 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2d6202f-bshls\" (UID: \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:18.158514 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.158447 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-825s7\" (UniqueName: \"kubernetes.io/projected/e082341a-d9eb-466f-b8a4-de9bd08a1f70-kube-api-access-825s7\") pod \"maas-api-revoke-sub-d2d6202f-bshls\" (UID: \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:18.158974 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.158952 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2d6202f-bshls\" (UID: \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:18.160748 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.160727 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2d6202f-bshls\" (UID: \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:18.177936 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.177918 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-825s7\" (UniqueName: \"kubernetes.io/projected/e082341a-d9eb-466f-b8a4-de9bd08a1f70-kube-api-access-825s7\") pod \"maas-api-revoke-sub-d2d6202f-bshls\" (UID: \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:18.324302 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.324279 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:18.632228 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:18.632128 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls"] Oct 30 23:50:18.635194 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:50:18.635143 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode082341a_d9eb_466f_b8a4_de9bd08a1f70.slice/crio-c382033df2a960a7e78c6a5ea1dca0fef78d05308ece1e6021263e26737df5cc WatchSource:0}: Error finding container c382033df2a960a7e78c6a5ea1dca0fef78d05308ece1e6021263e26737df5cc: Status 404 returned error can't find the container with id c382033df2a960a7e78c6a5ea1dca0fef78d05308ece1e6021263e26737df5cc Oct 30 23:50:19.147862 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:19.147828 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:50:19.336674 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:19.336640 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" event={"ID":"e082341a-d9eb-466f-b8a4-de9bd08a1f70","Type":"ContainerStarted","Data":"b350cc04690b562846727a098d4e5004070d10739d3d09ce9b370f9428248111"} Oct 30 23:50:19.336882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:19.336693 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" event={"ID":"e082341a-d9eb-466f-b8a4-de9bd08a1f70","Type":"ContainerStarted","Data":"c382033df2a960a7e78c6a5ea1dca0fef78d05308ece1e6021263e26737df5cc"} Oct 30 23:50:19.378362 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:19.378305 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" podStartSLOduration=2.37829133 podStartE2EDuration="2.37829133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:50:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:50:19.378195814 +0000 UTC m=+865.588782316" watchObservedRunningTime="2026-10-30 23:50:19.37829133 +0000 UTC m=+865.588877830" Oct 30 23:50:20.342902 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:20.342869 6174 generic.go:356] "Generic (PLEG): container finished" podID="e082341a-d9eb-466f-b8a4-de9bd08a1f70" containerID="b350cc04690b562846727a098d4e5004070d10739d3d09ce9b370f9428248111" exitCode=0 Oct 30 23:50:20.343308 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:20.342915 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" event={"ID":"e082341a-d9eb-466f-b8a4-de9bd08a1f70","Type":"ContainerDied","Data":"b350cc04690b562846727a098d4e5004070d10739d3d09ce9b370f9428248111"} Oct 30 23:50:21.506298 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:21.506275 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:21.591886 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:21.591854 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-openshift-ca\") pod \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\" (UID: \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\") " Oct 30 23:50:21.592066 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:21.591910 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-xks-ca\") pod \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\" (UID: \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\") " Oct 30 23:50:21.592066 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:21.591969 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e082341a-d9eb-466f-b8a4-de9bd08a1f70-kube-api-access-825s7\" (UniqueName: \"kubernetes.io/projected/e082341a-d9eb-466f-b8a4-de9bd08a1f70-kube-api-access-825s7\") pod \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\" (UID: \"e082341a-d9eb-466f-b8a4-de9bd08a1f70\") " Oct 30 23:50:21.592239 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:21.592215 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-openshift-ca" pod "e082341a-d9eb-466f-b8a4-de9bd08a1f70" (UID: "e082341a-d9eb-466f-b8a4-de9bd08a1f70"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:50:21.593976 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:21.593952 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-xks-ca" pod "e082341a-d9eb-466f-b8a4-de9bd08a1f70" (UID: "e082341a-d9eb-466f-b8a4-de9bd08a1f70"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:50:21.594186 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:21.594140 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e082341a-d9eb-466f-b8a4-de9bd08a1f70-kube-api-access-825s7" pod "e082341a-d9eb-466f-b8a4-de9bd08a1f70" (UID: "e082341a-d9eb-466f-b8a4-de9bd08a1f70"). InnerVolumeSpecName "kube-api-access-825s7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:50:21.693477 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:21.693450 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:21.693477 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:21.693474 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-825s7\" (UniqueName: \"kubernetes.io/projected/e082341a-d9eb-466f-b8a4-de9bd08a1f70-kube-api-access-825s7\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:21.693623 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:21.693485 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e082341a-d9eb-466f-b8a4-de9bd08a1f70-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:22.355414 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:22.355385 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" Oct 30 23:50:22.355414 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:22.355386 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2d6202f-bshls" event={"ID":"e082341a-d9eb-466f-b8a4-de9bd08a1f70","Type":"ContainerDied","Data":"c382033df2a960a7e78c6a5ea1dca0fef78d05308ece1e6021263e26737df5cc"} Oct 30 23:50:22.355615 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:22.355434 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c382033df2a960a7e78c6a5ea1dca0fef78d05308ece1e6021263e26737df5cc" Oct 30 23:50:27.828322 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:27.828267 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-hrcgk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:50:27.828963 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:27.828912 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-hrcgk" podUID="3c1dad76-6b81-41d5-8a73-04b9a6818ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:50:28.531657 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.531628 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm"] Oct 30 23:50:28.532037 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.532023 6174 cpu_manager.go:414] "containerMap: removing container" podUID="e082341a-d9eb-466f-b8a4-de9bd08a1f70" containerName="revoke-keys" Oct 30 23:50:28.532081 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.532038 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e082341a-d9eb-466f-b8a4-de9bd08a1f70" containerName="revoke-keys" Oct 30 23:50:28.532139 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.532130 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="e082341a-d9eb-466f-b8a4-de9bd08a1f70" containerName="revoke-keys" Oct 30 23:50:28.535492 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.535475 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:28.563100 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.563023 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:50:28.563277 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.563238 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:50:28.563400 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.563300 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:50:28.563400 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.563339 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:50:28.565822 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.565799 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm"] Oct 30 23:50:28.602719 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.602694 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-7ec31e49-2njkm\" (UID: \"19111282-3b31-468b-86e2-1cf5fa70d24e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:28.602853 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.602764 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-7ec31e49-2njkm\" (UID: \"19111282-3b31-468b-86e2-1cf5fa70d24e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:28.602853 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.602816 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl7h6\" (UniqueName: \"kubernetes.io/projected/19111282-3b31-468b-86e2-1cf5fa70d24e-kube-api-access-jl7h6\") pod \"maas-api-revoke-sub-7ec31e49-2njkm\" (UID: \"19111282-3b31-468b-86e2-1cf5fa70d24e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:28.703575 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.703547 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-7ec31e49-2njkm\" (UID: \"19111282-3b31-468b-86e2-1cf5fa70d24e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:28.703767 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.703607 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-7ec31e49-2njkm\" (UID: \"19111282-3b31-468b-86e2-1cf5fa70d24e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:28.703767 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.703663 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7h6\" (UniqueName: \"kubernetes.io/projected/19111282-3b31-468b-86e2-1cf5fa70d24e-kube-api-access-jl7h6\") pod \"maas-api-revoke-sub-7ec31e49-2njkm\" (UID: \"19111282-3b31-468b-86e2-1cf5fa70d24e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:28.704208 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.704176 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-7ec31e49-2njkm\" (UID: \"19111282-3b31-468b-86e2-1cf5fa70d24e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:28.706022 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.706000 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-7ec31e49-2njkm\" (UID: \"19111282-3b31-468b-86e2-1cf5fa70d24e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:28.732125 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.732096 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl7h6\" (UniqueName: \"kubernetes.io/projected/19111282-3b31-468b-86e2-1cf5fa70d24e-kube-api-access-jl7h6\") pod \"maas-api-revoke-sub-7ec31e49-2njkm\" (UID: \"19111282-3b31-468b-86e2-1cf5fa70d24e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:28.848244 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:28.848217 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:29.159448 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:29.159374 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm"] Oct 30 23:50:29.163474 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:50:29.163451 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19111282_3b31_468b_86e2_1cf5fa70d24e.slice/crio-91e0ba532b34b0c9475e12c874e7b6ef32cc8b263b96f69cf15f06952a830229 WatchSource:0}: Error finding container 91e0ba532b34b0c9475e12c874e7b6ef32cc8b263b96f69cf15f06952a830229: Status 404 returned error can't find the container with id 91e0ba532b34b0c9475e12c874e7b6ef32cc8b263b96f69cf15f06952a830229 Oct 30 23:50:29.269171 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:50:29.269127 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:50:29.416189 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:29.416092 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" event={"ID":"19111282-3b31-468b-86e2-1cf5fa70d24e","Type":"ContainerStarted","Data":"91e0ba532b34b0c9475e12c874e7b6ef32cc8b263b96f69cf15f06952a830229"} Oct 30 23:50:30.425937 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:30.425902 6174 generic.go:356] "Generic (PLEG): container finished" podID="19111282-3b31-468b-86e2-1cf5fa70d24e" containerID="f87a05df93c5e303f598254ea51b34e050e19f83ad7408f5f7bed20f200dd24d" exitCode=0 Oct 30 23:50:30.425937 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:30.425939 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" event={"ID":"19111282-3b31-468b-86e2-1cf5fa70d24e","Type":"ContainerDied","Data":"f87a05df93c5e303f598254ea51b34e050e19f83ad7408f5f7bed20f200dd24d"} Oct 30 23:50:30.943866 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:30.943831 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:50:31.638499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:31.638473 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:31.742815 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:31.742714 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-openshift-ca\") pod \"19111282-3b31-468b-86e2-1cf5fa70d24e\" (UID: \"19111282-3b31-468b-86e2-1cf5fa70d24e\") " Oct 30 23:50:31.742983 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:31.742811 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19111282-3b31-468b-86e2-1cf5fa70d24e-kube-api-access-jl7h6\" (UniqueName: \"kubernetes.io/projected/19111282-3b31-468b-86e2-1cf5fa70d24e-kube-api-access-jl7h6\") pod \"19111282-3b31-468b-86e2-1cf5fa70d24e\" (UID: \"19111282-3b31-468b-86e2-1cf5fa70d24e\") " Oct 30 23:50:31.742983 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:31.742932 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-xks-ca\") pod \"19111282-3b31-468b-86e2-1cf5fa70d24e\" (UID: \"19111282-3b31-468b-86e2-1cf5fa70d24e\") " Oct 30 23:50:31.743565 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:31.743536 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-openshift-ca" pod "19111282-3b31-468b-86e2-1cf5fa70d24e" (UID: "19111282-3b31-468b-86e2-1cf5fa70d24e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:50:31.746078 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:31.745754 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19111282-3b31-468b-86e2-1cf5fa70d24e-kube-api-access-jl7h6" pod "19111282-3b31-468b-86e2-1cf5fa70d24e" (UID: "19111282-3b31-468b-86e2-1cf5fa70d24e"). InnerVolumeSpecName "kube-api-access-jl7h6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:50:31.746328 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:31.746293 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-xks-ca" pod "19111282-3b31-468b-86e2-1cf5fa70d24e" (UID: "19111282-3b31-468b-86e2-1cf5fa70d24e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:50:31.844618 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:31.844577 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:31.844618 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:31.844618 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19111282-3b31-468b-86e2-1cf5fa70d24e-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:31.844863 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:31.844636 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl7h6\" (UniqueName: \"kubernetes.io/projected/19111282-3b31-468b-86e2-1cf5fa70d24e-kube-api-access-jl7h6\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:32.440437 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:32.440400 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" Oct 30 23:50:32.440437 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:32.440422 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-7ec31e49-2njkm" event={"ID":"19111282-3b31-468b-86e2-1cf5fa70d24e","Type":"ContainerDied","Data":"91e0ba532b34b0c9475e12c874e7b6ef32cc8b263b96f69cf15f06952a830229"} Oct 30 23:50:32.440707 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:32.440487 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91e0ba532b34b0c9475e12c874e7b6ef32cc8b263b96f69cf15f06952a830229" Oct 30 23:50:38.940894 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:38.940852 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx"] Oct 30 23:50:38.942254 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:38.942228 6174 cpu_manager.go:414] "containerMap: removing container" podUID="19111282-3b31-468b-86e2-1cf5fa70d24e" containerName="revoke-keys" Oct 30 23:50:38.942409 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:38.942394 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19111282-3b31-468b-86e2-1cf5fa70d24e" containerName="revoke-keys" Oct 30 23:50:38.942650 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:38.942633 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="19111282-3b31-468b-86e2-1cf5fa70d24e" containerName="revoke-keys" Oct 30 23:50:38.947362 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:38.947344 6174 scope.go:122] "RemoveContainer" containerID="ee9cb14dfc90caf2b7c4aeb84e3ccc56f38e5ea38f0ff66f641894bb508fa12b" Oct 30 23:50:38.948977 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:50:38.948571 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:50:38.949194 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:38.946649 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:38.971749 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:38.969449 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx"] Oct 30 23:50:38.978047 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:38.978028 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:50:38.978325 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:38.978311 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:50:38.978612 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:38.978560 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:50:38.985467 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:38.985432 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:50:39.039739 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:39.039709 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2rjk\" (UniqueName: \"kubernetes.io/projected/8e0fdcff-3d9d-4784-9725-f2afc2585b71-kube-api-access-k2rjk\") pod \"maas-api-revoke-sub-66072066-m7mqx\" (UID: \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:39.040069 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:39.040047 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-xks-ca\") pod \"maas-api-revoke-sub-66072066-m7mqx\" (UID: \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:39.040318 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:39.040300 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-66072066-m7mqx\" (UID: \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:39.150183 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:39.142766 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-66072066-m7mqx\" (UID: \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:39.150183 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:39.142831 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2rjk\" (UniqueName: \"kubernetes.io/projected/8e0fdcff-3d9d-4784-9725-f2afc2585b71-kube-api-access-k2rjk\") pod \"maas-api-revoke-sub-66072066-m7mqx\" (UID: \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:39.150183 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:39.142936 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-xks-ca\") pod \"maas-api-revoke-sub-66072066-m7mqx\" (UID: \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:39.150183 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:39.144255 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-66072066-m7mqx\" (UID: \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:39.164179 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:39.160345 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-xks-ca\") pod \"maas-api-revoke-sub-66072066-m7mqx\" (UID: \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:39.172034 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:39.171081 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2rjk\" (UniqueName: \"kubernetes.io/projected/8e0fdcff-3d9d-4784-9725-f2afc2585b71-kube-api-access-k2rjk\") pod \"maas-api-revoke-sub-66072066-m7mqx\" (UID: \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:39.341586 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:39.341559 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:39.637464 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:39.637393 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx"] Oct 30 23:50:39.640746 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:50:39.640721 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0fdcff_3d9d_4784_9725_f2afc2585b71.slice/crio-d215c40caf38c186b06a8c4a0ba65b80adcb2db6c401460d00888490668ab89e WatchSource:0}: Error finding container d215c40caf38c186b06a8c4a0ba65b80adcb2db6c401460d00888490668ab89e: Status 404 returned error can't find the container with id d215c40caf38c186b06a8c4a0ba65b80adcb2db6c401460d00888490668ab89e Oct 30 23:50:40.595926 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:40.595891 6174 generic.go:356] "Generic (PLEG): container finished" podID="8e0fdcff-3d9d-4784-9725-f2afc2585b71" containerID="037be90c79cd2414696cdd91b4f62742e02ded2ebb9dfa19f02d9fdf99bfe40b" exitCode=0 Oct 30 23:50:40.596314 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:40.595980 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" event={"ID":"8e0fdcff-3d9d-4784-9725-f2afc2585b71","Type":"ContainerDied","Data":"037be90c79cd2414696cdd91b4f62742e02ded2ebb9dfa19f02d9fdf99bfe40b"} Oct 30 23:50:40.596314 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:40.596028 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" event={"ID":"8e0fdcff-3d9d-4784-9725-f2afc2585b71","Type":"ContainerStarted","Data":"d215c40caf38c186b06a8c4a0ba65b80adcb2db6c401460d00888490668ab89e"} Oct 30 23:50:41.729883 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:41.729860 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:41.869324 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:41.869248 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-xks-ca\") pod \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\" (UID: \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\") " Oct 30 23:50:41.869324 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:41.869308 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e0fdcff-3d9d-4784-9725-f2afc2585b71-kube-api-access-k2rjk\" (UniqueName: \"kubernetes.io/projected/8e0fdcff-3d9d-4784-9725-f2afc2585b71-kube-api-access-k2rjk\") pod \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\" (UID: \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\") " Oct 30 23:50:41.869582 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:41.869368 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-openshift-ca\") pod \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\" (UID: \"8e0fdcff-3d9d-4784-9725-f2afc2585b71\") " Oct 30 23:50:41.869757 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:41.869733 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-openshift-ca" pod "8e0fdcff-3d9d-4784-9725-f2afc2585b71" (UID: "8e0fdcff-3d9d-4784-9725-f2afc2585b71"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:50:41.871314 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:41.871292 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-xks-ca" pod "8e0fdcff-3d9d-4784-9725-f2afc2585b71" (UID: "8e0fdcff-3d9d-4784-9725-f2afc2585b71"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:50:41.871404 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:41.871356 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e0fdcff-3d9d-4784-9725-f2afc2585b71-kube-api-access-k2rjk" pod "8e0fdcff-3d9d-4784-9725-f2afc2585b71" (UID: "8e0fdcff-3d9d-4784-9725-f2afc2585b71"). InnerVolumeSpecName "kube-api-access-k2rjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:50:41.971072 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:41.971041 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:41.971072 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:41.971067 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2rjk\" (UniqueName: \"kubernetes.io/projected/8e0fdcff-3d9d-4784-9725-f2afc2585b71-kube-api-access-k2rjk\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:41.971253 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:41.971076 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8e0fdcff-3d9d-4784-9725-f2afc2585b71-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:42.607135 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:42.607105 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" Oct 30 23:50:42.607322 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:42.607105 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-66072066-m7mqx" event={"ID":"8e0fdcff-3d9d-4784-9725-f2afc2585b71","Type":"ContainerDied","Data":"d215c40caf38c186b06a8c4a0ba65b80adcb2db6c401460d00888490668ab89e"} Oct 30 23:50:42.607322 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:42.607234 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d215c40caf38c186b06a8c4a0ba65b80adcb2db6c401460d00888490668ab89e" Oct 30 23:50:49.359299 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.359268 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp"] Oct 30 23:50:49.359712 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.359698 6174 cpu_manager.go:414] "containerMap: removing container" podUID="8e0fdcff-3d9d-4784-9725-f2afc2585b71" containerName="revoke-keys" Oct 30 23:50:49.359753 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.359713 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e0fdcff-3d9d-4784-9725-f2afc2585b71" containerName="revoke-keys" Oct 30 23:50:49.359796 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.359788 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e0fdcff-3d9d-4784-9725-f2afc2585b71" containerName="revoke-keys" Oct 30 23:50:49.362866 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.362848 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:49.391610 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.391575 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:50:49.391723 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.391617 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:50:49.391846 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.391823 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:50:49.391959 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.391858 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:50:49.394771 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.394749 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp"] Oct 30 23:50:49.543390 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.543361 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4e69dd5d-dhqzp\" (UID: \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:49.543539 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.543401 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhglb\" (UniqueName: \"kubernetes.io/projected/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-kube-api-access-xhglb\") pod \"maas-api-revoke-sub-4e69dd5d-dhqzp\" (UID: \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:49.543586 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.543537 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4e69dd5d-dhqzp\" (UID: \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:49.644554 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.644480 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4e69dd5d-dhqzp\" (UID: \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:49.644690 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.644577 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4e69dd5d-dhqzp\" (UID: \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:49.644690 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.644602 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhglb\" (UniqueName: \"kubernetes.io/projected/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-kube-api-access-xhglb\") pod \"maas-api-revoke-sub-4e69dd5d-dhqzp\" (UID: \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:49.645312 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.645291 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4e69dd5d-dhqzp\" (UID: \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:49.646864 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.646840 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4e69dd5d-dhqzp\" (UID: \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:49.664917 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.664893 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhglb\" (UniqueName: \"kubernetes.io/projected/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-kube-api-access-xhglb\") pod \"maas-api-revoke-sub-4e69dd5d-dhqzp\" (UID: \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:49.675732 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.675713 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:49.974285 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:49.974216 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp"] Oct 30 23:50:49.977996 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:50:49.977964 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4d3e30b_18e3_4c3d_a826_3ea6102ac4b6.slice/crio-ba3d4a29d44b7714be26b7431951ff23c8ab87608f3bb206095ad587e60a6f41 WatchSource:0}: Error finding container ba3d4a29d44b7714be26b7431951ff23c8ab87608f3bb206095ad587e60a6f41: Status 404 returned error can't find the container with id ba3d4a29d44b7714be26b7431951ff23c8ab87608f3bb206095ad587e60a6f41 Oct 30 23:50:50.653789 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:50.653742 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" event={"ID":"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6","Type":"ContainerStarted","Data":"7578779446a13d8f619d84d8cf1ea85bc8aad00ce9315717ebb91032070ef13a"} Oct 30 23:50:50.654194 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:50.653815 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" event={"ID":"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6","Type":"ContainerStarted","Data":"ba3d4a29d44b7714be26b7431951ff23c8ab87608f3bb206095ad587e60a6f41"} Oct 30 23:50:50.694528 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:50.694484 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" podStartSLOduration=1.6944700240000001 podStartE2EDuration="1.694470024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:50:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:50:50.69399463 +0000 UTC m=+896.904581131" watchObservedRunningTime="2026-10-30 23:50:50.694470024 +0000 UTC m=+896.905056524" Oct 30 23:50:51.664050 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:51.664009 6174 generic.go:356] "Generic (PLEG): container finished" podID="c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6" containerID="7578779446a13d8f619d84d8cf1ea85bc8aad00ce9315717ebb91032070ef13a" exitCode=0 Oct 30 23:50:51.664586 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:51.664098 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" event={"ID":"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6","Type":"ContainerDied","Data":"7578779446a13d8f619d84d8cf1ea85bc8aad00ce9315717ebb91032070ef13a"} Oct 30 23:50:53.236455 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.236412 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:53.359527 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.359438 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-kube-api-access-xhglb\" (UniqueName: \"kubernetes.io/projected/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-kube-api-access-xhglb\") pod \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\" (UID: \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\") " Oct 30 23:50:53.360205 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.360180 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-openshift-ca\") pod \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\" (UID: \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\") " Oct 30 23:50:53.360949 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.360901 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-openshift-ca" pod "c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6" (UID: "c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:50:53.369209 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.369181 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-xks-ca\") pod \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\" (UID: \"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6\") " Oct 30 23:50:53.369763 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.369740 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:53.425178 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.417305 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-xks-ca" pod "c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6" (UID: "c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:50:53.425178 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.418271 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-kube-api-access-xhglb" pod "c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6" (UID: "c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6"). InnerVolumeSpecName "kube-api-access-xhglb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:50:53.472781 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.472748 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhglb\" (UniqueName: \"kubernetes.io/projected/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-kube-api-access-xhglb\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:53.472960 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.472942 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:50:53.760658 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.760567 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" event={"ID":"c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6","Type":"ContainerDied","Data":"ba3d4a29d44b7714be26b7431951ff23c8ab87608f3bb206095ad587e60a6f41"} Oct 30 23:50:53.760907 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.760885 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba3d4a29d44b7714be26b7431951ff23c8ab87608f3bb206095ad587e60a6f41" Oct 30 23:50:53.761072 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:53.761059 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e69dd5d-dhqzp" Oct 30 23:50:54.625023 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:54.624993 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:50:54.632787 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:54.632759 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxjlg_0c018322-20cb-470c-ae55-7eaddfbb60ea/ovn-acl-logging/0.log" Oct 30 23:50:58.944030 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:58.943996 6174 scope.go:122] "RemoveContainer" containerID="ee9cb14dfc90caf2b7c4aeb84e3ccc56f38e5ea38f0ff66f641894bb508fa12b" Oct 30 23:50:59.267718 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:50:59.267641 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:50:59.719623 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.719590 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn"] Oct 30 23:50:59.720031 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.720019 6174 cpu_manager.go:414] "containerMap: removing container" podUID="c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6" containerName="revoke-keys" Oct 30 23:50:59.720076 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.720032 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6" containerName="revoke-keys" Oct 30 23:50:59.720108 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.720090 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6" containerName="revoke-keys" Oct 30 23:50:59.723310 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.723294 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:50:59.743283 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.743261 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn"] Oct 30 23:50:59.749720 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.749694 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:50:59.749857 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.749759 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:50:59.749925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.749889 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:50:59.749988 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.749972 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:50:59.808929 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.808904 6174 generic.go:356] "Generic (PLEG): container finished" podID="8879af5d-1f13-4772-b12d-7670aaaf8573" containerID="8929fab6436b7f3effe151673656f5c554ee00e2d8c405bf7b9d004f8386eb89" exitCode=1 Oct 30 23:50:59.809079 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.808977 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" event={"ID":"8879af5d-1f13-4772-b12d-7670aaaf8573","Type":"ContainerDied","Data":"8929fab6436b7f3effe151673656f5c554ee00e2d8c405bf7b9d004f8386eb89"} Oct 30 23:50:59.809079 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.809031 6174 scope.go:122] "RemoveContainer" containerID="ee9cb14dfc90caf2b7c4aeb84e3ccc56f38e5ea38f0ff66f641894bb508fa12b" Oct 30 23:50:59.809337 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.809318 6174 scope.go:122] "RemoveContainer" containerID="8929fab6436b7f3effe151673656f5c554ee00e2d8c405bf7b9d004f8386eb89" Oct 30 23:50:59.809546 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:50:59.809529 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:50:59.860651 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.860628 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-xks-ca\") pod \"maas-api-revoke-sub-562e07cc-dkwzn\" (UID: \"2096f1cd-e228-45fe-bead-8ec47c86a527\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:50:59.860759 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.860665 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-562e07cc-dkwzn\" (UID: \"2096f1cd-e228-45fe-bead-8ec47c86a527\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:50:59.860759 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.860681 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hghcb\" (UniqueName: \"kubernetes.io/projected/2096f1cd-e228-45fe-bead-8ec47c86a527-kube-api-access-hghcb\") pod \"maas-api-revoke-sub-562e07cc-dkwzn\" (UID: \"2096f1cd-e228-45fe-bead-8ec47c86a527\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:50:59.961706 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.961659 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-xks-ca\") pod \"maas-api-revoke-sub-562e07cc-dkwzn\" (UID: \"2096f1cd-e228-45fe-bead-8ec47c86a527\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:50:59.962383 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.961730 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-562e07cc-dkwzn\" (UID: \"2096f1cd-e228-45fe-bead-8ec47c86a527\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:50:59.962383 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.961757 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hghcb\" (UniqueName: \"kubernetes.io/projected/2096f1cd-e228-45fe-bead-8ec47c86a527-kube-api-access-hghcb\") pod \"maas-api-revoke-sub-562e07cc-dkwzn\" (UID: \"2096f1cd-e228-45fe-bead-8ec47c86a527\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:50:59.962482 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.962461 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-562e07cc-dkwzn\" (UID: \"2096f1cd-e228-45fe-bead-8ec47c86a527\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:50:59.964139 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.964117 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-xks-ca\") pod \"maas-api-revoke-sub-562e07cc-dkwzn\" (UID: \"2096f1cd-e228-45fe-bead-8ec47c86a527\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:50:59.983502 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:50:59.983449 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hghcb\" (UniqueName: \"kubernetes.io/projected/2096f1cd-e228-45fe-bead-8ec47c86a527-kube-api-access-hghcb\") pod \"maas-api-revoke-sub-562e07cc-dkwzn\" (UID: \"2096f1cd-e228-45fe-bead-8ec47c86a527\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:51:00.036306 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:00.036278 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:51:00.340842 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:00.340813 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn"] Oct 30 23:51:00.344452 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:51:00.344427 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2096f1cd_e228_45fe_bead_8ec47c86a527.slice/crio-7c1b08f24f0c7e212b76951750086423a74d315fddbbf3733f16907314c4568f WatchSource:0}: Error finding container 7c1b08f24f0c7e212b76951750086423a74d315fddbbf3733f16907314c4568f: Status 404 returned error can't find the container with id 7c1b08f24f0c7e212b76951750086423a74d315fddbbf3733f16907314c4568f Oct 30 23:51:00.817935 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:00.817900 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" event={"ID":"2096f1cd-e228-45fe-bead-8ec47c86a527","Type":"ContainerStarted","Data":"0251da3d5b2241e87235563048c9fbb0338472235868d6c509f3984701fc6a4a"} Oct 30 23:51:00.818076 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:00.817956 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" event={"ID":"2096f1cd-e228-45fe-bead-8ec47c86a527","Type":"ContainerStarted","Data":"7c1b08f24f0c7e212b76951750086423a74d315fddbbf3733f16907314c4568f"} Oct 30 23:51:00.862890 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:00.860913 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" podStartSLOduration=1.8608941300000001 podStartE2EDuration="1.86089413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:50:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:51:00.857220841 +0000 UTC m=+907.067807342" watchObservedRunningTime="2026-10-30 23:51:00.86089413 +0000 UTC m=+907.071480633" Oct 30 23:51:01.827547 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:01.827509 6174 generic.go:356] "Generic (PLEG): container finished" podID="2096f1cd-e228-45fe-bead-8ec47c86a527" containerID="0251da3d5b2241e87235563048c9fbb0338472235868d6c509f3984701fc6a4a" exitCode=0 Oct 30 23:51:01.828378 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:01.827657 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" event={"ID":"2096f1cd-e228-45fe-bead-8ec47c86a527","Type":"ContainerDied","Data":"0251da3d5b2241e87235563048c9fbb0338472235868d6c509f3984701fc6a4a"} Oct 30 23:51:03.607901 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.607627 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:51:03.767180 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.766753 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2096f1cd-e228-45fe-bead-8ec47c86a527-kube-api-access-hghcb\" (UniqueName: \"kubernetes.io/projected/2096f1cd-e228-45fe-bead-8ec47c86a527-kube-api-access-hghcb\") pod \"2096f1cd-e228-45fe-bead-8ec47c86a527\" (UID: \"2096f1cd-e228-45fe-bead-8ec47c86a527\") " Oct 30 23:51:03.767180 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.766820 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-xks-ca\") pod \"2096f1cd-e228-45fe-bead-8ec47c86a527\" (UID: \"2096f1cd-e228-45fe-bead-8ec47c86a527\") " Oct 30 23:51:03.767180 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.766861 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-openshift-ca\") pod \"2096f1cd-e228-45fe-bead-8ec47c86a527\" (UID: \"2096f1cd-e228-45fe-bead-8ec47c86a527\") " Oct 30 23:51:03.786848 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.786812 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-xks-ca" pod "2096f1cd-e228-45fe-bead-8ec47c86a527" (UID: "2096f1cd-e228-45fe-bead-8ec47c86a527"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:51:03.800788 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.800758 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2096f1cd-e228-45fe-bead-8ec47c86a527-kube-api-access-hghcb" pod "2096f1cd-e228-45fe-bead-8ec47c86a527" (UID: "2096f1cd-e228-45fe-bead-8ec47c86a527"). InnerVolumeSpecName "kube-api-access-hghcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:51:03.811219 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.810355 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-openshift-ca" pod "2096f1cd-e228-45fe-bead-8ec47c86a527" (UID: "2096f1cd-e228-45fe-bead-8ec47c86a527"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:51:03.868394 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.868360 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hghcb\" (UniqueName: \"kubernetes.io/projected/2096f1cd-e228-45fe-bead-8ec47c86a527-kube-api-access-hghcb\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:51:03.892239 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.892207 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:51:03.892417 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.892401 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2096f1cd-e228-45fe-bead-8ec47c86a527-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:51:03.903190 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.902283 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" event={"ID":"2096f1cd-e228-45fe-bead-8ec47c86a527","Type":"ContainerDied","Data":"7c1b08f24f0c7e212b76951750086423a74d315fddbbf3733f16907314c4568f"} Oct 30 23:51:03.903190 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.902357 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c1b08f24f0c7e212b76951750086423a74d315fddbbf3733f16907314c4568f" Oct 30 23:51:03.903190 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:03.902446 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-562e07cc-dkwzn" Oct 30 23:51:05.229813 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:05.229776 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:51:05.230260 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:05.229852 6174 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" Oct 30 23:51:05.230331 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:05.230306 6174 scope.go:122] "RemoveContainer" containerID="8929fab6436b7f3effe151673656f5c554ee00e2d8c405bf7b9d004f8386eb89" Oct 30 23:51:05.230631 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:51:05.230604 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:51:11.516041 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:11.516005 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:51:15.526331 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:15.526281 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bdfdz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:51:15.526819 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:15.526448 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" podUID="d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:51:20.603910 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:20.603877 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:51:29.267431 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:51:29.267392 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:51:29.623234 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:29.623202 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:51:38.129679 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:51:38.129650 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:51:59.267577 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:51:59.267537 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:52:09.959889 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:09.959860 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn"] Oct 30 23:52:09.960321 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:09.960303 6174 cpu_manager.go:414] "containerMap: removing container" podUID="2096f1cd-e228-45fe-bead-8ec47c86a527" containerName="revoke-keys" Oct 30 23:52:09.960321 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:09.960316 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2096f1cd-e228-45fe-bead-8ec47c86a527" containerName="revoke-keys" Oct 30 23:52:09.960416 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:09.960405 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="2096f1cd-e228-45fe-bead-8ec47c86a527" containerName="revoke-keys" Oct 30 23:52:09.963747 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:09.963729 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:09.983793 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:09.983768 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn"] Oct 30 23:52:09.992984 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:09.992960 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:52:09.992984 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:09.992963 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:52:09.993185 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:09.993019 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:52:09.993185 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:09.993120 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:52:10.086861 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:10.086833 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-xks-ca\") pod \"maas-api-revoke-sub-36dfae7c-2qxrn\" (UID: \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:10.087010 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:10.086874 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtzwl\" (UniqueName: \"kubernetes.io/projected/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-kube-api-access-dtzwl\") pod \"maas-api-revoke-sub-36dfae7c-2qxrn\" (UID: \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:10.087010 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:10.086893 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-36dfae7c-2qxrn\" (UID: \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:10.187895 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:10.187865 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-xks-ca\") pod \"maas-api-revoke-sub-36dfae7c-2qxrn\" (UID: \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:10.188011 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:10.187905 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzwl\" (UniqueName: \"kubernetes.io/projected/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-kube-api-access-dtzwl\") pod \"maas-api-revoke-sub-36dfae7c-2qxrn\" (UID: \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:10.188011 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:10.187922 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-36dfae7c-2qxrn\" (UID: \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:10.188663 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:10.188636 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-36dfae7c-2qxrn\" (UID: \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:10.190118 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:10.190101 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-xks-ca\") pod \"maas-api-revoke-sub-36dfae7c-2qxrn\" (UID: \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:10.205745 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:10.205725 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtzwl\" (UniqueName: \"kubernetes.io/projected/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-kube-api-access-dtzwl\") pod \"maas-api-revoke-sub-36dfae7c-2qxrn\" (UID: \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:10.275838 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:10.275788 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:10.570617 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:10.570589 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn"] Oct 30 23:52:10.574805 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:52:10.574763 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99bfe7d_ccbf_444a_9f8e_8d31901c8974.slice/crio-2302f281bbb62f25c9e0255ef4a604c998b38e4da1a2e98b35a12e0e8346b846 WatchSource:0}: Error finding container 2302f281bbb62f25c9e0255ef4a604c998b38e4da1a2e98b35a12e0e8346b846: Status 404 returned error can't find the container with id 2302f281bbb62f25c9e0255ef4a604c998b38e4da1a2e98b35a12e0e8346b846 Oct 30 23:52:11.474186 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:11.474141 6174 generic.go:356] "Generic (PLEG): container finished" podID="e99bfe7d-ccbf-444a-9f8e-8d31901c8974" containerID="8b8ff4a17675b2540c838ad434cbd75fbd7ebef7d9f4098eb09b67f47aecd640" exitCode=0 Oct 30 23:52:11.474544 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:11.474197 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" event={"ID":"e99bfe7d-ccbf-444a-9f8e-8d31901c8974","Type":"ContainerDied","Data":"8b8ff4a17675b2540c838ad434cbd75fbd7ebef7d9f4098eb09b67f47aecd640"} Oct 30 23:52:11.474544 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:11.474247 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" event={"ID":"e99bfe7d-ccbf-444a-9f8e-8d31901c8974","Type":"ContainerStarted","Data":"2302f281bbb62f25c9e0255ef4a604c998b38e4da1a2e98b35a12e0e8346b846"} Oct 30 23:52:12.615883 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:12.615860 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:12.716732 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:12.716705 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-openshift-ca\") pod \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\" (UID: \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\") " Oct 30 23:52:12.716877 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:12.716809 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-kube-api-access-dtzwl\" (UniqueName: \"kubernetes.io/projected/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-kube-api-access-dtzwl\") pod \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\" (UID: \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\") " Oct 30 23:52:12.716877 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:12.716852 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-xks-ca\") pod \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\" (UID: \"e99bfe7d-ccbf-444a-9f8e-8d31901c8974\") " Oct 30 23:52:12.717085 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:12.717058 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-openshift-ca" pod "e99bfe7d-ccbf-444a-9f8e-8d31901c8974" (UID: "e99bfe7d-ccbf-444a-9f8e-8d31901c8974"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:52:12.717284 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:12.717262 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:12.718881 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:12.718856 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-kube-api-access-dtzwl" pod "e99bfe7d-ccbf-444a-9f8e-8d31901c8974" (UID: "e99bfe7d-ccbf-444a-9f8e-8d31901c8974"). InnerVolumeSpecName "kube-api-access-dtzwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:52:12.718967 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:12.718921 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-xks-ca" pod "e99bfe7d-ccbf-444a-9f8e-8d31901c8974" (UID: "e99bfe7d-ccbf-444a-9f8e-8d31901c8974"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:52:12.818094 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:12.818067 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtzwl\" (UniqueName: \"kubernetes.io/projected/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-kube-api-access-dtzwl\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:12.818094 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:12.818091 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e99bfe7d-ccbf-444a-9f8e-8d31901c8974-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:13.486285 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:13.486193 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" event={"ID":"e99bfe7d-ccbf-444a-9f8e-8d31901c8974","Type":"ContainerDied","Data":"2302f281bbb62f25c9e0255ef4a604c998b38e4da1a2e98b35a12e0e8346b846"} Oct 30 23:52:13.486285 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:13.486216 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-36dfae7c-2qxrn" Oct 30 23:52:13.486285 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:13.486245 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2302f281bbb62f25c9e0255ef4a604c998b38e4da1a2e98b35a12e0e8346b846" Oct 30 23:52:15.030926 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:15.030888 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5"] Oct 30 23:52:15.041775 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:15.041751 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b86bdf7c-5wds5"] Oct 30 23:52:15.950370 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:15.950338 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef186c46-b922-41ba-a208-4d04dbda53f0" path="/var/lib/kubelet/pods/ef186c46-b922-41ba-a208-4d04dbda53f0/volumes" Oct 30 23:52:20.438294 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.438261 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n"] Oct 30 23:52:20.438686 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.438672 6174 cpu_manager.go:414] "containerMap: removing container" podUID="e99bfe7d-ccbf-444a-9f8e-8d31901c8974" containerName="revoke-keys" Oct 30 23:52:20.438686 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.438683 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e99bfe7d-ccbf-444a-9f8e-8d31901c8974" containerName="revoke-keys" Oct 30 23:52:20.438785 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.438772 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="e99bfe7d-ccbf-444a-9f8e-8d31901c8974" containerName="revoke-keys" Oct 30 23:52:20.442382 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.442362 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:20.469869 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.469841 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:52:20.470118 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.470097 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:52:20.470272 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.470148 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:52:20.470272 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.470194 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:52:20.472399 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.472376 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n"] Oct 30 23:52:20.598178 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.598133 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1c7b9eef-wmp2n\" (UID: \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:20.598178 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.598175 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1c7b9eef-wmp2n\" (UID: \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:20.598360 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.598285 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcl67\" (UniqueName: \"kubernetes.io/projected/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-kube-api-access-qcl67\") pod \"maas-api-revoke-sub-1c7b9eef-wmp2n\" (UID: \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:20.699420 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.699345 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcl67\" (UniqueName: \"kubernetes.io/projected/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-kube-api-access-qcl67\") pod \"maas-api-revoke-sub-1c7b9eef-wmp2n\" (UID: \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:20.699565 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.699458 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1c7b9eef-wmp2n\" (UID: \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:20.699565 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.699480 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1c7b9eef-wmp2n\" (UID: \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:20.700048 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.700031 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1c7b9eef-wmp2n\" (UID: \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:20.701849 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.701825 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1c7b9eef-wmp2n\" (UID: \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:20.717990 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.717965 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcl67\" (UniqueName: \"kubernetes.io/projected/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-kube-api-access-qcl67\") pod \"maas-api-revoke-sub-1c7b9eef-wmp2n\" (UID: \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:20.770007 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.769951 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:20.944231 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:20.944204 6174 scope.go:122] "RemoveContainer" containerID="8929fab6436b7f3effe151673656f5c554ee00e2d8c405bf7b9d004f8386eb89" Oct 30 23:52:20.944447 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:52:20.944426 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:52:21.077373 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:21.077345 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n"] Oct 30 23:52:21.539220 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:21.539183 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" event={"ID":"58844db3-ae5c-403c-afd0-e80fa9ae1cdc","Type":"ContainerStarted","Data":"9be1d9f6702159e13a3072aceea644a3946cf96109843b3590400ca1ace35a73"} Oct 30 23:52:21.539600 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:21.539241 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" event={"ID":"58844db3-ae5c-403c-afd0-e80fa9ae1cdc","Type":"ContainerStarted","Data":"b9b98938d86032ce3bf3fea64d88945e659d20838f8bea1cc02f80768bd0d31f"} Oct 30 23:52:21.578965 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:21.578916 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" podStartSLOduration=1.5789028200000002 podStartE2EDuration="1.57890282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:52:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:52:21.576217545 +0000 UTC m=+987.786804046" watchObservedRunningTime="2026-10-30 23:52:21.57890282 +0000 UTC m=+987.789489321" Oct 30 23:52:22.029639 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:22.029607 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6"] Oct 30 23:52:22.032537 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:22.032510 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7398db7-gzlx6"] Oct 30 23:52:22.545967 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:22.545934 6174 generic.go:356] "Generic (PLEG): container finished" podID="58844db3-ae5c-403c-afd0-e80fa9ae1cdc" containerID="9be1d9f6702159e13a3072aceea644a3946cf96109843b3590400ca1ace35a73" exitCode=0 Oct 30 23:52:22.546397 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:22.546017 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" event={"ID":"58844db3-ae5c-403c-afd0-e80fa9ae1cdc","Type":"ContainerDied","Data":"9be1d9f6702159e13a3072aceea644a3946cf96109843b3590400ca1ace35a73"} Oct 30 23:52:22.827774 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:22.827694 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:52:23.743102 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:23.743075 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:23.836851 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:23.836763 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-xks-ca\") pod \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\" (UID: \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\") " Oct 30 23:52:23.837027 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:23.836864 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-kube-api-access-qcl67\" (UniqueName: \"kubernetes.io/projected/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-kube-api-access-qcl67\") pod \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\" (UID: \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\") " Oct 30 23:52:23.837027 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:23.836928 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-openshift-ca\") pod \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\" (UID: \"58844db3-ae5c-403c-afd0-e80fa9ae1cdc\") " Oct 30 23:52:23.837714 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:23.837659 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-openshift-ca" pod "58844db3-ae5c-403c-afd0-e80fa9ae1cdc" (UID: "58844db3-ae5c-403c-afd0-e80fa9ae1cdc"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:52:23.839604 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:23.839577 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-xks-ca" pod "58844db3-ae5c-403c-afd0-e80fa9ae1cdc" (UID: "58844db3-ae5c-403c-afd0-e80fa9ae1cdc"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:52:23.839854 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:23.839818 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-kube-api-access-qcl67" pod "58844db3-ae5c-403c-afd0-e80fa9ae1cdc" (UID: "58844db3-ae5c-403c-afd0-e80fa9ae1cdc"). InnerVolumeSpecName "kube-api-access-qcl67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:52:23.938858 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:23.938776 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:23.938858 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:23.938815 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcl67\" (UniqueName: \"kubernetes.io/projected/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-kube-api-access-qcl67\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:23.938858 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:23.938833 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/58844db3-ae5c-403c-afd0-e80fa9ae1cdc-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:23.955380 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:23.953842 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c56f7bd-60ce-4810-8031-e28fc469238a" path="/var/lib/kubelet/pods/2c56f7bd-60ce-4810-8031-e28fc469238a/volumes" Oct 30 23:52:24.590442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:24.589514 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" event={"ID":"58844db3-ae5c-403c-afd0-e80fa9ae1cdc","Type":"ContainerDied","Data":"b9b98938d86032ce3bf3fea64d88945e659d20838f8bea1cc02f80768bd0d31f"} Oct 30 23:52:24.590442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:24.589580 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9b98938d86032ce3bf3fea64d88945e659d20838f8bea1cc02f80768bd0d31f" Oct 30 23:52:24.590442 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:24.589665 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c7b9eef-wmp2n" Oct 30 23:52:29.361182 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:52:29.352513 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:52:30.548638 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:30.548597 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bdfdz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:52:30.549371 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:30.549334 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" podUID="d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:52:30.863233 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:30.856319 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp"] Oct 30 23:52:30.867179 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:30.864460 6174 cpu_manager.go:414] "containerMap: removing container" podUID="58844db3-ae5c-403c-afd0-e80fa9ae1cdc" containerName="revoke-keys" Oct 30 23:52:30.867179 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:30.864487 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58844db3-ae5c-403c-afd0-e80fa9ae1cdc" containerName="revoke-keys" Oct 30 23:52:30.867179 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:30.864620 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="58844db3-ae5c-403c-afd0-e80fa9ae1cdc" containerName="revoke-keys" Oct 30 23:52:30.887717 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:30.878468 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp"] Oct 30 23:52:30.887717 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:30.878590 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:30.920200 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:30.911828 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:52:30.945689 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:30.924585 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:52:30.945689 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:30.924708 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:52:30.945689 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:30.924778 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:52:31.034527 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:31.034495 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8197ed26-2sfwp\" (UID: \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:31.034852 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:31.034810 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8197ed26-2sfwp\" (UID: \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:31.035025 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:31.035006 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnb6t\" (UniqueName: \"kubernetes.io/projected/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-kube-api-access-dnb6t\") pod \"maas-api-revoke-sub-8197ed26-2sfwp\" (UID: \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:31.137092 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:31.137009 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8197ed26-2sfwp\" (UID: \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:31.137092 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:31.137063 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8197ed26-2sfwp\" (UID: \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:31.137302 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:31.137092 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnb6t\" (UniqueName: \"kubernetes.io/projected/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-kube-api-access-dnb6t\") pod \"maas-api-revoke-sub-8197ed26-2sfwp\" (UID: \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:31.137781 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:31.137753 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8197ed26-2sfwp\" (UID: \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:31.139373 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:31.139356 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8197ed26-2sfwp\" (UID: \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:31.157308 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:31.157289 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnb6t\" (UniqueName: \"kubernetes.io/projected/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-kube-api-access-dnb6t\") pod \"maas-api-revoke-sub-8197ed26-2sfwp\" (UID: \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:31.273930 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:31.273908 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:31.570047 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:31.570022 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp"] Oct 30 23:52:31.572074 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:52:31.572047 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31f67e4_ba4c_47d3_9c10_c0832ffecd82.slice/crio-86557198d6f27663705016432f24ce72c87d5d47d83aeaa4b2750cda1dc07f02 WatchSource:0}: Error finding container 86557198d6f27663705016432f24ce72c87d5d47d83aeaa4b2750cda1dc07f02: Status 404 returned error can't find the container with id 86557198d6f27663705016432f24ce72c87d5d47d83aeaa4b2750cda1dc07f02 Oct 30 23:52:31.692624 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:31.692590 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" event={"ID":"d31f67e4-ba4c-47d3-9c10-c0832ffecd82","Type":"ContainerStarted","Data":"86557198d6f27663705016432f24ce72c87d5d47d83aeaa4b2750cda1dc07f02"} Oct 30 23:52:32.036640 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:32.036603 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4"] Oct 30 23:52:32.039507 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:32.039481 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-517f1a26-p4fb4"] Oct 30 23:52:32.700323 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:32.700240 6174 generic.go:356] "Generic (PLEG): container finished" podID="d31f67e4-ba4c-47d3-9c10-c0832ffecd82" containerID="bb851efcbcb6c2a64ef57679acbd95c96eb1f2c33ae617fcb56d947ab37280b5" exitCode=0 Oct 30 23:52:32.700673 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:32.700329 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" event={"ID":"d31f67e4-ba4c-47d3-9c10-c0832ffecd82","Type":"ContainerDied","Data":"bb851efcbcb6c2a64ef57679acbd95c96eb1f2c33ae617fcb56d947ab37280b5"} Oct 30 23:52:33.836562 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:33.836538 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:33.949721 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:33.949682 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7cc5a566-ee81-406e-82e4-3263f1fe24ce" path="/var/lib/kubelet/pods/7cc5a566-ee81-406e-82e4-3263f1fe24ce/volumes" Oct 30 23:52:33.962416 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:33.962353 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-openshift-ca\") pod \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\" (UID: \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\") " Oct 30 23:52:33.962542 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:33.962498 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-kube-api-access-dnb6t\" (UniqueName: \"kubernetes.io/projected/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-kube-api-access-dnb6t\") pod \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\" (UID: \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\") " Oct 30 23:52:33.962542 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:33.962525 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-xks-ca\") pod \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\" (UID: \"d31f67e4-ba4c-47d3-9c10-c0832ffecd82\") " Oct 30 23:52:33.962715 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:33.962688 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-openshift-ca" pod "d31f67e4-ba4c-47d3-9c10-c0832ffecd82" (UID: "d31f67e4-ba4c-47d3-9c10-c0832ffecd82"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:52:33.964467 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:33.964445 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-xks-ca" pod "d31f67e4-ba4c-47d3-9c10-c0832ffecd82" (UID: "d31f67e4-ba4c-47d3-9c10-c0832ffecd82"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:52:33.964580 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:33.964534 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-kube-api-access-dnb6t" pod "d31f67e4-ba4c-47d3-9c10-c0832ffecd82" (UID: "d31f67e4-ba4c-47d3-9c10-c0832ffecd82"). InnerVolumeSpecName "kube-api-access-dnb6t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:52:34.064220 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:34.064190 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnb6t\" (UniqueName: \"kubernetes.io/projected/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-kube-api-access-dnb6t\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:34.064220 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:34.064213 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:34.064220 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:34.064223 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d31f67e4-ba4c-47d3-9c10-c0832ffecd82-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:34.712114 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:34.712082 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" event={"ID":"d31f67e4-ba4c-47d3-9c10-c0832ffecd82","Type":"ContainerDied","Data":"86557198d6f27663705016432f24ce72c87d5d47d83aeaa4b2750cda1dc07f02"} Oct 30 23:52:34.712114 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:34.712111 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8197ed26-2sfwp" Oct 30 23:52:34.712334 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:34.712129 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86557198d6f27663705016432f24ce72c87d5d47d83aeaa4b2750cda1dc07f02" Oct 30 23:52:41.222831 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.222798 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5"] Oct 30 23:52:41.223251 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.223237 6174 cpu_manager.go:414] "containerMap: removing container" podUID="d31f67e4-ba4c-47d3-9c10-c0832ffecd82" containerName="revoke-keys" Oct 30 23:52:41.223302 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.223251 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d31f67e4-ba4c-47d3-9c10-c0832ffecd82" containerName="revoke-keys" Oct 30 23:52:41.223334 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.223316 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="d31f67e4-ba4c-47d3-9c10-c0832ffecd82" containerName="revoke-keys" Oct 30 23:52:41.226422 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.226406 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:41.240981 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.240961 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:52:41.241076 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.241046 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:52:41.252993 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.252969 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:52:41.252993 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.252989 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:52:41.255336 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.255318 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5"] Oct 30 23:52:41.337202 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.337175 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h9p2\" (UniqueName: \"kubernetes.io/projected/78bd3c9a-bc7a-4289-a868-120262214909-kube-api-access-4h9p2\") pod \"maas-api-revoke-sub-6f5cdd5d-ntpn5\" (UID: \"78bd3c9a-bc7a-4289-a868-120262214909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:41.337317 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.337235 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6f5cdd5d-ntpn5\" (UID: \"78bd3c9a-bc7a-4289-a868-120262214909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:41.337365 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.337346 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6f5cdd5d-ntpn5\" (UID: \"78bd3c9a-bc7a-4289-a868-120262214909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:41.437810 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.437779 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6f5cdd5d-ntpn5\" (UID: \"78bd3c9a-bc7a-4289-a868-120262214909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:41.437972 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.437847 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6f5cdd5d-ntpn5\" (UID: \"78bd3c9a-bc7a-4289-a868-120262214909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:41.437972 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.437885 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h9p2\" (UniqueName: \"kubernetes.io/projected/78bd3c9a-bc7a-4289-a868-120262214909-kube-api-access-4h9p2\") pod \"maas-api-revoke-sub-6f5cdd5d-ntpn5\" (UID: \"78bd3c9a-bc7a-4289-a868-120262214909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:41.438541 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.438512 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6f5cdd5d-ntpn5\" (UID: \"78bd3c9a-bc7a-4289-a868-120262214909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:41.440138 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.440110 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6f5cdd5d-ntpn5\" (UID: \"78bd3c9a-bc7a-4289-a868-120262214909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:41.457382 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.457360 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h9p2\" (UniqueName: \"kubernetes.io/projected/78bd3c9a-bc7a-4289-a868-120262214909-kube-api-access-4h9p2\") pod \"maas-api-revoke-sub-6f5cdd5d-ntpn5\" (UID: \"78bd3c9a-bc7a-4289-a868-120262214909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:41.538765 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.538744 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:41.840686 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:41.840603 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5"] Oct 30 23:52:41.844409 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:52:41.844380 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78bd3c9a_bc7a_4289_a868_120262214909.slice/crio-98aa1874016e378b23e525d21c7ebf5c4d4916b40c03641ca2bbb9083f90b469 WatchSource:0}: Error finding container 98aa1874016e378b23e525d21c7ebf5c4d4916b40c03641ca2bbb9083f90b469: Status 404 returned error can't find the container with id 98aa1874016e378b23e525d21c7ebf5c4d4916b40c03641ca2bbb9083f90b469 Oct 30 23:52:42.756829 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:42.756800 6174 generic.go:356] "Generic (PLEG): container finished" podID="78bd3c9a-bc7a-4289-a868-120262214909" containerID="5cd3feb044b6fb2d54c9aa23e170a769c830bcb9c5188411330cd846c0b52523" exitCode=0 Oct 30 23:52:42.757235 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:42.756893 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" event={"ID":"78bd3c9a-bc7a-4289-a868-120262214909","Type":"ContainerDied","Data":"5cd3feb044b6fb2d54c9aa23e170a769c830bcb9c5188411330cd846c0b52523"} Oct 30 23:52:42.757235 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:42.756959 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" event={"ID":"78bd3c9a-bc7a-4289-a868-120262214909","Type":"ContainerStarted","Data":"98aa1874016e378b23e525d21c7ebf5c4d4916b40c03641ca2bbb9083f90b469"} Oct 30 23:52:43.027636 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:43.027553 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z"] Oct 30 23:52:43.030746 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:43.030717 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-932ad867-vqq8z"] Oct 30 23:52:43.953924 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:43.953884 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e" path="/var/lib/kubelet/pods/9bb0a6e7-a419-4076-9f4d-7f44aa9aa25e/volumes" Oct 30 23:52:43.994649 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:43.994609 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:44.168234 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:44.168198 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-xks-ca\") pod \"78bd3c9a-bc7a-4289-a868-120262214909\" (UID: \"78bd3c9a-bc7a-4289-a868-120262214909\") " Oct 30 23:52:44.168433 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:44.168284 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/78bd3c9a-bc7a-4289-a868-120262214909-kube-api-access-4h9p2\" (UniqueName: \"kubernetes.io/projected/78bd3c9a-bc7a-4289-a868-120262214909-kube-api-access-4h9p2\") pod \"78bd3c9a-bc7a-4289-a868-120262214909\" (UID: \"78bd3c9a-bc7a-4289-a868-120262214909\") " Oct 30 23:52:44.168433 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:44.168394 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-openshift-ca\") pod \"78bd3c9a-bc7a-4289-a868-120262214909\" (UID: \"78bd3c9a-bc7a-4289-a868-120262214909\") " Oct 30 23:52:44.169397 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:44.169351 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-openshift-ca" pod "78bd3c9a-bc7a-4289-a868-120262214909" (UID: "78bd3c9a-bc7a-4289-a868-120262214909"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:52:44.173906 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:44.171515 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78bd3c9a-bc7a-4289-a868-120262214909-kube-api-access-4h9p2" pod "78bd3c9a-bc7a-4289-a868-120262214909" (UID: "78bd3c9a-bc7a-4289-a868-120262214909"). InnerVolumeSpecName "kube-api-access-4h9p2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:52:44.173906 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:44.173855 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-xks-ca" pod "78bd3c9a-bc7a-4289-a868-120262214909" (UID: "78bd3c9a-bc7a-4289-a868-120262214909"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:52:44.277941 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:44.277847 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:44.277941 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:44.277882 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/78bd3c9a-bc7a-4289-a868-120262214909-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:44.277941 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:44.277901 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h9p2\" (UniqueName: \"kubernetes.io/projected/78bd3c9a-bc7a-4289-a868-120262214909-kube-api-access-4h9p2\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:44.803776 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:44.803738 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" event={"ID":"78bd3c9a-bc7a-4289-a868-120262214909","Type":"ContainerDied","Data":"98aa1874016e378b23e525d21c7ebf5c4d4916b40c03641ca2bbb9083f90b469"} Oct 30 23:52:44.804082 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:44.804060 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98aa1874016e378b23e525d21c7ebf5c4d4916b40c03641ca2bbb9083f90b469" Oct 30 23:52:44.804283 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:44.804267 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f5cdd5d-ntpn5" Oct 30 23:52:45.527182 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:45.526267 6174 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f5667f86c-bdfdz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 23:52:45.527182 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:45.526332 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f5667f86c-bdfdz" podUID="d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 23:52:51.587152 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.587116 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5"] Oct 30 23:52:51.587805 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.587783 6174 cpu_manager.go:414] "containerMap: removing container" podUID="78bd3c9a-bc7a-4289-a868-120262214909" containerName="revoke-keys" Oct 30 23:52:51.587874 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.587809 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="78bd3c9a-bc7a-4289-a868-120262214909" containerName="revoke-keys" Oct 30 23:52:51.587983 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.587961 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="78bd3c9a-bc7a-4289-a868-120262214909" containerName="revoke-keys" Oct 30 23:52:51.591398 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.591382 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:51.609684 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.609654 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5"] Oct 30 23:52:51.618800 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.618778 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:52:51.618915 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.618811 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:52:51.618915 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.618811 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:52:51.618915 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.618841 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:52:51.731462 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.731432 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e099064c-jvvg5\" (UID: \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:51.731574 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.731470 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e099064c-jvvg5\" (UID: \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:51.731574 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.731493 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf28j\" (UniqueName: \"kubernetes.io/projected/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-kube-api-access-bf28j\") pod \"maas-api-revoke-sub-e099064c-jvvg5\" (UID: \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:51.832939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.832900 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e099064c-jvvg5\" (UID: \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:51.832939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.832944 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e099064c-jvvg5\" (UID: \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:51.833134 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.832966 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf28j\" (UniqueName: \"kubernetes.io/projected/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-kube-api-access-bf28j\") pod \"maas-api-revoke-sub-e099064c-jvvg5\" (UID: \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:51.833701 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.833674 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e099064c-jvvg5\" (UID: \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:51.835344 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.835317 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e099064c-jvvg5\" (UID: \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:51.851648 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.851593 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf28j\" (UniqueName: \"kubernetes.io/projected/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-kube-api-access-bf28j\") pod \"maas-api-revoke-sub-e099064c-jvvg5\" (UID: \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:51.904132 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:51.904090 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:52.202262 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:52.202187 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5"] Oct 30 23:52:52.205505 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:52:52.205474 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c1ec17_27d3_40e0_bd20_fb86ea14f55e.slice/crio-3451610aefdb6e50d61d9100aa00f842121c10e088936c6c9fb4db37aff3cfbe WatchSource:0}: Error finding container 3451610aefdb6e50d61d9100aa00f842121c10e088936c6c9fb4db37aff3cfbe: Status 404 returned error can't find the container with id 3451610aefdb6e50d61d9100aa00f842121c10e088936c6c9fb4db37aff3cfbe Oct 30 23:52:52.893521 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:52.893487 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" event={"ID":"40c1ec17-27d3-40e0-bd20-fb86ea14f55e","Type":"ContainerStarted","Data":"38b2664cd0a40f0850786143de7440ffa22559dd43f2ba676cd344cafbfa9903"} Oct 30 23:52:52.893981 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:52.893535 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" event={"ID":"40c1ec17-27d3-40e0-bd20-fb86ea14f55e","Type":"ContainerStarted","Data":"3451610aefdb6e50d61d9100aa00f842121c10e088936c6c9fb4db37aff3cfbe"} Oct 30 23:52:52.932254 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:52.932204 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" podStartSLOduration=1.932192736 podStartE2EDuration="1.932192736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:52:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:52:52.930953849 +0000 UTC m=+1019.141540350" watchObservedRunningTime="2026-10-30 23:52:52.932192736 +0000 UTC m=+1019.142779234" Oct 30 23:52:53.903850 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:53.903812 6174 generic.go:356] "Generic (PLEG): container finished" podID="40c1ec17-27d3-40e0-bd20-fb86ea14f55e" containerID="38b2664cd0a40f0850786143de7440ffa22559dd43f2ba676cd344cafbfa9903" exitCode=0 Oct 30 23:52:53.904401 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:53.903995 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" event={"ID":"40c1ec17-27d3-40e0-bd20-fb86ea14f55e","Type":"ContainerDied","Data":"38b2664cd0a40f0850786143de7440ffa22559dd43f2ba676cd344cafbfa9903"} Oct 30 23:52:54.033307 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:54.033270 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l"] Oct 30 23:52:54.039426 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:54.039395 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b8b4d0dd-65v5l"] Oct 30 23:52:55.556021 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:55.555986 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:55.757665 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:55.757555 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-xks-ca\") pod \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\" (UID: \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\") " Oct 30 23:52:55.758026 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:55.757987 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-kube-api-access-bf28j\" (UniqueName: \"kubernetes.io/projected/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-kube-api-access-bf28j\") pod \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\" (UID: \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\") " Oct 30 23:52:55.762574 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:55.762544 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-openshift-ca\") pod \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\" (UID: \"40c1ec17-27d3-40e0-bd20-fb86ea14f55e\") " Oct 30 23:52:55.768732 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:55.768692 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-openshift-ca" pod "40c1ec17-27d3-40e0-bd20-fb86ea14f55e" (UID: "40c1ec17-27d3-40e0-bd20-fb86ea14f55e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:52:55.800371 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:55.790329 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-xks-ca" pod "40c1ec17-27d3-40e0-bd20-fb86ea14f55e" (UID: "40c1ec17-27d3-40e0-bd20-fb86ea14f55e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:52:55.811483 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:55.811452 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-kube-api-access-bf28j" pod "40c1ec17-27d3-40e0-bd20-fb86ea14f55e" (UID: "40c1ec17-27d3-40e0-bd20-fb86ea14f55e"). InnerVolumeSpecName "kube-api-access-bf28j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:52:55.870786 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:55.870754 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf28j\" (UniqueName: \"kubernetes.io/projected/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-kube-api-access-bf28j\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:55.870968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:55.870952 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:55.871078 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:55.871065 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/40c1ec17-27d3-40e0-bd20-fb86ea14f55e-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:52:56.027230 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:56.010032 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="715e1e0e-f577-45b0-b774-7808363c1c87" path="/var/lib/kubelet/pods/715e1e0e-f577-45b0-b774-7808363c1c87/volumes" Oct 30 23:52:56.036685 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:56.036654 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" event={"ID":"40c1ec17-27d3-40e0-bd20-fb86ea14f55e","Type":"ContainerDied","Data":"3451610aefdb6e50d61d9100aa00f842121c10e088936c6c9fb4db37aff3cfbe"} Oct 30 23:52:56.036870 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:56.036855 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3451610aefdb6e50d61d9100aa00f842121c10e088936c6c9fb4db37aff3cfbe" Oct 30 23:52:56.037040 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:52:56.037027 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e099064c-jvvg5" Oct 30 23:52:59.267187 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:52:59.267127 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:53:03.326496 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:03.326464 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:53:07.270349 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.270300 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj"] Oct 30 23:53:07.271609 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.271581 6174 cpu_manager.go:414] "containerMap: removing container" podUID="40c1ec17-27d3-40e0-bd20-fb86ea14f55e" containerName="revoke-keys" Oct 30 23:53:07.272573 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.272528 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40c1ec17-27d3-40e0-bd20-fb86ea14f55e" containerName="revoke-keys" Oct 30 23:53:07.272839 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.272825 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="40c1ec17-27d3-40e0-bd20-fb86ea14f55e" containerName="revoke-keys" Oct 30 23:53:07.282772 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.282747 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:07.313492 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.313465 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:53:07.319200 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.314804 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:53:07.319345 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.314854 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:53:07.319445 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.314911 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:53:07.324601 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.324581 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj"] Oct 30 23:53:07.416185 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.416087 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj\" (UID: \"9fa02fb0-fbc5-4411-992d-45607f9b8391\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:07.416185 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.416189 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl2nh\" (UniqueName: \"kubernetes.io/projected/9fa02fb0-fbc5-4411-992d-45607f9b8391-kube-api-access-rl2nh\") pod \"maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj\" (UID: \"9fa02fb0-fbc5-4411-992d-45607f9b8391\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:07.416457 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.416366 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj\" (UID: \"9fa02fb0-fbc5-4411-992d-45607f9b8391\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:07.517132 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.517092 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj\" (UID: \"9fa02fb0-fbc5-4411-992d-45607f9b8391\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:07.517384 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.517150 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj\" (UID: \"9fa02fb0-fbc5-4411-992d-45607f9b8391\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:07.517384 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.517226 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl2nh\" (UniqueName: \"kubernetes.io/projected/9fa02fb0-fbc5-4411-992d-45607f9b8391-kube-api-access-rl2nh\") pod \"maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj\" (UID: \"9fa02fb0-fbc5-4411-992d-45607f9b8391\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:07.517905 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.517880 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj\" (UID: \"9fa02fb0-fbc5-4411-992d-45607f9b8391\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:07.519474 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.519448 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj\" (UID: \"9fa02fb0-fbc5-4411-992d-45607f9b8391\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:07.537059 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.537036 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl2nh\" (UniqueName: \"kubernetes.io/projected/9fa02fb0-fbc5-4411-992d-45607f9b8391-kube-api-access-rl2nh\") pod \"maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj\" (UID: \"9fa02fb0-fbc5-4411-992d-45607f9b8391\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:07.640586 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.640558 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:07.959390 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:07.959309 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj"] Oct 30 23:53:07.963389 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:53:07.963362 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa02fb0_fbc5_4411_992d_45607f9b8391.slice/crio-72cc97a228c99c6183f1d72731df67374213c38baba49593af12866d58f3214a WatchSource:0}: Error finding container 72cc97a228c99c6183f1d72731df67374213c38baba49593af12866d58f3214a: Status 404 returned error can't find the container with id 72cc97a228c99c6183f1d72731df67374213c38baba49593af12866d58f3214a Oct 30 23:53:08.228244 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:08.228139 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" event={"ID":"9fa02fb0-fbc5-4411-992d-45607f9b8391","Type":"ContainerStarted","Data":"6f41b3df8d5a02e4c4431a303a35f15d34665708d02a23b370ded232065d7401"} Oct 30 23:53:08.228244 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:08.228221 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" event={"ID":"9fa02fb0-fbc5-4411-992d-45607f9b8391","Type":"ContainerStarted","Data":"72cc97a228c99c6183f1d72731df67374213c38baba49593af12866d58f3214a"} Oct 30 23:53:08.269751 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:08.269704 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" podStartSLOduration=1.269690022 podStartE2EDuration="1.269690022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:53:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:53:08.26861597 +0000 UTC m=+1034.479202470" watchObservedRunningTime="2026-10-30 23:53:08.269690022 +0000 UTC m=+1034.480276522" Oct 30 23:53:09.248339 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:09.248245 6174 generic.go:356] "Generic (PLEG): container finished" podID="9fa02fb0-fbc5-4411-992d-45607f9b8391" containerID="6f41b3df8d5a02e4c4431a303a35f15d34665708d02a23b370ded232065d7401" exitCode=0 Oct 30 23:53:09.248984 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:09.248956 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" event={"ID":"9fa02fb0-fbc5-4411-992d-45607f9b8391","Type":"ContainerDied","Data":"6f41b3df8d5a02e4c4431a303a35f15d34665708d02a23b370ded232065d7401"} Oct 30 23:53:10.646917 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:10.646890 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:10.712775 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:10.712740 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fa02fb0-fbc5-4411-992d-45607f9b8391-kube-api-access-rl2nh\" (UniqueName: \"kubernetes.io/projected/9fa02fb0-fbc5-4411-992d-45607f9b8391-kube-api-access-rl2nh\") pod \"9fa02fb0-fbc5-4411-992d-45607f9b8391\" (UID: \"9fa02fb0-fbc5-4411-992d-45607f9b8391\") " Oct 30 23:53:10.712947 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:10.712923 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-xks-ca\") pod \"9fa02fb0-fbc5-4411-992d-45607f9b8391\" (UID: \"9fa02fb0-fbc5-4411-992d-45607f9b8391\") " Oct 30 23:53:10.713033 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:10.713016 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-openshift-ca\") pod \"9fa02fb0-fbc5-4411-992d-45607f9b8391\" (UID: \"9fa02fb0-fbc5-4411-992d-45607f9b8391\") " Oct 30 23:53:10.713438 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:10.713406 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-openshift-ca" pod "9fa02fb0-fbc5-4411-992d-45607f9b8391" (UID: "9fa02fb0-fbc5-4411-992d-45607f9b8391"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:53:10.713795 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:10.713774 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:10.715092 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:10.715058 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa02fb0-fbc5-4411-992d-45607f9b8391-kube-api-access-rl2nh" pod "9fa02fb0-fbc5-4411-992d-45607f9b8391" (UID: "9fa02fb0-fbc5-4411-992d-45607f9b8391"). InnerVolumeSpecName "kube-api-access-rl2nh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:53:10.715668 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:10.715638 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-xks-ca" pod "9fa02fb0-fbc5-4411-992d-45607f9b8391" (UID: "9fa02fb0-fbc5-4411-992d-45607f9b8391"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:53:10.814843 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:10.814810 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9fa02fb0-fbc5-4411-992d-45607f9b8391-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:10.814843 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:10.814839 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl2nh\" (UniqueName: \"kubernetes.io/projected/9fa02fb0-fbc5-4411-992d-45607f9b8391-kube-api-access-rl2nh\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:11.265987 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:11.265956 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" Oct 30 23:53:11.265987 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:11.265961 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj" event={"ID":"9fa02fb0-fbc5-4411-992d-45607f9b8391","Type":"ContainerDied","Data":"72cc97a228c99c6183f1d72731df67374213c38baba49593af12866d58f3214a"} Oct 30 23:53:11.266229 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:11.266036 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72cc97a228c99c6183f1d72731df67374213c38baba49593af12866d58f3214a" Oct 30 23:53:13.332257 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:13.332225 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:53:17.778931 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:17.778895 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w"] Oct 30 23:53:17.812680 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:17.812654 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm"] Oct 30 23:53:21.130120 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:21.130081 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:53:22.780242 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:22.780201 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" podUID="30a3cc5b-6ced-488a-b7c7-dc6178930228" containerName="payload-processing" containerID="cri-o://5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9" gracePeriod=25 Oct 30 23:53:22.813206 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:22.813179 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" podUID="2b76f319-60e2-4d6c-9802-c93c82082533" containerName="payload-pre-processing" containerID="cri-o://4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb" gracePeriod=25 Oct 30 23:53:23.099021 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.098976 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj"] Oct 30 23:53:23.101311 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.101273 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" Oct 30 23:53:23.105348 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.105319 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-8d2ae1-pm8wj"] Oct 30 23:53:23.109026 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.109005 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" Oct 30 23:53:23.152924 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.152900 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30a3cc5b-6ced-488a-b7c7-dc6178930228-kube-api-access-bs4h7\" (UniqueName: \"kubernetes.io/projected/30a3cc5b-6ced-488a-b7c7-dc6178930228-kube-api-access-bs4h7\") pod \"30a3cc5b-6ced-488a-b7c7-dc6178930228\" (UID: \"30a3cc5b-6ced-488a-b7c7-dc6178930228\") " Oct 30 23:53:23.153039 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.152948 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/30a3cc5b-6ced-488a-b7c7-dc6178930228-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30a3cc5b-6ced-488a-b7c7-dc6178930228-plugins-config-volume\") pod \"30a3cc5b-6ced-488a-b7c7-dc6178930228\" (UID: \"30a3cc5b-6ced-488a-b7c7-dc6178930228\") " Oct 30 23:53:23.153499 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.153477 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30a3cc5b-6ced-488a-b7c7-dc6178930228-plugins-config-volume" pod "30a3cc5b-6ced-488a-b7c7-dc6178930228" (UID: "30a3cc5b-6ced-488a-b7c7-dc6178930228"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:53:23.155367 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.155343 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30a3cc5b-6ced-488a-b7c7-dc6178930228-kube-api-access-bs4h7" pod "30a3cc5b-6ced-488a-b7c7-dc6178930228" (UID: "30a3cc5b-6ced-488a-b7c7-dc6178930228"). InnerVolumeSpecName "kube-api-access-bs4h7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:53:23.253833 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.253800 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b76f319-60e2-4d6c-9802-c93c82082533-kube-api-access-b2vdk\" (UniqueName: \"kubernetes.io/projected/2b76f319-60e2-4d6c-9802-c93c82082533-kube-api-access-b2vdk\") pod \"2b76f319-60e2-4d6c-9802-c93c82082533\" (UID: \"2b76f319-60e2-4d6c-9802-c93c82082533\") " Oct 30 23:53:23.254027 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.254002 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b76f319-60e2-4d6c-9802-c93c82082533-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b76f319-60e2-4d6c-9802-c93c82082533-plugins-config-volume\") pod \"2b76f319-60e2-4d6c-9802-c93c82082533\" (UID: \"2b76f319-60e2-4d6c-9802-c93c82082533\") " Oct 30 23:53:23.254247 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.254230 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs4h7\" (UniqueName: \"kubernetes.io/projected/30a3cc5b-6ced-488a-b7c7-dc6178930228-kube-api-access-bs4h7\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:23.254247 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.254247 6174 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30a3cc5b-6ced-488a-b7c7-dc6178930228-plugins-config-volume\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:23.254386 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.254362 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b76f319-60e2-4d6c-9802-c93c82082533-plugins-config-volume" pod "2b76f319-60e2-4d6c-9802-c93c82082533" (UID: "2b76f319-60e2-4d6c-9802-c93c82082533"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:53:23.255905 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.255879 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b76f319-60e2-4d6c-9802-c93c82082533-kube-api-access-b2vdk" pod "2b76f319-60e2-4d6c-9802-c93c82082533" (UID: "2b76f319-60e2-4d6c-9802-c93c82082533"). InnerVolumeSpecName "kube-api-access-b2vdk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:53:23.334177 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.334092 6174 generic.go:356] "Generic (PLEG): container finished" podID="2b76f319-60e2-4d6c-9802-c93c82082533" containerID="4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb" exitCode=0 Oct 30 23:53:23.334177 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.334139 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" Oct 30 23:53:23.334327 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.334187 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" event={"ID":"2b76f319-60e2-4d6c-9802-c93c82082533","Type":"ContainerDied","Data":"4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb"} Oct 30 23:53:23.334327 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.334235 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm" event={"ID":"2b76f319-60e2-4d6c-9802-c93c82082533","Type":"ContainerDied","Data":"12435d6b7425d022dc8fe9ca58b5954eee27900c3cc85e404c1a37723bbcd0da"} Oct 30 23:53:23.334327 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.334259 6174 scope.go:122] "RemoveContainer" containerID="4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb" Oct 30 23:53:23.335585 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.335560 6174 generic.go:356] "Generic (PLEG): container finished" podID="30a3cc5b-6ced-488a-b7c7-dc6178930228" containerID="5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9" exitCode=0 Oct 30 23:53:23.335678 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.335607 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" Oct 30 23:53:23.335678 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.335648 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" event={"ID":"30a3cc5b-6ced-488a-b7c7-dc6178930228","Type":"ContainerDied","Data":"5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9"} Oct 30 23:53:23.335787 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.335701 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w" event={"ID":"30a3cc5b-6ced-488a-b7c7-dc6178930228","Type":"ContainerDied","Data":"2e8bb7df8fc1bcc37e403e4f0209abb5120dbdf23afbd19ada0d5ee127063bea"} Oct 30 23:53:23.343939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.343250 6174 scope.go:122] "RemoveContainer" containerID="4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb" Oct 30 23:53:23.343939 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:53:23.343602 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb\": container with ID starting with 4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb not found: ID does not exist" containerID="4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb" Oct 30 23:53:23.343939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.343646 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb"} err="failed to get container status \"4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb\": rpc error: code = NotFound desc = could not find container \"4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb\": container with ID starting with 4ffe92e04fa61e1fff7257d5a1145c7d42daaf68196a34ee126bcff2293d03bb not found: ID does not exist" Oct 30 23:53:23.343939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.343666 6174 scope.go:122] "RemoveContainer" containerID="5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9" Oct 30 23:53:23.352526 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.352512 6174 scope.go:122] "RemoveContainer" containerID="5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9" Oct 30 23:53:23.352780 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:53:23.352763 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9\": container with ID starting with 5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9 not found: ID does not exist" containerID="5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9" Oct 30 23:53:23.352840 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.352786 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9"} err="failed to get container status \"5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9\": rpc error: code = NotFound desc = could not find container \"5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9\": container with ID starting with 5d00bfed22be475d821fcf2f54f4dc8a98843b2905de1a0c24f9a216f51a3cc9 not found: ID does not exist" Oct 30 23:53:23.355324 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.355306 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2vdk\" (UniqueName: \"kubernetes.io/projected/2b76f319-60e2-4d6c-9802-c93c82082533-kube-api-access-b2vdk\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:23.355373 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.355326 6174 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b76f319-60e2-4d6c-9802-c93c82082533-plugins-config-volume\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:23.386872 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.386850 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w"] Oct 30 23:53:23.393336 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.393317 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-8d2ae1-7f88fcf466-q965w"] Oct 30 23:53:23.426527 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.426505 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm"] Oct 30 23:53:23.430743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.430718 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-8d2ae1-6d5b87d699cbrzm"] Oct 30 23:53:23.950565 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.950535 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b76f319-60e2-4d6c-9802-c93c82082533" path="/var/lib/kubelet/pods/2b76f319-60e2-4d6c-9802-c93c82082533/volumes" Oct 30 23:53:23.950910 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.950902 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="30a3cc5b-6ced-488a-b7c7-dc6178930228" path="/var/lib/kubelet/pods/30a3cc5b-6ced-488a-b7c7-dc6178930228/volumes" Oct 30 23:53:23.951295 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:23.951281 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9fa02fb0-fbc5-4411-992d-45607f9b8391" path="/var/lib/kubelet/pods/9fa02fb0-fbc5-4411-992d-45607f9b8391/volumes" Oct 30 23:53:29.268994 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:53:29.268960 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:53:29.729877 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:29.729842 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd"] Oct 30 23:53:29.730224 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:29.730137 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerName="istio-proxy" containerID="cri-o://7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919" gracePeriod=30 Oct 30 23:53:30.341607 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.341573 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5"] Oct 30 23:53:30.341985 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.341973 6174 cpu_manager.go:414] "containerMap: removing container" podUID="30a3cc5b-6ced-488a-b7c7-dc6178930228" containerName="payload-processing" Oct 30 23:53:30.341985 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.341984 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30a3cc5b-6ced-488a-b7c7-dc6178930228" containerName="payload-processing" Oct 30 23:53:30.342057 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.342002 6174 cpu_manager.go:414] "containerMap: removing container" podUID="2b76f319-60e2-4d6c-9802-c93c82082533" containerName="payload-pre-processing" Oct 30 23:53:30.342057 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.342008 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b76f319-60e2-4d6c-9802-c93c82082533" containerName="payload-pre-processing" Oct 30 23:53:30.342057 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.342027 6174 cpu_manager.go:414] "containerMap: removing container" podUID="9fa02fb0-fbc5-4411-992d-45607f9b8391" containerName="revoke-keys" Oct 30 23:53:30.342057 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.342031 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fa02fb0-fbc5-4411-992d-45607f9b8391" containerName="revoke-keys" Oct 30 23:53:30.342219 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.342098 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fa02fb0-fbc5-4411-992d-45607f9b8391" containerName="revoke-keys" Oct 30 23:53:30.342219 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.342109 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="30a3cc5b-6ced-488a-b7c7-dc6178930228" containerName="payload-processing" Oct 30 23:53:30.342219 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.342116 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b76f319-60e2-4d6c-9802-c93c82082533" containerName="payload-pre-processing" Oct 30 23:53:30.346629 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.346611 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:30.362955 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.362906 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 23:53:30.362955 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.362926 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 23:53:30.363181 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.363045 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 23:53:30.363181 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.363083 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hx8l4\"" Oct 30 23:53:30.365889 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.365863 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5"] Oct 30 23:53:30.429706 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.429675 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5\" (UID: \"a46f53db-2221-442e-86ab-395d2bffd81a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:30.429867 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.429714 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hhxv\" (UniqueName: \"kubernetes.io/projected/a46f53db-2221-442e-86ab-395d2bffd81a-kube-api-access-5hhxv\") pod \"maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5\" (UID: \"a46f53db-2221-442e-86ab-395d2bffd81a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:30.429867 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.429839 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5\" (UID: \"a46f53db-2221-442e-86ab-395d2bffd81a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:30.531067 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.531034 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5\" (UID: \"a46f53db-2221-442e-86ab-395d2bffd81a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:30.531252 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.531128 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5\" (UID: \"a46f53db-2221-442e-86ab-395d2bffd81a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:30.531252 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.531173 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hhxv\" (UniqueName: \"kubernetes.io/projected/a46f53db-2221-442e-86ab-395d2bffd81a-kube-api-access-5hhxv\") pod \"maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5\" (UID: \"a46f53db-2221-442e-86ab-395d2bffd81a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:30.531706 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.531677 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5\" (UID: \"a46f53db-2221-442e-86ab-395d2bffd81a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:30.533431 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.533414 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5\" (UID: \"a46f53db-2221-442e-86ab-395d2bffd81a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:30.550534 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.550512 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hhxv\" (UniqueName: \"kubernetes.io/projected/a46f53db-2221-442e-86ab-395d2bffd81a-kube-api-access-5hhxv\") pod \"maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5\" (UID: \"a46f53db-2221-442e-86ab-395d2bffd81a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:30.659493 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.659426 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:30.958030 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:30.957958 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5"] Oct 30 23:53:30.961369 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:53:30.961342 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46f53db_2221_442e_86ab_395d2bffd81a.slice/crio-1579d7185aa9438af942c577ac7bd438e91bbcefe07f0d3e665be519fbafa3af WatchSource:0}: Error finding container 1579d7185aa9438af942c577ac7bd438e91bbcefe07f0d3e665be519fbafa3af: Status 404 returned error can't find the container with id 1579d7185aa9438af942c577ac7bd438e91bbcefe07f0d3e665be519fbafa3af Oct 30 23:53:31.391805 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:31.391773 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" event={"ID":"a46f53db-2221-442e-86ab-395d2bffd81a","Type":"ContainerStarted","Data":"61b53c8aa78ab19bd1322a187ed3c4f6a48f9c1abf20224dae8b26eb920430cc"} Oct 30 23:53:31.392188 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:31.391825 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" event={"ID":"a46f53db-2221-442e-86ab-395d2bffd81a","Type":"ContainerStarted","Data":"1579d7185aa9438af942c577ac7bd438e91bbcefe07f0d3e665be519fbafa3af"} Oct 30 23:53:31.431688 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:31.431571 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" podStartSLOduration=1.431559097 podStartE2EDuration="1.431559097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:53:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:53:31.430505056 +0000 UTC m=+1057.641091556" watchObservedRunningTime="2026-10-30 23:53:31.431559097 +0000 UTC m=+1057.642145625" Oct 30 23:53:32.399023 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:32.398989 6174 generic.go:356] "Generic (PLEG): container finished" podID="a46f53db-2221-442e-86ab-395d2bffd81a" containerID="61b53c8aa78ab19bd1322a187ed3c4f6a48f9c1abf20224dae8b26eb920430cc" exitCode=0 Oct 30 23:53:32.399403 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:32.399047 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" event={"ID":"a46f53db-2221-442e-86ab-395d2bffd81a","Type":"ContainerDied","Data":"61b53c8aa78ab19bd1322a187ed3c4f6a48f9c1abf20224dae8b26eb920430cc"} Oct 30 23:53:33.536657 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:33.536632 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:33.674805 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:33.674456 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-openshift-ca\") pod \"a46f53db-2221-442e-86ab-395d2bffd81a\" (UID: \"a46f53db-2221-442e-86ab-395d2bffd81a\") " Oct 30 23:53:33.675816 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:33.675608 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-xks-ca\") pod \"a46f53db-2221-442e-86ab-395d2bffd81a\" (UID: \"a46f53db-2221-442e-86ab-395d2bffd81a\") " Oct 30 23:53:33.675816 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:33.675699 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a46f53db-2221-442e-86ab-395d2bffd81a-kube-api-access-5hhxv\" (UniqueName: \"kubernetes.io/projected/a46f53db-2221-442e-86ab-395d2bffd81a-kube-api-access-5hhxv\") pod \"a46f53db-2221-442e-86ab-395d2bffd81a\" (UID: \"a46f53db-2221-442e-86ab-395d2bffd81a\") " Oct 30 23:53:33.678240 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:33.678204 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-openshift-ca" pod "a46f53db-2221-442e-86ab-395d2bffd81a" (UID: "a46f53db-2221-442e-86ab-395d2bffd81a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:53:33.682138 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:33.682088 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-xks-ca" pod "a46f53db-2221-442e-86ab-395d2bffd81a" (UID: "a46f53db-2221-442e-86ab-395d2bffd81a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 23:53:33.682283 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:33.682099 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46f53db-2221-442e-86ab-395d2bffd81a-kube-api-access-5hhxv" pod "a46f53db-2221-442e-86ab-395d2bffd81a" (UID: "a46f53db-2221-442e-86ab-395d2bffd81a"). InnerVolumeSpecName "kube-api-access-5hhxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:53:33.777872 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:33.777840 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-xks-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:33.777872 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:33.777867 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hhxv\" (UniqueName: \"kubernetes.io/projected/a46f53db-2221-442e-86ab-395d2bffd81a-kube-api-access-5hhxv\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:33.778027 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:33.777877 6174 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a46f53db-2221-442e-86ab-395d2bffd81a-maas-api-openshift-ca\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:34.410888 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:34.410861 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" Oct 30 23:53:34.411147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:34.410900 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5" event={"ID":"a46f53db-2221-442e-86ab-395d2bffd81a","Type":"ContainerDied","Data":"1579d7185aa9438af942c577ac7bd438e91bbcefe07f0d3e665be519fbafa3af"} Oct 30 23:53:34.411147 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:34.410948 6174 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1579d7185aa9438af942c577ac7bd438e91bbcefe07f0d3e665be519fbafa3af" Oct 30 23:53:34.973815 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:34.973787 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:53:35.090523 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.090496 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-token\" (UniqueName: \"kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-token\") pod \"a64d3f58-39cb-436f-b8c5-aad0ff964361\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " Oct 30 23:53:35.090666 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.090551 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-data\") pod \"a64d3f58-39cb-436f-b8c5-aad0ff964361\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " Oct 30 23:53:35.090666 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.090577 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-kube-api-access-75bnq\" (UniqueName: \"kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-kube-api-access-75bnq\") pod \"a64d3f58-39cb-436f-b8c5-aad0ff964361\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " Oct 30 23:53:35.090666 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.090632 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-podinfo\") pod \"a64d3f58-39cb-436f-b8c5-aad0ff964361\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " Oct 30 23:53:35.090808 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.090692 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a64d3f58-39cb-436f-b8c5-aad0ff964361-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64d3f58-39cb-436f-b8c5-aad0ff964361-istiod-ca-cert\") pod \"a64d3f58-39cb-436f-b8c5-aad0ff964361\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " Oct 30 23:53:35.090808 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.090720 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-envoy\") pod \"a64d3f58-39cb-436f-b8c5-aad0ff964361\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " Oct 30 23:53:35.090808 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.090787 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-credential-socket\") pod \"a64d3f58-39cb-436f-b8c5-aad0ff964361\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " Oct 30 23:53:35.090968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.090819 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-certs\") pod \"a64d3f58-39cb-436f-b8c5-aad0ff964361\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " Oct 30 23:53:35.090968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.090867 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-socket\") pod \"a64d3f58-39cb-436f-b8c5-aad0ff964361\" (UID: \"a64d3f58-39cb-436f-b8c5-aad0ff964361\") " Oct 30 23:53:35.090968 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.090909 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-data" pod "a64d3f58-39cb-436f-b8c5-aad0ff964361" (UID: "a64d3f58-39cb-436f-b8c5-aad0ff964361"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:53:35.091130 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.091117 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-credential-socket" pod "a64d3f58-39cb-436f-b8c5-aad0ff964361" (UID: "a64d3f58-39cb-436f-b8c5-aad0ff964361"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:53:35.091211 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.091147 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-certs" pod "a64d3f58-39cb-436f-b8c5-aad0ff964361" (UID: "a64d3f58-39cb-436f-b8c5-aad0ff964361"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:53:35.091275 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.091206 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a64d3f58-39cb-436f-b8c5-aad0ff964361-istiod-ca-cert" pod "a64d3f58-39cb-436f-b8c5-aad0ff964361" (UID: "a64d3f58-39cb-436f-b8c5-aad0ff964361"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:53:35.091342 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.091323 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-socket" pod "a64d3f58-39cb-436f-b8c5-aad0ff964361" (UID: "a64d3f58-39cb-436f-b8c5-aad0ff964361"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:53:35.091398 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.091351 6174 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64d3f58-39cb-436f-b8c5-aad0ff964361-istiod-ca-cert\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:35.091398 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.091374 6174 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-credential-socket\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:35.091398 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.091391 6174 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-certs\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:35.091562 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.091405 6174 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-data\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:35.092809 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.092780 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-token" pod "a64d3f58-39cb-436f-b8c5-aad0ff964361" (UID: "a64d3f58-39cb-436f-b8c5-aad0ff964361"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:53:35.093148 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.093124 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-envoy" pod "a64d3f58-39cb-436f-b8c5-aad0ff964361" (UID: "a64d3f58-39cb-436f-b8c5-aad0ff964361"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 23:53:35.093275 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.093255 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-kube-api-access-75bnq" pod "a64d3f58-39cb-436f-b8c5-aad0ff964361" (UID: "a64d3f58-39cb-436f-b8c5-aad0ff964361"). InnerVolumeSpecName "kube-api-access-75bnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:53:35.093317 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.093301 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-podinfo" pod "a64d3f58-39cb-436f-b8c5-aad0ff964361" (UID: "a64d3f58-39cb-436f-b8c5-aad0ff964361"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 23:53:35.191802 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.191778 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75bnq\" (UniqueName: \"kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-kube-api-access-75bnq\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:35.191802 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.191799 6174 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-podinfo\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:35.191957 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.191807 6174 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-envoy\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:35.191957 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.191817 6174 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64d3f58-39cb-436f-b8c5-aad0ff964361-workload-socket\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:35.191957 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.191825 6174 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64d3f58-39cb-436f-b8c5-aad0ff964361-istio-token\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:53:35.417521 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.417440 6174 generic.go:356] "Generic (PLEG): container finished" podID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerID="7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919" exitCode=0 Oct 30 23:53:35.417521 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.417487 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" Oct 30 23:53:35.417693 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.417527 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" event={"ID":"a64d3f58-39cb-436f-b8c5-aad0ff964361","Type":"ContainerDied","Data":"7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919"} Oct 30 23:53:35.417693 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.417587 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd" event={"ID":"a64d3f58-39cb-436f-b8c5-aad0ff964361","Type":"ContainerDied","Data":"cb628ceb11f99fc7ac1ac1b72ff670e89a7a2416574d25076abf7b4972867d9b"} Oct 30 23:53:35.417693 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.417611 6174 scope.go:122] "RemoveContainer" containerID="7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919" Oct 30 23:53:35.427771 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.427757 6174 scope.go:122] "RemoveContainer" containerID="7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58" Oct 30 23:53:35.436380 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.436359 6174 scope.go:122] "RemoveContainer" containerID="7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919" Oct 30 23:53:35.436616 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:53:35.436599 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919\": container with ID starting with 7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919 not found: ID does not exist" containerID="7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919" Oct 30 23:53:35.436665 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.436627 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919"} err="failed to get container status \"7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919\": rpc error: code = NotFound desc = could not find container \"7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919\": container with ID starting with 7d3031dff04f7903a2ff6c9f82c8283e54944f553e8733424a7ad09b69235919 not found: ID does not exist" Oct 30 23:53:35.436665 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.436643 6174 scope.go:122] "RemoveContainer" containerID="7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58" Oct 30 23:53:35.436838 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:53:35.436823 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58\": container with ID starting with 7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58 not found: ID does not exist" containerID="7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58" Oct 30 23:53:35.436878 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.436843 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58"} err="failed to get container status \"7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58\": rpc error: code = NotFound desc = could not find container \"7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58\": container with ID starting with 7c0ab429f865ed0d1c1c19647017f25e301038d6efa2f2d42791bd9304768f58 not found: ID does not exist" Oct 30 23:53:35.475192 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.473272 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd"] Oct 30 23:53:35.482380 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.482346 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-main-8d2ae1-openshift-default-6ff89779c-lcbfd"] Oct 30 23:53:35.949136 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:35.949102 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" path="/var/lib/kubelet/pods/a64d3f58-39cb-436f-b8c5-aad0ff964361/volumes" Oct 30 23:53:38.943877 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:38.943845 6174 scope.go:122] "RemoveContainer" containerID="8929fab6436b7f3effe151673656f5c554ee00e2d8c405bf7b9d004f8386eb89" Oct 30 23:53:38.944320 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:53:38.944050 6174 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-auth-proxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-auth-proxy pod=maas-consumer-portal-auth-proxy-658b9c897-xbs4n_odh-ai-gateway-infra(8879af5d-1f13-4772-b12d-7670aaaf8573)\"" pod="odh-ai-gateway-infra/maas-consumer-portal-auth-proxy-658b9c897-xbs4n" podUID="8879af5d-1f13-4772-b12d-7670aaaf8573" Oct 30 23:53:40.812529 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:40.812495 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r"] Oct 30 23:53:40.843190 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:40.843150 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr"] Oct 30 23:53:42.753334 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:42.753298 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5"] Oct 30 23:53:42.767146 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:42.767109 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-cd9099-f6zd5"] Oct 30 23:53:43.949812 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:43.949780 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a46f53db-2221-442e-86ab-395d2bffd81a" path="/var/lib/kubelet/pods/a46f53db-2221-442e-86ab-395d2bffd81a/volumes" Oct 30 23:53:44.543752 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:44.543707 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-d52jw"] Oct 30 23:53:45.813179 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:45.813105 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" podUID="9feffccc-da7c-49f6-b4f3-e2bb95c13bb7" containerName="payload-processing" containerID="cri-o://3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf" gracePeriod=25 Oct 30 23:53:45.843664 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:45.843631 6174 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" podUID="1bb1a017-b255-4a2c-a1e9-c969dc56add7" containerName="payload-pre-processing" containerID="cri-o://82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66" gracePeriod=25 Oct 30 23:53:49.928527 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:49.928483 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" podUID="9feffccc-da7c-49f6-b4f3-e2bb95c13bb7" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 23:53:49.928939 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:49.928495 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" podUID="1bb1a017-b255-4a2c-a1e9-c969dc56add7" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 23:53:54.234466 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:54.234433 6174 scope.go:122] "RemoveContainer" containerID="2d09a1917e2096dc151a808108460972b312e934059b07b954e0e11619d069ad" Oct 30 23:53:54.243185 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:54.243144 6174 scope.go:122] "RemoveContainer" containerID="d5c86f29cf7ed62a70820ebee048611d27cb7c68c28dc3758260f13e8419e622" Oct 30 23:53:54.251209 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:54.251188 6174 scope.go:122] "RemoveContainer" containerID="1c472305e37530dbda4931cb5a9d8551e2eae6be7fde64730fcb2e7349a658b3" Oct 30 23:53:54.260437 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:54.260414 6174 scope.go:122] "RemoveContainer" containerID="94c0e4d488a230c96d96efae9b6b34616eb30b9269e9036c4f983adf7651e772" Oct 30 23:53:54.268712 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:54.268696 6174 scope.go:122] "RemoveContainer" containerID="eb0dea17d60c4330e45bdc7b3a600813824a29f0c7ed50e118dc3ea6acfcabc0" Oct 30 23:53:59.266893 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:53:59.266852 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:53:59.928845 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:59.928808 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" podUID="9feffccc-da7c-49f6-b4f3-e2bb95c13bb7" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 23:53:59.929030 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:53:59.928808 6174 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" podUID="1bb1a017-b255-4a2c-a1e9-c969dc56add7" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 23:54:01.190712 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:01.190681 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-rx9tb_47faafa4-be06-421d-ad43-72fa5db58157/manager/0.log" Oct 30 23:54:03.478247 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:03.478170 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-1c7b9eef-wmp2n_58844db3-ae5c-403c-afd0-e80fa9ae1cdc/revoke-keys/0.log" Oct 30 23:54:03.673381 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:03.673355 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-36dfae7c-2qxrn_e99bfe7d-ccbf-444a-9f8e-8d31901c8974/revoke-keys/0.log" Oct 30 23:54:03.863053 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:03.863030 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-465e2457-6hv9q_b636dc87-61da-402c-b2d3-8eee4d1b5561/revoke-keys/0.log" Oct 30 23:54:04.048293 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:04.048265 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-4e69dd5d-dhqzp_c4d3e30b-18e3-4c3d-a826-3ea6102ac4b6/revoke-keys/0.log" Oct 30 23:54:04.226586 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:04.226517 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-562e07cc-dkwzn_2096f1cd-e228-45fe-bead-8ec47c86a527/revoke-keys/0.log" Oct 30 23:54:04.405229 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:04.405206 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-66072066-m7mqx_8e0fdcff-3d9d-4784-9725-f2afc2585b71/revoke-keys/0.log" Oct 30 23:54:04.588654 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:04.588625 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6f5cdd5d-ntpn5_78bd3c9a-bc7a-4289-a868-120262214909/revoke-keys/0.log" Oct 30 23:54:04.779592 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:04.779563 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-7ec31e49-2njkm_19111282-3b31-468b-86e2-1cf5fa70d24e/revoke-keys/0.log" Oct 30 23:54:04.982440 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:04.982369 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-8197ed26-2sfwp_d31f67e4-ba4c-47d3-9c10-c0832ffecd82/revoke-keys/0.log" Oct 30 23:54:05.169604 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:05.169578 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-d2d6202f-bshls_e082341a-d9eb-466f-b8a4-de9bd08a1f70/revoke-keys/0.log" Oct 30 23:54:05.355913 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:05.355879 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-e099064c-jvvg5_40c1ec17-27d3-40e0-bd20-fb86ea14f55e/revoke-keys/0.log" Oct 30 23:54:05.539412 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:05.539384 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-consumer-portal-auth-proxy-658b9c897-xbs4n_8879af5d-1f13-4772-b12d-7670aaaf8573/kube-auth-proxy/6.log" Oct 30 23:54:06.096659 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.096632 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" Oct 30 23:54:06.117743 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.117721 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" Oct 30 23:54:06.119257 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.119238 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-consumer-portal-auth-proxy-658b9c897-xbs4n_8879af5d-1f13-4772-b12d-7670aaaf8573/kube-auth-proxy/6.log" Oct 30 23:54:06.179030 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.179003 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-plugins-config-volume\") pod \"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7\" (UID: \"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7\") " Oct 30 23:54:06.179224 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.179054 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1bb1a017-b255-4a2c-a1e9-c969dc56add7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb1a017-b255-4a2c-a1e9-c969dc56add7-plugins-config-volume\") pod \"1bb1a017-b255-4a2c-a1e9-c969dc56add7\" (UID: \"1bb1a017-b255-4a2c-a1e9-c969dc56add7\") " Oct 30 23:54:06.179224 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.179200 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1bb1a017-b255-4a2c-a1e9-c969dc56add7-kube-api-access-6sgh7\" (UniqueName: \"kubernetes.io/projected/1bb1a017-b255-4a2c-a1e9-c969dc56add7-kube-api-access-6sgh7\") pod \"1bb1a017-b255-4a2c-a1e9-c969dc56add7\" (UID: \"1bb1a017-b255-4a2c-a1e9-c969dc56add7\") " Oct 30 23:54:06.179338 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.179228 6174 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-kube-api-access-zvg6r\" (UniqueName: \"kubernetes.io/projected/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-kube-api-access-zvg6r\") pod \"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7\" (UID: \"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7\") " Oct 30 23:54:06.179483 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.179460 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-plugins-config-volume" pod "9feffccc-da7c-49f6-b4f3-e2bb95c13bb7" (UID: "9feffccc-da7c-49f6-b4f3-e2bb95c13bb7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:54:06.179559 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.179458 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb1a017-b255-4a2c-a1e9-c969dc56add7-plugins-config-volume" pod "1bb1a017-b255-4a2c-a1e9-c969dc56add7" (UID: "1bb1a017-b255-4a2c-a1e9-c969dc56add7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 23:54:06.179662 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.179600 6174 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-plugins-config-volume\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:54:06.181589 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.181567 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-kube-api-access-zvg6r" pod "9feffccc-da7c-49f6-b4f3-e2bb95c13bb7" (UID: "9feffccc-da7c-49f6-b4f3-e2bb95c13bb7"). InnerVolumeSpecName "kube-api-access-zvg6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:54:06.181798 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.181775 6174 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb1a017-b255-4a2c-a1e9-c969dc56add7-kube-api-access-6sgh7" pod "1bb1a017-b255-4a2c-a1e9-c969dc56add7" (UID: "1bb1a017-b255-4a2c-a1e9-c969dc56add7"). InnerVolumeSpecName "kube-api-access-6sgh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 23:54:06.280460 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.280416 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sgh7\" (UniqueName: \"kubernetes.io/projected/1bb1a017-b255-4a2c-a1e9-c969dc56add7-kube-api-access-6sgh7\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:54:06.280460 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.280458 6174 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvg6r\" (UniqueName: \"kubernetes.io/projected/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7-kube-api-access-zvg6r\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:54:06.280629 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.280472 6174 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bb1a017-b255-4a2c-a1e9-c969dc56add7-plugins-config-volume\") on node \"ip-10-0-138-47.ec2.internal\" DevicePath \"\"" Oct 30 23:54:06.608334 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.608300 6174 generic.go:356] "Generic (PLEG): container finished" podID="9feffccc-da7c-49f6-b4f3-e2bb95c13bb7" containerID="3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf" exitCode=0 Oct 30 23:54:06.608508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.608344 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" Oct 30 23:54:06.608508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.608384 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" event={"ID":"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7","Type":"ContainerDied","Data":"3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf"} Oct 30 23:54:06.608508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.608429 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r" event={"ID":"9feffccc-da7c-49f6-b4f3-e2bb95c13bb7","Type":"ContainerDied","Data":"69a84dded3b5aea1ab207d0e3fbd807d4d21f439f4480ca491ef675292305972"} Oct 30 23:54:06.608508 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.608460 6174 scope.go:122] "RemoveContainer" containerID="3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf" Oct 30 23:54:06.609985 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.609957 6174 generic.go:356] "Generic (PLEG): container finished" podID="1bb1a017-b255-4a2c-a1e9-c969dc56add7" containerID="82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66" exitCode=0 Oct 30 23:54:06.610083 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.609998 6174 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" Oct 30 23:54:06.610083 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.610011 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" event={"ID":"1bb1a017-b255-4a2c-a1e9-c969dc56add7","Type":"ContainerDied","Data":"82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66"} Oct 30 23:54:06.610083 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.610064 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr" event={"ID":"1bb1a017-b255-4a2c-a1e9-c969dc56add7","Type":"ContainerDied","Data":"9e43dcaf698b143d9a25768fea8b7277a8eb75141437479f198fa6596cc9689b"} Oct 30 23:54:06.618579 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.618560 6174 scope.go:122] "RemoveContainer" containerID="3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf" Oct 30 23:54:06.618863 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:54:06.618844 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf\": container with ID starting with 3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf not found: ID does not exist" containerID="3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf" Oct 30 23:54:06.618932 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.618867 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf"} err="failed to get container status \"3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf\": rpc error: code = NotFound desc = could not find container \"3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf\": container with ID starting with 3920e3787998d4e595a317f967dcb140bc877b5c9c57ddf39ca901eeb099a8bf not found: ID does not exist" Oct 30 23:54:06.618932 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.618885 6174 scope.go:122] "RemoveContainer" containerID="82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66" Oct 30 23:54:06.627236 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.627220 6174 scope.go:122] "RemoveContainer" containerID="82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66" Oct 30 23:54:06.627493 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:54:06.627474 6174 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66\": container with ID starting with 82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66 not found: ID does not exist" containerID="82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66" Oct 30 23:54:06.627549 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.627498 6174 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66"} err="failed to get container status \"82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66\": rpc error: code = NotFound desc = could not find container \"82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66\": container with ID starting with 82aa4175d9386e0eae306a94f6298f5b9786b4dd9b7596a294b802162738cb66 not found: ID does not exist" Oct 30 23:54:06.657910 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.657888 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr"] Oct 30 23:54:06.669313 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.669289 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-cd9099-655dc67ccft6ppr"] Oct 30 23:54:06.702483 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.702459 6174 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r"] Oct 30 23:54:06.706539 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:06.706520 6174 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-cd9099-568bcd6bf4-spd5r"] Oct 30 23:54:07.949342 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:07.949310 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1bb1a017-b255-4a2c-a1e9-c969dc56add7" path="/var/lib/kubelet/pods/1bb1a017-b255-4a2c-a1e9-c969dc56add7/volumes" Oct 30 23:54:07.949845 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:07.949692 6174 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9feffccc-da7c-49f6-b4f3-e2bb95c13bb7" path="/var/lib/kubelet/pods/9feffccc-da7c-49f6-b4f3-e2bb95c13bb7/volumes" Oct 30 23:54:08.493082 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:08.493055 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-d52jw_f9ddefa2-c1ab-46cd-b2d3-e530e0138236/limitador/0.log" Oct 30 23:54:09.644684 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:09.644653 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-5rk8q_00236c42-24f5-4c5f-b024-0c623076b037/discovery/0.log" Oct 30 23:54:10.033257 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:10.033188 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798f575fff-xvqvg_6021dc8a-cbd5-4915-bc65-fd5779f23087/kube-auth-proxy/0.log" Oct 30 23:54:10.624563 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:10.624530 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bdfdz_d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1/istio-proxy/0.log" Oct 30 23:54:11.009048 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:11.008976 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hcml7_6864b0d8-cf9b-4045-a1fb-cfba56df7059/istio-proxy/0.log" Oct 30 23:54:11.388378 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:11.388348 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hrcgk_3c1dad76-6b81-41d5-8a73-04b9a6818ece/istio-proxy/0.log" Oct 30 23:54:11.966999 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:11.966969 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-t7kc5_d7f71b68-2967-4c7b-b81c-3f576fa2eeeb/istio-proxy/0.log" Oct 30 23:54:12.561643 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:12.561612 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-g2n6t_61853f99-ead8-4955-b488-70176727c22f/payload-processing/0.log" Oct 30 23:54:13.939266 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:13.939234 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-znckw_94b8d0fe-9a44-4a77-8b04-96cb32d7e693/main/0.log" Oct 30 23:54:14.147383 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:14.147358 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-h55jb_e50bf50b-d08f-4d61-bb8b-eb6c9691a56e/main/0.log" Oct 30 23:54:14.351281 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:14.351253 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-x6m75_e32aceb9-09d5-4eb7-a7dd-e4303654db59/main/0.log" Oct 30 23:54:14.945429 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:14.945399 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-w45pz_c0c7ac6e-b8e8-4398-82db-350d262ffd8d/main/0.log" Oct 30 23:54:29.268530 ip-10-0-138-47 kubenswrapper[6174]: E1030 23:54:29.268491 6174 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b2gj4" containerName="extractor" Oct 30 23:54:29.962406 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:29.962379 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dhk5w_1cc7c057-2789-4df5-8370-2244dc2f5d8b/global-pull-secret-syncer/0.log" Oct 30 23:54:30.789404 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:30.789372 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rbrcx_e50cdfc2-8c66-4e22-bcfa-d7186b29f2cf/konnectivity-agent/0.log" Oct 30 23:54:31.131345 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:31.131253 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-47.ec2.internal_eb43bc9abe76bb2220c1657ae80c7c48/haproxy/0.log" Oct 30 23:54:35.141718 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:35.141681 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-rx9tb_47faafa4-be06-421d-ad43-72fa5db58157/manager/0.log" Oct 30 23:54:35.263222 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:35.263192 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-rx9tb_47faafa4-be06-421d-ad43-72fa5db58157/manager/0.log" Oct 30 23:54:37.332330 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:37.332297 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-rx9tb_47faafa4-be06-421d-ad43-72fa5db58157/manager/0.log" Oct 30 23:54:37.384099 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:37.384071 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-d52jw_f9ddefa2-c1ab-46cd-b2d3-e530e0138236/limitador/0.log" Oct 30 23:54:37.454037 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:37.453998 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-rx9tb_47faafa4-be06-421d-ad43-72fa5db58157/manager/0.log" Oct 30 23:54:39.110265 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.110229 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ada8ced-a063-4061-9aa9-d7a374a71ec8/alertmanager/0.log" Oct 30 23:54:39.214292 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.214267 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ada8ced-a063-4061-9aa9-d7a374a71ec8/config-reloader/0.log" Oct 30 23:54:39.324126 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.324095 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ada8ced-a063-4061-9aa9-d7a374a71ec8/kube-rbac-proxy-web/0.log" Oct 30 23:54:39.428046 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.427976 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ada8ced-a063-4061-9aa9-d7a374a71ec8/kube-rbac-proxy/0.log" Oct 30 23:54:39.432593 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.432571 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-rx9tb_47faafa4-be06-421d-ad43-72fa5db58157/manager/0.log" Oct 30 23:54:39.510656 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.510629 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-rx9tb_47faafa4-be06-421d-ad43-72fa5db58157/manager/0.log" Oct 30 23:54:39.575024 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.574996 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ada8ced-a063-4061-9aa9-d7a374a71ec8/kube-rbac-proxy-metric/0.log" Oct 30 23:54:39.695429 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.695355 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ada8ced-a063-4061-9aa9-d7a374a71ec8/prom-label-proxy/0.log" Oct 30 23:54:39.739175 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739123 6174 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr"] Oct 30 23:54:39.739547 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739533 6174 cpu_manager.go:414] "containerMap: removing container" podUID="1bb1a017-b255-4a2c-a1e9-c969dc56add7" containerName="payload-pre-processing" Oct 30 23:54:39.739595 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739550 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1bb1a017-b255-4a2c-a1e9-c969dc56add7" containerName="payload-pre-processing" Oct 30 23:54:39.739595 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739575 6174 cpu_manager.go:414] "containerMap: removing container" podUID="a46f53db-2221-442e-86ab-395d2bffd81a" containerName="revoke-keys" Oct 30 23:54:39.739595 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739581 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a46f53db-2221-442e-86ab-395d2bffd81a" containerName="revoke-keys" Oct 30 23:54:39.739693 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739599 6174 cpu_manager.go:414] "containerMap: removing container" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerName="istio-proxy" Oct 30 23:54:39.739693 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739604 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerName="istio-proxy" Oct 30 23:54:39.739693 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739611 6174 cpu_manager.go:414] "containerMap: removing container" podUID="9feffccc-da7c-49f6-b4f3-e2bb95c13bb7" containerName="payload-processing" Oct 30 23:54:39.739693 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739616 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9feffccc-da7c-49f6-b4f3-e2bb95c13bb7" containerName="payload-processing" Oct 30 23:54:39.739693 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739626 6174 cpu_manager.go:414] "containerMap: removing container" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerName="istio-proxy" Oct 30 23:54:39.739693 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739634 6174 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerName="istio-proxy" Oct 30 23:54:39.739693 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739692 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="a46f53db-2221-442e-86ab-395d2bffd81a" containerName="revoke-keys" Oct 30 23:54:39.739891 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739705 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="a64d3f58-39cb-436f-b8c5-aad0ff964361" containerName="istio-proxy" Oct 30 23:54:39.739891 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739713 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="9feffccc-da7c-49f6-b4f3-e2bb95c13bb7" containerName="payload-processing" Oct 30 23:54:39.739891 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.739721 6174 memory_manager.go:365] "RemoveStaleState removing state" podUID="1bb1a017-b255-4a2c-a1e9-c969dc56add7" containerName="payload-pre-processing" Oct 30 23:54:39.742828 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.742810 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.759844 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.759824 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b2jtk\"/\"openshift-service-ca.crt\"" Oct 30 23:54:39.769326 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.769305 6174 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b2jtk\"/\"default-dockercfg-h295r\"" Oct 30 23:54:39.771619 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.771595 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr"] Oct 30 23:54:39.792951 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.792917 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a1cabc35-4d29-476d-b113-ebc818a97292-podres\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.793077 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.792993 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a1cabc35-4d29-476d-b113-ebc818a97292-proc\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.793077 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.793035 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a1cabc35-4d29-476d-b113-ebc818a97292-lib-modules\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.793213 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.793144 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-798cf\" (UniqueName: \"kubernetes.io/projected/a1cabc35-4d29-476d-b113-ebc818a97292-kube-api-access-798cf\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.793213 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.793204 6174 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1cabc35-4d29-476d-b113-ebc818a97292-sys\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.827642 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.827613 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ada8ced-a063-4061-9aa9-d7a374a71ec8/init-config-reloader/0.log" Oct 30 23:54:39.861661 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.861643 6174 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b2jtk\"/\"kube-root-ca.crt\"" Oct 30 23:54:39.894360 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.894335 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1cabc35-4d29-476d-b113-ebc818a97292-sys\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.894441 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.894376 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a1cabc35-4d29-476d-b113-ebc818a97292-podres\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.894441 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.894417 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a1cabc35-4d29-476d-b113-ebc818a97292-proc\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.894441 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.894435 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a1cabc35-4d29-476d-b113-ebc818a97292-lib-modules\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.894590 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.894453 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1cabc35-4d29-476d-b113-ebc818a97292-sys\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.894590 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.894526 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a1cabc35-4d29-476d-b113-ebc818a97292-lib-modules\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.894590 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.894526 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a1cabc35-4d29-476d-b113-ebc818a97292-podres\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.894590 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.894529 6174 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-798cf\" (UniqueName: \"kubernetes.io/projected/a1cabc35-4d29-476d-b113-ebc818a97292-kube-api-access-798cf\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.894590 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.894552 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a1cabc35-4d29-476d-b113-ebc818a97292-proc\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:39.913830 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:39.913805 6174 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-798cf\" (UniqueName: \"kubernetes.io/projected/a1cabc35-4d29-476d-b113-ebc818a97292-kube-api-access-798cf\") pod \"perf-node-gather-daemonset-kxchr\" (UID: \"a1cabc35-4d29-476d-b113-ebc818a97292\") " pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:40.055215 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:40.055178 6174 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:40.353586 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:40.353510 6174 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr"] Oct 30 23:54:40.356874 ip-10-0-138-47 kubenswrapper[6174]: W1030 23:54:40.356844 6174 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda1cabc35_4d29_476d_b113_ebc818a97292.slice/crio-25b5fc6d0adb7eec33c7529d2b7f85577b1b020459d7bc5de48b1ec300048459 WatchSource:0}: Error finding container 25b5fc6d0adb7eec33c7529d2b7f85577b1b020459d7bc5de48b1ec300048459: Status 404 returned error can't find the container with id 25b5fc6d0adb7eec33c7529d2b7f85577b1b020459d7bc5de48b1ec300048459 Oct 30 23:54:40.536002 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:40.535978 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-tnlqc_3eff329b-439c-49f0-9325-f4111a5fc659/monitoring-plugin/0.log" Oct 30 23:54:40.788031 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:40.788001 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" event={"ID":"a1cabc35-4d29-476d-b113-ebc818a97292","Type":"ContainerStarted","Data":"e2dbdb5fa22b416855d2a0fa0077fdaaf554169d37efea7d10b6c9f84133926e"} Oct 30 23:54:40.788271 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:40.788062 6174 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" event={"ID":"a1cabc35-4d29-476d-b113-ebc818a97292","Type":"ContainerStarted","Data":"25b5fc6d0adb7eec33c7529d2b7f85577b1b020459d7bc5de48b1ec300048459"} Oct 30 23:54:40.788271 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:40.788138 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:40.834411 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:40.834367 6174 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" podStartSLOduration=1.834355465 podStartE2EDuration="1.834355465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:54:40.830863545 +0000 UTC m=+1127.041450045" watchObservedRunningTime="2026-10-30 23:54:40.834355465 +0000 UTC m=+1127.044942003" Oct 30 23:54:40.985185 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:40.985142 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2tf6_dd63f30a-bd74-47e5-9692-e6a41b88ad6c/node-exporter/0.log" Oct 30 23:54:41.095122 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:41.095043 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2tf6_dd63f30a-bd74-47e5-9692-e6a41b88ad6c/kube-rbac-proxy/0.log" Oct 30 23:54:41.208925 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:41.208896 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2tf6_dd63f30a-bd74-47e5-9692-e6a41b88ad6c/init-textfile/0.log" Oct 30 23:54:42.389525 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:42.389440 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-5rk8q_00236c42-24f5-4c5f-b024-0c623076b037/discovery/0.log" Oct 30 23:54:42.508374 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:42.508335 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-5rk8q_00236c42-24f5-4c5f-b024-0c623076b037/discovery/0.log" Oct 30 23:54:42.533327 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:42.533300 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798f575fff-xvqvg_6021dc8a-cbd5-4915-bc65-fd5779f23087/kube-auth-proxy/0.log" Oct 30 23:54:42.620267 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:42.620243 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798f575fff-xvqvg_6021dc8a-cbd5-4915-bc65-fd5779f23087/kube-auth-proxy/0.log" Oct 30 23:54:42.714431 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:42.714357 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bdfdz_d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1/istio-proxy/0.log" Oct 30 23:54:42.800466 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:42.800439 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bdfdz_d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1/istio-proxy/0.log" Oct 30 23:54:42.854428 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:42.854396 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hcml7_6864b0d8-cf9b-4045-a1fb-cfba56df7059/istio-proxy/0.log" Oct 30 23:54:42.933863 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:42.933814 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hcml7_6864b0d8-cf9b-4045-a1fb-cfba56df7059/istio-proxy/0.log" Oct 30 23:54:42.990208 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:42.990121 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hrcgk_3c1dad76-6b81-41d5-8a73-04b9a6818ece/istio-proxy/0.log" Oct 30 23:54:43.067762 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:43.067728 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hrcgk_3c1dad76-6b81-41d5-8a73-04b9a6818ece/istio-proxy/0.log" Oct 30 23:54:43.068841 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:43.068818 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-mpdlf_aa89d93c-3459-445c-a4ad-2afc60b41ded/prometheus-operator/0.log" Oct 30 23:54:43.170873 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:43.170847 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-mpdlf_aa89d93c-3459-445c-a4ad-2afc60b41ded/kube-rbac-proxy/0.log" Oct 30 23:54:43.192561 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:43.192537 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-t7kc5_d7f71b68-2967-4c7b-b81c-3f576fa2eeeb/istio-proxy/0.log" Oct 30 23:54:43.259904 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:43.259834 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-t7kc5_d7f71b68-2967-4c7b-b81c-3f576fa2eeeb/istio-proxy/0.log" Oct 30 23:54:43.387178 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:43.387136 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-g2n6t_61853f99-ead8-4955-b488-70176727c22f/payload-processing/0.log" Oct 30 23:54:43.394821 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:43.394801 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-848b854bb9-m9nsx_ac8687ac-f591-479c-9bc2-e2557f9fcc85/telemeter-client/0.log" Oct 30 23:54:43.449957 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:43.449934 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-g2n6t_61853f99-ead8-4955-b488-70176727c22f/payload-processing/0.log" Oct 30 23:54:43.497400 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:43.497364 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-848b854bb9-m9nsx_ac8687ac-f591-479c-9bc2-e2557f9fcc85/reload/0.log" Oct 30 23:54:43.603757 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:43.603732 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-848b854bb9-m9nsx_ac8687ac-f591-479c-9bc2-e2557f9fcc85/kube-rbac-proxy/0.log" Oct 30 23:54:45.602153 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:45.602128 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-d52jw_f9ddefa2-c1ab-46cd-b2d3-e530e0138236/limitador/0.log" Oct 30 23:54:45.835883 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:45.835856 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-d52jw_f9ddefa2-c1ab-46cd-b2d3-e530e0138236/limitador/0.log" Oct 30 23:54:46.803007 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:46.802981 6174 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b2jtk/perf-node-gather-daemonset-kxchr" Oct 30 23:54:47.605975 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:47.605941 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-866655858d-ccc5l_bf0c3823-66d8-4d83-a11d-35ce46a738c9/console/0.log" Oct 30 23:54:47.723315 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:47.723288 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-ljn2m_dca9509b-a5f9-4afd-baff-f10b6a9b0c7f/download-server/0.log" Oct 30 23:54:51.517271 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:51.517243 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xpf7m_ee4cfb5e-2b2a-4831-8114-e57970cb7569/dns/0.log" Oct 30 23:54:51.623405 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:51.623374 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xpf7m_ee4cfb5e-2b2a-4831-8114-e57970cb7569/kube-rbac-proxy/0.log" Oct 30 23:54:51.845243 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:51.845219 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-czdjt_b44eee82-b560-4cab-8804-b1e77523635b/dns-node-resolver/0.log" Oct 30 23:54:52.314843 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:52.314814 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-597b95cb84-5jmbs_82094af2-8e11-4802-a21a-470ef0b2a1ac/cert-manager-controller/0.log" Oct 30 23:54:53.038525 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:53.038477 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-5rk8q_00236c42-24f5-4c5f-b024-0c623076b037/discovery/0.log" Oct 30 23:54:53.132737 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:53.132709 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hszwb_9d559e44-7c9d-464e-be57-884cff742118/node-ca/0.log" Oct 30 23:54:53.165223 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:53.165199 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798f575fff-xvqvg_6021dc8a-cbd5-4915-bc65-fd5779f23087/kube-auth-proxy/0.log" Oct 30 23:54:53.328374 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:53.328293 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bdfdz_d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1/istio-proxy/0.log" Oct 30 23:54:53.453668 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:53.453635 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hcml7_6864b0d8-cf9b-4045-a1fb-cfba56df7059/istio-proxy/0.log" Oct 30 23:54:53.580333 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:53.580270 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hrcgk_3c1dad76-6b81-41d5-8a73-04b9a6818ece/istio-proxy/0.log" Oct 30 23:54:53.641141 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:53.641113 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-776779f744-slh5t_e3606a07-854e-45de-bb7f-6e60c1263478/manager/0.log" Oct 30 23:54:53.675413 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:53.675391 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-776779f744-slh5t_e3606a07-854e-45de-bb7f-6e60c1263478/copy-manifests/0.log" Oct 30 23:54:53.767584 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:53.767556 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-t7kc5_d7f71b68-2967-4c7b-b81c-3f576fa2eeeb/istio-proxy/0.log" Oct 30 23:54:53.947645 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:53.947558 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-g2n6t_61853f99-ead8-4955-b488-70176727c22f/payload-processing/0.log" Oct 30 23:54:54.163494 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:54.163468 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-597b95cb84-5jmbs_82094af2-8e11-4802-a21a-470ef0b2a1ac/cert-manager-controller/0.log" Oct 30 23:54:54.777944 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:54.777868 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-rx9tb_47faafa4-be06-421d-ad43-72fa5db58157/manager/0.log" Oct 30 23:54:55.561910 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:55.561873 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-776779f744-slh5t_e3606a07-854e-45de-bb7f-6e60c1263478/manager/0.log" Oct 30 23:54:55.580538 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:55.580514 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-5rk8q_00236c42-24f5-4c5f-b024-0c623076b037/discovery/0.log" Oct 30 23:54:55.591871 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:55.591849 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-776779f744-slh5t_e3606a07-854e-45de-bb7f-6e60c1263478/copy-manifests/0.log" Oct 30 23:54:55.764760 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:55.764737 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798f575fff-xvqvg_6021dc8a-cbd5-4915-bc65-fd5779f23087/kube-auth-proxy/0.log" Oct 30 23:54:56.090152 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:56.090121 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bdfdz_d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1/istio-proxy/0.log" Oct 30 23:54:56.241896 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:56.241865 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-5rk8q_00236c42-24f5-4c5f-b024-0c623076b037/discovery/0.log" Oct 30 23:54:56.318112 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:56.318081 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hcml7_6864b0d8-cf9b-4045-a1fb-cfba56df7059/istio-proxy/0.log" Oct 30 23:54:56.342112 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:56.342047 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798f575fff-xvqvg_6021dc8a-cbd5-4915-bc65-fd5779f23087/kube-auth-proxy/0.log" Oct 30 23:54:56.557690 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:56.557664 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bdfdz_d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1/istio-proxy/0.log" Oct 30 23:54:56.630404 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:56.630320 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hrcgk_3c1dad76-6b81-41d5-8a73-04b9a6818ece/istio-proxy/0.log" Oct 30 23:54:56.704878 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:56.704838 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hcml7_6864b0d8-cf9b-4045-a1fb-cfba56df7059/istio-proxy/0.log" Oct 30 23:54:56.767684 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:56.767641 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-rx9tb_47faafa4-be06-421d-ad43-72fa5db58157/manager/0.log" Oct 30 23:54:56.804252 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:56.804224 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-5rk8q_00236c42-24f5-4c5f-b024-0c623076b037/discovery/0.log" Oct 30 23:54:56.834882 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:56.834839 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hrcgk_3c1dad76-6b81-41d5-8a73-04b9a6818ece/istio-proxy/0.log" Oct 30 23:54:56.903195 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:56.903115 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-798f575fff-xvqvg_6021dc8a-cbd5-4915-bc65-fd5779f23087/kube-auth-proxy/0.log" Oct 30 23:54:56.984802 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:56.984770 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-t7kc5_d7f71b68-2967-4c7b-b81c-3f576fa2eeeb/istio-proxy/0.log" Oct 30 23:54:57.043149 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:57.043122 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-t7kc5_d7f71b68-2967-4c7b-b81c-3f576fa2eeeb/istio-proxy/0.log" Oct 30 23:54:57.089134 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:57.089108 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-bdfdz_d4f03d25-3b68-4cc8-9475-0a8eab9ba3b1/istio-proxy/0.log" Oct 30 23:54:57.218482 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:57.218407 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hcml7_6864b0d8-cf9b-4045-a1fb-cfba56df7059/istio-proxy/0.log" Oct 30 23:54:57.244216 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:57.244190 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-g2n6t_61853f99-ead8-4955-b488-70176727c22f/payload-processing/0.log" Oct 30 23:54:57.338854 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:57.338822 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-g2n6t_61853f99-ead8-4955-b488-70176727c22f/payload-processing/0.log" Oct 30 23:54:57.353744 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:57.353721 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-hrcgk_3c1dad76-6b81-41d5-8a73-04b9a6818ece/istio-proxy/0.log" Oct 30 23:54:57.547584 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:57.547556 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f5667f86c-t7kc5_d7f71b68-2967-4c7b-b81c-3f576fa2eeeb/istio-proxy/0.log" Oct 30 23:54:57.726847 ip-10-0-138-47 kubenswrapper[6174]: I1030 23:54:57.726819 6174 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-g2n6t_61853f99-ead8-4955-b488-70176727c22f/payload-processing/0.log"