Oct 30 18:35:35.986739 ip-10-0-135-218 systemd[1]: Starting Kubernetes Kubelet... Oct 30 18:35:36.386251 ip-10-0-135-218 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 18:35:36.386251 ip-10-0-135-218 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 18:35:36.386251 ip-10-0-135-218 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 18:35:36.386251 ip-10-0-135-218 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 18:35:36.390271 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390177 2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390278 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390282 2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390286 2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390290 2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390293 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390296 2575 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390299 2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390304 2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390309 2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390312 2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390314 2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390317 2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390320 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390322 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:35:36.390325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390325 2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390336 2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390339 2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390342 2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390344 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390347 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390349 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390352 2575 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390355 2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390357 2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390360 2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390362 2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390365 2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390369 2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390373 2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390375 2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390378 2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390380 2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390383 2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:35:36.390692 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390386 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390388 2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390390 2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390393 2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390396 2575 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390399 2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390415 2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390418 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390421 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390425 2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390427 2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390430 2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390432 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390435 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390439 2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390442 2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390445 2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390448 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390451 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390454 2575 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:35:36.391128 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390456 2575 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390459 2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390462 2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390464 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390467 2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390469 2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390472 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390475 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390477 2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390480 2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390482 2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390485 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390488 2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390490 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390493 2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390495 2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390498 2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390500 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390503 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:35:36.391636 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390505 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390508 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390510 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390513 2575 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390515 2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390518 2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390520 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390523 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390527 2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390530 2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390532 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390535 2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390537 2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390539 2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390542 2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390544 2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390547 2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390549 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390551 2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390554 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:35:36.392072 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390557 2575 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:35:36.392544 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390559 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:35:36.392544 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390562 2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:35:36.392544 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390564 2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:35:36.392544 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390567 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:35:36.392544 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390569 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:35:36.392544 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390572 2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:35:36.392544 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390574 2575 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:35:36.392544 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390577 2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:35:36.392544 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390581 2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:35:36.392544 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390584 2575 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:35:36.392544 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390586 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:35:36.392544 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.390588 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:35:36.392947 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392933 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:35:36.392947 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392947 2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392951 2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392955 2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392958 2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392961 2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392963 2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392966 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392969 2575 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392972 2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392975 2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392978 2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392980 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392983 2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392985 2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392988 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392990 2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392993 2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392995 2575 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.392997 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393000 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:35:36.393005 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393003 2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393005 2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393008 2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393010 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393013 2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393016 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393019 2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393021 2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393024 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393026 2575 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393029 2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393031 2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393034 2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393036 2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393039 2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393041 2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393044 2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393046 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393049 2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393051 2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:35:36.393487 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393054 2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393057 2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393059 2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393061 2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393064 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393066 2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393068 2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393071 2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393073 2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393076 2575 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393078 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393080 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393083 2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393088 2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393093 2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393096 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393099 2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393101 2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393104 2575 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:35:36.393945 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393107 2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393110 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393112 2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393115 2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393117 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393120 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393122 2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393125 2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393128 2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393130 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393133 2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393135 2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393137 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393140 2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393143 2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393146 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393148 2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393151 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393153 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:35:36.394471 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393156 2575 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393158 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393161 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393163 2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393165 2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393168 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393170 2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393173 2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393176 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393178 2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393181 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393184 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393186 2575 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393189 2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393192 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393194 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393197 2575 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393199 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393203 2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:35:36.394918 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393207 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393210 2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393213 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393217 2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393219 2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393222 2575 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393224 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393227 2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393750 2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393755 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393758 2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393761 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393764 2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393767 2575 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393769 2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393772 2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393774 2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393777 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393780 2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:35:36.395356 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393782 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393785 2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393788 2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393791 2575 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393794 2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393796 2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393799 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393802 2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393805 2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393808 2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393810 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393813 2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393816 2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393818 2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393821 2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393823 2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393826 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393828 2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393831 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393833 2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:35:36.395823 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393836 2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393839 2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393842 2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393844 2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393846 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393849 2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393852 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393854 2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393857 2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393860 2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393863 2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393866 2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393869 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393875 2575 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393877 2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393880 2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393882 2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393885 2575 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393889 2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:35:36.396286 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393893 2575 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393895 2575 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393898 2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393901 2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393904 2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393907 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393909 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393912 2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393914 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393917 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393919 2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393922 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393924 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393927 2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393929 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393931 2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393935 2575 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393937 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393940 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393943 2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:35:36.396744 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393945 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393948 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393951 2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393954 2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393956 2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393959 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393962 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393965 2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393967 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393969 2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393972 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393975 2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393977 2575 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393980 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393983 2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393985 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393988 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393990 2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393993 2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:35:36.397217 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393996 2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.393998 2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394000 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394003 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394005 2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394008 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394010 2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394012 2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394015 2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394017 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394020 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394022 2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394026 2575 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394029 2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394032 2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394034 2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.394037 2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394742 2575 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394753 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394760 2575 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 18:35:36.397658 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394766 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394771 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394774 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394779 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394783 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394787 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394790 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394794 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394797 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394800 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394803 2575 flags.go:64] FLAG: --cgroup-root="" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394806 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394810 2575 flags.go:64] FLAG: --client-ca-file="" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394813 2575 flags.go:64] FLAG: --cloud-provider="external" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394815 2575 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394821 2575 flags.go:64] FLAG: --cluster-domain="" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394824 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394827 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394832 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394836 2575 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394840 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394844 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394847 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 18:35:36.398111 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394851 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394854 2575 flags.go:64] FLAG: --contention-profiling="false" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394858 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394861 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394864 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394867 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394872 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394875 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394878 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394881 2575 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394884 2575 flags.go:64] FLAG: --enable-server="true" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394887 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394891 2575 flags.go:64] FLAG: --event-burst="100" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394895 2575 flags.go:64] FLAG: --event-qps="50" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394897 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394900 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394904 2575 flags.go:64] FLAG: --eviction-hard="" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394908 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394912 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394915 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394917 2575 flags.go:64] FLAG: --eviction-soft="" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394921 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394924 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394927 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394930 2575 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 18:35:36.398649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394934 2575 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394937 2575 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394940 2575 flags.go:64] FLAG: --feature-gates="" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394944 2575 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394948 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394951 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394954 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394957 2575 flags.go:64] FLAG: --healthz-port="10248" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394961 2575 flags.go:64] FLAG: --help="false" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394964 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394967 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394971 2575 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394974 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394977 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394981 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394984 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394987 2575 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394990 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394993 2575 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394996 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.394999 2575 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395002 2575 flags.go:64] FLAG: --kube-reserved="" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395005 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395008 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 18:35:36.399269 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395011 2575 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395014 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395017 2575 flags.go:64] FLAG: --lock-file="" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395020 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395023 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395026 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395032 2575 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395035 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395038 2575 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395041 2575 flags.go:64] FLAG: --logging-format="text" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395044 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395048 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395051 2575 flags.go:64] FLAG: --manifest-url="" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395054 2575 flags.go:64] FLAG: --manifest-url-header="" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395059 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395062 2575 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395066 2575 flags.go:64] FLAG: --max-pods="110" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395070 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395073 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395076 2575 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395079 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395082 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395086 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395090 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395098 2575 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 18:35:36.399850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395102 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395105 2575 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395108 2575 flags.go:64] FLAG: --pod-cidr="" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395111 2575 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395114 2575 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395117 2575 flags.go:64] FLAG: --pods-per-core="0" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395120 2575 flags.go:64] FLAG: --port="10250" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395123 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395126 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03ed5fb1fd9bd7ddf" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395129 2575 flags.go:64] FLAG: --qos-reserved="" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395132 2575 flags.go:64] FLAG: --read-only-port="10255" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395135 2575 flags.go:64] FLAG: --register-node="true" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395138 2575 flags.go:64] FLAG: --register-with-taints="" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395142 2575 flags.go:64] FLAG: --registry-burst="10" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395145 2575 flags.go:64] FLAG: --registry-qps="5" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395148 2575 flags.go:64] FLAG: --reserved-cpus="" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395151 2575 flags.go:64] FLAG: --reserved-memory="" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395155 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395158 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395161 2575 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395164 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395167 2575 flags.go:64] FLAG: --runonce="false" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395170 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395173 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395177 2575 flags.go:64] FLAG: --seccomp-default="false" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395186 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395190 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 18:35:36.400439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395193 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395196 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395200 2575 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395203 2575 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395207 2575 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395210 2575 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395213 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395216 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395219 2575 flags.go:64] FLAG: --system-cgroups="" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395222 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395227 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395230 2575 flags.go:64] FLAG: --tls-cert-file="" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395233 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395238 2575 flags.go:64] FLAG: --tls-min-version="" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395240 2575 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395243 2575 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395246 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395249 2575 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395252 2575 flags.go:64] FLAG: --v="2" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395256 2575 flags.go:64] FLAG: --version="false" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395261 2575 flags.go:64] FLAG: --vmodule="" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395265 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395268 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395444 2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395449 2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:35:36.401150 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395452 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395455 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395458 2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395460 2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395463 2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395465 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395468 2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395471 2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395474 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395478 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395481 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395484 2575 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395486 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395489 2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395491 2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395494 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395496 2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395499 2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395501 2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395504 2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:35:36.401746 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395506 2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395508 2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395511 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395513 2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395516 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395518 2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395521 2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395523 2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395529 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395531 2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395533 2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395536 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395539 2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395541 2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395543 2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395546 2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395549 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395551 2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395554 2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395557 2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:35:36.402245 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395559 2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395563 2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395566 2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395568 2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395571 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395573 2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395576 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395578 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395580 2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395583 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395586 2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395588 2575 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395590 2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395593 2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395595 2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395599 2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395601 2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395604 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395606 2575 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:35:36.402731 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395609 2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395614 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395616 2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395619 2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395621 2575 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395624 2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395626 2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395629 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395632 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395635 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395637 2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395639 2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395642 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395646 2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395651 2575 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395654 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395657 2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395660 2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395663 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:35:36.403214 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395665 2575 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395668 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395670 2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395673 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395675 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395678 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395680 2575 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395683 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395687 2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395689 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395693 2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395697 2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395700 2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395703 2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395708 2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395711 2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395714 2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395725 2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395728 2575 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:35:36.403684 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395731 2575 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395733 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395736 2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395739 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395741 2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395744 2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395746 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.395776 2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395818 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395824 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395828 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395831 2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395834 2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395836 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395840 2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395845 2575 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:35:36.404125 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395848 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395851 2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395854 2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395857 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395860 2575 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395863 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395866 2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395868 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395871 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395874 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395877 2575 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395879 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395884 2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395886 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395890 2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395895 2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395897 2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395900 2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395903 2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:35:36.404732 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395905 2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395908 2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395910 2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395913 2575 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395915 2575 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395919 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395923 2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395925 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395928 2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395930 2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395933 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395935 2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395938 2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395941 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395943 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395946 2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395948 2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395950 2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395953 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395955 2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:35:36.405362 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395958 2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395960 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395976 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395980 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395983 2575 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395987 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395990 2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395993 2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395995 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.395998 2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396000 2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396003 2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396005 2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396008 2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396010 2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396013 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396015 2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396019 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396021 2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396024 2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:35:36.405906 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396027 2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396030 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396032 2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396035 2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396037 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396040 2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396042 2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396045 2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396047 2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396049 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396052 2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396054 2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396057 2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396059 2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396062 2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396064 2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396066 2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396071 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396073 2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:35:36.406513 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396076 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396078 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396081 2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396083 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396086 2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396088 2575 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396091 2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396094 2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396096 2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396099 2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396103 2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396105 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396108 2575 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396111 2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396113 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396116 2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396118 2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396122 2575 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396124 2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:35:36.406959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.396127 2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.403429 2575 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.403449 2575 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.403462 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.403467 2575 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403525 2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403531 2575 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403534 2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403537 2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403540 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403543 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403546 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403549 2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403552 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403555 2575 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403557 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403560 2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403563 2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403566 2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403568 2575 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:35:36.407393 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403571 2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403574 2575 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403576 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403579 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403581 2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403584 2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403588 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403590 2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403595 2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403598 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403601 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403604 2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403607 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403610 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403613 2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403615 2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403618 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403620 2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403623 2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:35:36.407889 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403626 2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403628 2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403630 2575 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403633 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403636 2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403638 2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403641 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403644 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403646 2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403649 2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403651 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403654 2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403657 2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403660 2575 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403664 2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403669 2575 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403673 2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403677 2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403681 2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403685 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:35:36.408330 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403688 2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403692 2575 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403695 2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403698 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403700 2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403703 2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403705 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403709 2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403711 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403714 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403724 2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403726 2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403729 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403731 2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403734 2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403737 2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403740 2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403742 2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403745 2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403748 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:35:36.408936 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403750 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403753 2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403755 2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403758 2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403760 2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403763 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403765 2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403768 2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403771 2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403773 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403776 2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403779 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403781 2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403784 2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403788 2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403792 2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403795 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403797 2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403800 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:35:36.409387 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403802 2575 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403805 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403808 2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403810 2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403813 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403815 2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403818 2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403820 2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403823 2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403825 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403827 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403830 2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.403832 2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.403860 2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404000 2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404005 2575 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:35:36.409893 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404008 2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404011 2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404014 2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404016 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404018 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404021 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404024 2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404027 2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404029 2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404032 2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404034 2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404037 2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404040 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404042 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404045 2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404047 2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404051 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404053 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404056 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:35:36.410263 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404058 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404060 2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404063 2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404066 2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404068 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404070 2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404073 2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404075 2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404078 2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404080 2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404084 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404086 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404089 2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404092 2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404094 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404097 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404099 2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404101 2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404104 2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404107 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:35:36.410838 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404109 2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404111 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404114 2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404116 2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404119 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404173 2575 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404214 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404217 2575 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404220 2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404224 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404227 2575 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.404230 2575 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.405752 2575 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.405774 2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.405781 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.405788 2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.405793 2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.405798 2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.405803 2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.405815 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:35:36.411294 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.405819 2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.405991 2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.405995 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.405999 2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406003 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406006 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406008 2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406011 2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406014 2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406017 2575 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406019 2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406022 2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406026 2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406031 2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406035 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406039 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406042 2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406044 2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406047 2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:35:36.411813 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406052 2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406056 2575 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406059 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406061 2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406065 2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406067 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406070 2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406073 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406075 2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406078 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406081 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406084 2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406092 2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406096 2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406101 2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406105 2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406108 2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406110 2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406113 2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:35:36.412248 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406116 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406119 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406122 2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406125 2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406127 2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406130 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406133 2575 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.406167 2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406210 2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406213 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406217 2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406220 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406222 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406225 2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406228 2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406232 2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:35:36.412983 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406236 2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406240 2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406242 2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406245 2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406247 2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406250 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406253 2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406255 2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406258 2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406260 2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406263 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406267 2575 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406270 2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406273 2575 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406275 2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406278 2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406280 2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406283 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406285 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406287 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:35:36.413585 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406290 2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406293 2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406295 2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406298 2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406300 2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406303 2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406306 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406308 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406311 2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406314 2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406316 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406319 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406321 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406324 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406326 2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406329 2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406331 2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406333 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406336 2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:35:36.414041 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406339 2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406341 2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406344 2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406346 2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406349 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406351 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406354 2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406356 2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406359 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406362 2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406364 2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406367 2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406369 2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406372 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406374 2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406376 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406379 2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406382 2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406384 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:35:36.414665 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406388 2575 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406390 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406393 2575 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406395 2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406398 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406414 2575 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406418 2575 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406422 2575 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406426 2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406429 2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406432 2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406435 2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406438 2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406441 2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406443 2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406449 2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406452 2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406454 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406457 2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406459 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:35:36.415162 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406462 2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406464 2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406468 2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406471 2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406474 2575 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406476 2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406479 2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406482 2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406484 2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406487 2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406489 2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406492 2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406494 2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406497 2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406501 2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406505 2575 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406508 2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406511 2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406514 2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:35:36.415637 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:36.406519 2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:35:36.416217 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.406580 2575 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 18:35:36.416217 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.409500 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 18:35:36.416217 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.410451 2575 server.go:1014] "Starting client certificate rotation" Oct 30 18:35:36.416217 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.410568 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 18:35:36.416217 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.410624 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 18:35:36.416217 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.412518 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 18:35:36.416217 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.413735 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 18:35:36.424325 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.424303 2575 log.go:25] "Validated CRI v1 runtime API" Oct 30 18:35:36.427884 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.427869 2575 log.go:25] "Validated CRI v1 image API" Oct 30 18:35:36.428699 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.428671 2575 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 18:35:36.431723 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.431694 2575 fs.go:135] Filesystem UUIDs: map[11cd716f-38bb-4937-9cfa-79256c4854d6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7fe1bac4-667c-4988-9d9e-4105da58c19e:/dev/nvme0n1p3] Oct 30 18:35:36.431789 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.431721 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 18:35:36.436711 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.436583 2575 manager.go:217] Machine: {Timestamp:2026-10-30 18:35:36.435348542 +0000 UTC m=+0.326802433 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3197160 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21a91fd6379e8c436d73aa2f32f0e9 SystemUUID:ec21a91f-d637-9e8c-436d-73aa2f32f0e9 BootID:6c8f9c64-44a5-4941-b414-29d77ae8b942 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:dc:19:6a:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:dc:19:6a:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:37:a2:6c:36:b9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 18:35:36.437227 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.437216 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 18:35:36.437360 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.437348 2575 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 18:35:36.442130 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.441914 2575 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 18:35:36.442294 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.442135 2575 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-218.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 18:35:36.442341 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.442299 2575 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 18:35:36.442341 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.442310 2575 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 18:35:36.442341 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.442322 2575 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 18:35:36.443029 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.443018 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 18:35:36.443864 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.443853 2575 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 18:35:36.447756 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.447740 2575 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 18:35:36.447895 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.447885 2575 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 18:35:36.448598 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.448587 2575 kubelet.go:493] "Attempting to sync node with API server" Oct 30 18:35:36.448629 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.448604 2575 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 18:35:36.448629 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.448614 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 18:35:36.448629 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.448624 2575 kubelet.go:405] "Adding apiserver pod source" Oct 30 18:35:36.448739 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.448633 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 18:35:36.449006 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.448985 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 18:35:36.451630 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.451608 2575 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 18:35:36.456845 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.456827 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 18:35:36.458266 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.458253 2575 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 18:35:36.458323 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.458283 2575 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 18:35:36.458477 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.458466 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 18:35:36.458507 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.458482 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 18:35:36.458507 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.458487 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 18:35:36.458507 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.458493 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 18:35:36.458507 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.458500 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 18:35:36.458603 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.458510 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 18:35:36.459012 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.459004 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 18:35:36.459049 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.459012 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 18:35:36.459049 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.459020 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 18:35:36.459049 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.459026 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 18:35:36.459049 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.459034 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 18:35:36.459049 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.459043 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 18:35:36.459701 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.459690 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 18:35:36.459755 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.459706 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 18:35:36.463538 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.463523 2575 server.go:1263] "Started kubelet" Oct 30 18:35:36.463750 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.463712 2575 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 18:35:36.463841 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.463684 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 18:35:36.463897 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.463851 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 18:35:36.464468 ip-10-0-135-218 systemd[1]: Started Kubernetes Kubelet. Oct 30 18:35:36.465140 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.465125 2575 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 18:35:36.466388 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.466253 2575 server.go:317] "Adding debug handlers to kubelet server" Oct 30 18:35:36.469839 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.469817 2575 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 18:35:36.474971 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.474945 2575 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 18:35:36.474971 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.474962 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 18:35:36.475140 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.475025 2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found" Oct 30 18:35:36.475765 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.475539 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 18:35:36.475765 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.475587 2575 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 18:35:36.475765 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.475623 2575 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 18:35:36.475987 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.475844 2575 reconstruct.go:97] "Volume reconstruction finished" Oct 30 18:35:36.475987 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.475855 2575 reconciler.go:29] "Reconciler: start to sync state" Oct 30 18:35:36.475987 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.475944 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 18:35:36.475987 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.475955 2575 factory.go:55] Registering systemd factory Oct 30 18:35:36.475987 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.475962 2575 factory.go:223] Registration of the systemd container factory successfully Oct 30 18:35:36.476222 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.476207 2575 factory.go:153] Registering CRI-O factory Oct 30 18:35:36.476268 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.476224 2575 factory.go:223] Registration of the crio container factory successfully Oct 30 18:35:36.476268 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.476242 2575 factory.go:103] Registering Raw factory Oct 30 18:35:36.476268 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.476256 2575 manager.go:1199] Started watching for new ooms in manager Oct 30 18:35:36.477246 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.477227 2575 manager.go:319] Starting recovery of all containers Oct 30 18:35:36.483520 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.483482 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 18:35:36.491200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.491182 2575 manager.go:324] Recovery completed Oct 30 18:35:36.497876 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.497853 2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:35:36.501060 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.501027 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:35:36.501060 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.501065 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:35:36.501246 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.501076 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:35:36.501395 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.501363 2575 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 18:35:36.501893 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.501877 2575 cpu_manager.go:226] "Starting" policy="none" Oct 30 18:35:36.501893 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.501891 2575 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 18:35:36.502042 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.501911 2575 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 18:35:36.502042 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.501880 2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:35:36.502153 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.501202 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-218.ec2.internal.18e36276354cd4f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-218.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-218.ec2.internal,},FirstTimestamp:2026-10-30 18:35:36.463480049 +0000 UTC m=+0.354933940,LastTimestamp:2026-10-30 18:35:36.463480049 +0000 UTC m=+0.354933940,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-218.ec2.internal,}" Oct 30 18:35:36.502821 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.502802 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:35:36.502896 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.502836 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:35:36.502896 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.502850 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:35:36.504257 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.504240 2575 policy_none.go:50] "Start" Oct 30 18:35:36.504257 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.504259 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 18:35:36.504350 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.504273 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 18:35:36.506384 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.506370 2575 policy_none.go:44] "Start" Oct 30 18:35:36.509279 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.509262 2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 18:35:36.513806 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.513789 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s4dlx" Oct 30 18:35:36.517792 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.517765 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-218.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 18:35:36.517926 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.517836 2575 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 18:35:36.517992 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.517927 2575 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 30 18:35:36.518045 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.517910 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-218.ec2.internal.18e36276378a2ce4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-218.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-218.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-218.ec2.internal,},FirstTimestamp:2026-10-30 18:35:36.501054692 +0000 UTC m=+0.392508581,LastTimestamp:2026-10-30 18:35:36.501054692 +0000 UTC m=+0.392508581,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-218.ec2.internal,}" Oct 30 18:35:36.525386 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.525357 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s4dlx" Oct 30 18:35:36.527694 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.527671 2575 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 30 18:35:36.544095 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.544049 2575 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 18:35:36.546975 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.546954 2575 manager.go:341] "Starting Device Plugin manager" Oct 30 18:35:36.547109 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.547005 2575 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 18:35:36.547109 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.547018 2575 server.go:87] "Starting device plugin registration server" Oct 30 18:35:36.547331 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.547317 2575 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 18:35:36.547399 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.547330 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 18:35:36.547866 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.547579 2575 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 18:35:36.547866 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.547651 2575 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 18:35:36.547866 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.547658 2575 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 18:35:36.548130 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.548110 2575 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 18:35:36.548194 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.548160 2575 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-218.ec2.internal\" not found" Oct 30 18:35:36.600310 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.600284 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 18:35:36.600310 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.600314 2575 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 18:35:36.602445 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.600335 2575 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 18:35:36.602445 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.600373 2575 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 18:35:36.614595 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.614570 2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:35:36.647790 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.647691 2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:35:36.648775 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.648753 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:35:36.648883 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.648790 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:35:36.648883 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.648803 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:35:36.648883 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.648832 2575 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.667612 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.667591 2575 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.667735 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.667620 2575 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-218.ec2.internal\": node \"ip-10-0-135-218.ec2.internal\" not found" Oct 30 18:35:36.701052 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.700996 2575 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal"] Oct 30 18:35:36.701225 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.701083 2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:35:36.702062 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.702036 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:35:36.702157 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.702068 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:35:36.702157 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.702096 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:35:36.703363 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.703348 2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found" Oct 30 18:35:36.704299 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.704287 2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:35:36.704497 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.704480 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.704568 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.704530 2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:35:36.705054 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.705037 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:35:36.705054 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.705054 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:35:36.705159 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.705065 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:35:36.705159 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.705079 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:35:36.705159 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.705079 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:35:36.705159 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.705096 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:35:36.707046 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.707030 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.707106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.707062 2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:35:36.707784 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.707767 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:35:36.707837 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.707801 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:35:36.707837 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.707815 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:35:36.732102 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.732076 2575 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-218.ec2.internal\" not found" node="ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.738175 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.738158 2575 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-218.ec2.internal\" not found" node="ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.777118 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.777090 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a1141f188cb159776b4a1af048cbc31-config\") pod \"kube-apiserver-proxy-ip-10-0-135-218.ec2.internal\" (UID: \"0a1141f188cb159776b4a1af048cbc31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.777118 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.777118 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40d34cdd4c09d30482e59285c4804c2a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"40d34cdd4c09d30482e59285c4804c2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.777289 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.777139 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40d34cdd4c09d30482e59285c4804c2a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"40d34cdd4c09d30482e59285c4804c2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.803704 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.803677 2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found" Oct 30 18:35:36.877761 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.877726 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40d34cdd4c09d30482e59285c4804c2a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"40d34cdd4c09d30482e59285c4804c2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.877761 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.877764 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40d34cdd4c09d30482e59285c4804c2a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"40d34cdd4c09d30482e59285c4804c2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.877960 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.877820 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a1141f188cb159776b4a1af048cbc31-config\") pod \"kube-apiserver-proxy-ip-10-0-135-218.ec2.internal\" (UID: \"0a1141f188cb159776b4a1af048cbc31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.877960 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.877820 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40d34cdd4c09d30482e59285c4804c2a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"40d34cdd4c09d30482e59285c4804c2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.877960 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.877842 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40d34cdd4c09d30482e59285c4804c2a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"40d34cdd4c09d30482e59285c4804c2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.877960 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:36.877894 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a1141f188cb159776b4a1af048cbc31-config\") pod \"kube-apiserver-proxy-ip-10-0-135-218.ec2.internal\" (UID: \"0a1141f188cb159776b4a1af048cbc31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:35:36.904068 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:36.903987 2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found" Oct 30 18:35:37.004652 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.004620 2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found" Oct 30 18:35:37.035847 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.035812 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:35:37.041389 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.041370 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:35:37.105883 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.105686 2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found" Oct 30 18:35:37.207899 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.207864 2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found" Oct 30 18:35:37.308536 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.308493 2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found" Oct 30 18:35:37.345841 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.345809 2575 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:35:37.377293 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.377245 2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:35:37.400579 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.400543 2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 18:35:37.402565 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.402546 2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:35:37.409904 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.409876 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 18:35:37.410087 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.410024 2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 18:35:37.410087 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.410064 2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 18:35:37.410170 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.410101 2575 kubelet.go:3370] "Failed creating a mirror pod" err="Post \"https://a90dbb53e21b64025bd8a889899b3b8c-58613a4e2a30bb43.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.135.218:46160->3.138.132.187:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:35:37.449655 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.449576 2575 apiserver.go:52] "Watching apiserver" Oct 30 18:35:37.475856 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.475826 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 18:35:37.532304 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.532241 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 18:30:36 +0000 UTC" deadline="2028-03-31 09:31:32.640796172 +0000 UTC" Oct 30 18:35:37.532304 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.532289 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12422h55m55.10851255s" Oct 30 18:35:37.532730 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.532711 2575 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 18:35:37.533114 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.533091 2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-q7q62","openshift-ovn-kubernetes/ovnkube-node-vksqc","openshift-dns/node-resolver-qv54m","openshift-multus/multus-additional-cni-plugins-zwf76","kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx","openshift-network-diagnostics/network-check-target-9dktd","openshift-network-operator/iptables-alerter-m82d8","kube-system/konnectivity-agent-5tlrv","openshift-cluster-node-tuning-operator/tuned-znlrr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal","openshift-multus/network-metrics-daemon-njrxt","kube-system/global-pull-secret-syncer-54kx8","openshift-image-registry/node-ca-zcm2q"] Oct 30 18:35:37.536254 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.535991 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.538495 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.538458 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.540733 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.540708 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qv54m" Oct 30 18:35:37.543081 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.543066 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.545527 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.545507 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.547889 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.547874 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:37.547966 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.547946 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:35:37.550314 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.550292 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:35:37.553030 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.552988 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 18:35:37.553030 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.553017 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-p2p55\"" Oct 30 18:35:37.553207 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.553101 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 18:35:37.554408 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.554385 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:35:37.556797 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.556781 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.558631 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.558603 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 18:35:37.559332 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.559313 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 18:35:37.559417 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.559337 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 18:35:37.559417 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.559392 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 18:35:37.559557 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.559438 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 18:35:37.559557 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.559451 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9gvp2\"" Oct 30 18:35:37.559649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.559604 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:37.559700 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.559657 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 18:35:37.559700 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.559665 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6x4zm\"" Oct 30 18:35:37.559700 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.559673 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:35:37.559842 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.559698 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 18:35:37.559842 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.559609 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 18:35:37.559842 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.559738 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 18:35:37.559842 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.559813 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j94tm\"" Oct 30 18:35:37.560792 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.560779 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 18:35:37.560792 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.560786 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 18:35:37.560870 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.560794 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 18:35:37.562236 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.562217 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:37.562315 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.562295 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:35:37.565327 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.565311 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:35:37.566366 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.566344 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 18:35:37.566455 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.566384 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 18:35:37.566455 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.566392 2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 18:35:37.566455 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.566438 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rxfwb" Oct 30 18:35:37.566455 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.566437 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 18:35:37.569876 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.566994 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m2hrx\"" Oct 30 18:35:37.576618 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.576596 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 18:35:37.582137 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-cni-netd\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.582257 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582143 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c64ea11-4f4d-4101-9d92-684e9cd106ac-serviceca\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:35:37.582257 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582161 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-ovn\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.582257 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582179 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-system-cni-dir\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.582381 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.582381 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582300 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-sys\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.582381 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksj94\" (UniqueName: \"kubernetes.io/projected/f12964ad-e99d-45a0-87e9-4fc1722d6e25-kube-api-access-ksj94\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:37.582521 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582427 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-etc-kubernetes\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.582521 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm7zz\" (UniqueName: \"kubernetes.io/projected/de091251-1364-4040-87b4-d6cc3a29c932-kube-api-access-qm7zz\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.582592 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582517 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-etc-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.582592 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-tmp-dir\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:35:37.582665 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582595 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9brbk\" (UniqueName: \"kubernetes.io/projected/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-kube-api-access-9brbk\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:35:37.582665 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582626 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-cni-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.582665 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582646 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-conf-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.582812 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582667 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-var-lib-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.582812 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxb7n\" (UniqueName: \"kubernetes.io/projected/007a2514-b71b-4588-ad8c-3cc364e353d6-kube-api-access-sxb7n\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.582812 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582721 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-sys-fs\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.582812 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582776 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.582812 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582807 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c87bw\" (UniqueName: \"kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw\") pod \"network-check-target-9dktd\" (UID: \"c176ae98-07b8-4c0f-a658-987a76e39e50\") " pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:37.583008 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582875 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-kubernetes\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.583008 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582915 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-socket-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.583008 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582952 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-device-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.583008 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.582991 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7-konnectivity-ca\") pod \"konnectivity-agent-5tlrv\" (UID: \"60d85957-1f67-4dfc-8ad1-c30f04b0b3f7\") " pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:35:37.583202 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cnibin\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.583202 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583077 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysctl-d\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.583202 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-env-overrides\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.583202 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c64ea11-4f4d-4101-9d92-684e9cd106ac-host\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:35:37.583202 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-hosts-file\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:35:37.583421 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583218 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4e96d8b-df57-498e-b290-39e0eb573f94-tmp\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.583421 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-log-socket\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.583421 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-iptables-alerter-script\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:35:37.583421 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583331 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ddec812-a5d4-45b1-8a57-70a9b5914964-dbus\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:37.583421 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-modprobe-d\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.583421 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583386 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysconfig\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.583681 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-systemd\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.583681 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583466 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.583681 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:37.583681 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr78f\" (UniqueName: \"kubernetes.io/projected/8c64ea11-4f4d-4101-9d92-684e9cd106ac-kube-api-access-jr78f\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:35:37.583681 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583574 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-var-lib-kubelet\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.583681 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-cnibin\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.583681 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583651 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-k8s-cni-cncf-io\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.583681 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583668 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.583980 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583715 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-host\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.583980 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-tuned\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.583980 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583776 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-run-netns\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.583980 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583795 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-systemd\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.583980 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.583980 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.583980 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583866 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-netns\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.583980 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583907 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-slash\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.583980 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583933 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7-agent-certs\") pod \"konnectivity-agent-5tlrv\" (UID: \"60d85957-1f67-4dfc-8ad1-c30f04b0b3f7\") " pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:35:37.583980 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ddec812-a5d4-45b1-8a57-70a9b5914964-kubelet-config\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.583989 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584017 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-cni-multus\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-cni-bin\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584107 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-ovnkube-script-lib\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-registration-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584163 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hngs\" (UniqueName: \"kubernetes.io/projected/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-kube-api-access-5hngs\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584214 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de091251-1364-4040-87b4-d6cc3a29c932-multus-daemon-config\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584235 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm2hc\" (UniqueName: \"kubernetes.io/projected/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-kube-api-access-gm2hc\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcjg6\" (UniqueName: \"kubernetes.io/projected/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-kube-api-access-vcjg6\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584278 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-socket-dir-parent\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584307 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-multus-certs\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfb6x\" (UniqueName: \"kubernetes.io/projected/b4e96d8b-df57-498e-b290-39e0eb573f94-kube-api-access-nfb6x\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584370 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-kubelet\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.585106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584402 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-kubelet\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-systemd-units\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-ovnkube-config\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysctl-conf\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de091251-1364-4040-87b4-d6cc3a29c932-cni-binary-copy\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584532 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-cni-bin\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584548 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-hostroot\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584589 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-node-log\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584624 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-host-slash\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-run\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584676 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/007a2514-b71b-4588-ad8c-3cc364e353d6-ovn-node-metrics-cert\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-lib-modules\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.585643 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.584857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-system-cni-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.652016 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:37.651983 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1141f188cb159776b4a1af048cbc31.slice/crio-6dbb4604499dc985263db6c12e4fb65abdccca23771082893592db9ec8e58a98 WatchSource:0}: Error finding container 6dbb4604499dc985263db6c12e4fb65abdccca23771082893592db9ec8e58a98: Status 404 returned error can't find the container with id 6dbb4604499dc985263db6c12e4fb65abdccca23771082893592db9ec8e58a98 Oct 30 18:35:37.653325 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:37.653294 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d34cdd4c09d30482e59285c4804c2a.slice/crio-6d5d9b0326a238be3818b2de56c5c90aa0271e5f8abea9b9ba9e60c47a437e27 WatchSource:0}: Error finding container 6d5d9b0326a238be3818b2de56c5c90aa0271e5f8abea9b9ba9e60c47a437e27: Status 404 returned error can't find the container with id 6d5d9b0326a238be3818b2de56c5c90aa0271e5f8abea9b9ba9e60c47a437e27 Oct 30 18:35:37.658187 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.658124 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 18:35:37.661438 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661407 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 18:35:37.661572 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661486 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7mnv2\"" Oct 30 18:35:37.661572 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661523 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vrsg5\"" Oct 30 18:35:37.661572 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661560 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 18:35:37.661685 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661590 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m478x\"" Oct 30 18:35:37.661685 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661598 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 18:35:37.661685 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661528 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 18:35:37.661685 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661622 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 18:35:37.661685 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661645 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-z5jb4\"" Oct 30 18:35:37.661685 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661650 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 18:35:37.661685 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661663 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 18:35:37.661685 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661667 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 18:35:37.662093 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661707 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 18:35:37.662093 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.661727 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 18:35:37.685998 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.685966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-ovn\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.685998 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.685998 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-system-cni-dir\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.686180 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686018 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.686180 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686034 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-sys\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.686180 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686063 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksj94\" (UniqueName: \"kubernetes.io/projected/f12964ad-e99d-45a0-87e9-4fc1722d6e25-kube-api-access-ksj94\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:37.686180 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686085 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-etc-kubernetes\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.686180 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686102 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-system-cni-dir\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.686180 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686110 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-ovn\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.686180 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686127 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-sys\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.686180 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm7zz\" (UniqueName: \"kubernetes.io/projected/de091251-1364-4040-87b4-d6cc3a29c932-kube-api-access-qm7zz\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.686180 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686169 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-etc-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.686180 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686175 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686198 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-tmp-dir\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686170 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-etc-kubernetes\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9brbk\" (UniqueName: \"kubernetes.io/projected/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-kube-api-access-9brbk\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-cni-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686292 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-etc-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686311 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-conf-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-var-lib-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxb7n\" (UniqueName: \"kubernetes.io/projected/007a2514-b71b-4588-ad8c-3cc364e353d6-kube-api-access-sxb7n\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686376 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-conf-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-sys-fs\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686400 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-var-lib-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686455 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686455 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-sys-fs\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686499 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-tmp-dir\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c87bw\" (UniqueName: \"kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw\") pod \"network-check-target-9dktd\" (UID: \"c176ae98-07b8-4c0f-a658-987a76e39e50\") " pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686618 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-cni-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.686686 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-kubernetes\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-socket-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686686 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-device-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7-konnectivity-ca\") pod \"konnectivity-agent-5tlrv\" (UID: \"60d85957-1f67-4dfc-8ad1-c30f04b0b3f7\") " pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cnibin\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686763 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-kubernetes\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686763 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-device-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686766 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysctl-d\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686814 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-socket-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686816 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-env-overrides\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686861 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c64ea11-4f4d-4101-9d92-684e9cd106ac-host\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686864 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysctl-d\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686887 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cnibin\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686889 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-hosts-file\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686907 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c64ea11-4f4d-4101-9d92-684e9cd106ac-host\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4e96d8b-df57-498e-b290-39e0eb573f94-tmp\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686931 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-hosts-file\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686948 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-log-socket\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.687471 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.686996 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-iptables-alerter-script\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ddec812-a5d4-45b1-8a57-70a9b5914964-dbus\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687023 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-log-socket\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687033 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-modprobe-d\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687023 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687048 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysconfig\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-systemd\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687111 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ddec812-a5d4-45b1-8a57-70a9b5914964-dbus\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687125 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687151 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-modprobe-d\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687165 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysconfig\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr78f\" (UniqueName: \"kubernetes.io/projected/8c64ea11-4f4d-4101-9d92-684e9cd106ac-kube-api-access-jr78f\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687209 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687221 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-var-lib-kubelet\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687258 2575 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687245 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-cnibin\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687294 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-k8s-cni-cncf-io\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.688241 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687349 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7-konnectivity-ca\") pod \"konnectivity-agent-5tlrv\" (UID: \"60d85957-1f67-4dfc-8ad1-c30f04b0b3f7\") " pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687339 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-host\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687417 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-var-lib-kubelet\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687429 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-tuned\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687432 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-cnibin\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687222 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-systemd\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687465 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-k8s-cni-cncf-io\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687386 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-host\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687497 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687462 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-run-netns\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687541 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-run-netns\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687542 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-systemd\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687593 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687562 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-systemd\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687643 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687685 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-netns\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.688959 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.687691 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687709 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-slash\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.687769 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret podName:3ddec812-a5d4-45b1-8a57-70a9b5914964 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:38.187750528 +0000 UTC m=+2.079204433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret") pod "global-pull-secret-syncer-54kx8" (UID: "3ddec812-a5d4-45b1-8a57-70a9b5914964") : object "kube-system"/"original-pull-secret" not registered Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687764 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-netns\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687789 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-slash\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687796 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-env-overrides\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687791 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7-agent-certs\") pod \"konnectivity-agent-5tlrv\" (UID: \"60d85957-1f67-4dfc-8ad1-c30f04b0b3f7\") " pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687823 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ddec812-a5d4-45b1-8a57-70a9b5914964-kubelet-config\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687858 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687880 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-cni-multus\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687888 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ddec812-a5d4-45b1-8a57-70a9b5914964-kubelet-config\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687916 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-cni-bin\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687933 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-cni-multus\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.687940 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-ovnkube-script-lib\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.689717 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687974 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-registration-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687979 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-cni-bin\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.687975 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.687990 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs podName:f12964ad-e99d-45a0-87e9-4fc1722d6e25 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:38.187974493 +0000 UTC m=+2.079428400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs") pod "network-metrics-daemon-njrxt" (UID: "f12964ad-e99d-45a0-87e9-4fc1722d6e25") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688020 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-registration-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688544 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hngs\" (UniqueName: \"kubernetes.io/projected/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-kube-api-access-5hngs\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688636 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de091251-1364-4040-87b4-d6cc3a29c932-multus-daemon-config\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688668 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm2hc\" (UniqueName: \"kubernetes.io/projected/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-kube-api-access-gm2hc\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688685 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-iptables-alerter-script\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688699 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcjg6\" (UniqueName: \"kubernetes.io/projected/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-kube-api-access-vcjg6\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688730 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-socket-dir-parent\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-multus-certs\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfb6x\" (UniqueName: \"kubernetes.io/projected/b4e96d8b-df57-498e-b290-39e0eb573f94-kube-api-access-nfb6x\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688810 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-kubelet\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688837 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-kubelet\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.690200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688845 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-ovnkube-script-lib\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-systemd-units\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-ovnkube-config\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688915 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysctl-conf\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688932 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-multus-certs\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688943 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de091251-1364-4040-87b4-d6cc3a29c932-cni-binary-copy\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.688972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-cni-bin\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689112 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-hostroot\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-node-log\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-host-slash\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-run\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/007a2514-b71b-4588-ad8c-3cc364e353d6-ovn-node-metrics-cert\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689299 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-lib-modules\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-system-cni-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689363 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-cni-netd\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689401 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c64ea11-4f4d-4101-9d92-684e9cd106ac-serviceca\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689464 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de091251-1364-4040-87b4-d6cc3a29c932-multus-daemon-config\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.690781 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689546 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-systemd-units\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.689901 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c64ea11-4f4d-4101-9d92-684e9cd106ac-serviceca\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.690116 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-ovnkube-config\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.690221 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-kubelet\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.690282 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-cni-bin\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.690338 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-hostroot\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.690390 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-node-log\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.690442 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-host-slash\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.690519 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-run\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.690697 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-socket-dir-parent\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.690753 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-kubelet\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.690859 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysctl-conf\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.691135 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.691192 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-lib-modules\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.691266 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-system-cni-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.691312 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de091251-1364-4040-87b4-d6cc3a29c932-cni-binary-copy\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.691322 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-cni-netd\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.693770 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.691696 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.694288 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.693839 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4e96d8b-df57-498e-b290-39e0eb573f94-tmp\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.694288 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.693860 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-tuned\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.694288 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.693954 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/007a2514-b71b-4588-ad8c-3cc364e353d6-ovn-node-metrics-cert\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.694288 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.694070 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7-agent-certs\") pod \"konnectivity-agent-5tlrv\" (UID: \"60d85957-1f67-4dfc-8ad1-c30f04b0b3f7\") " pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:35:37.710070 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.710002 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 18:35:37.710070 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.710024 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 18:35:37.710070 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.710038 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c87bw for pod openshift-network-diagnostics/network-check-target-9dktd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:35:37.710357 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:37.710105 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw podName:c176ae98-07b8-4c0f-a658-987a76e39e50 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:38.210089346 +0000 UTC m=+2.101543237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c87bw" (UniqueName: "kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw") pod "network-check-target-9dktd" (UID: "c176ae98-07b8-4c0f-a658-987a76e39e50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:35:37.712811 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.712785 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr78f\" (UniqueName: \"kubernetes.io/projected/8c64ea11-4f4d-4101-9d92-684e9cd106ac-kube-api-access-jr78f\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:35:37.712925 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.712814 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm7zz\" (UniqueName: \"kubernetes.io/projected/de091251-1364-4040-87b4-d6cc3a29c932-kube-api-access-qm7zz\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.712925 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.712843 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxb7n\" (UniqueName: \"kubernetes.io/projected/007a2514-b71b-4588-ad8c-3cc364e353d6-kube-api-access-sxb7n\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.712925 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.712857 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksj94\" (UniqueName: \"kubernetes.io/projected/f12964ad-e99d-45a0-87e9-4fc1722d6e25-kube-api-access-ksj94\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:37.712925 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.712843 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9brbk\" (UniqueName: \"kubernetes.io/projected/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-kube-api-access-9brbk\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:35:37.713237 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.713210 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hngs\" (UniqueName: \"kubernetes.io/projected/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-kube-api-access-5hngs\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.714645 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.714623 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfb6x\" (UniqueName: \"kubernetes.io/projected/b4e96d8b-df57-498e-b290-39e0eb573f94-kube-api-access-nfb6x\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.714751 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.714732 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcjg6\" (UniqueName: \"kubernetes.io/projected/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-kube-api-access-vcjg6\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:35:37.714949 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.714929 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm2hc\" (UniqueName: \"kubernetes.io/projected/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-kube-api-access-gm2hc\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.868375 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.868336 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q7q62" Oct 30 18:35:37.879299 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:37.879269 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde091251_1364_4040_87b4_d6cc3a29c932.slice/crio-8d314d6739bbeea0f00143837bb10ad68e0bb2a5736a003518db2f2efd875518 WatchSource:0}: Error finding container 8d314d6739bbeea0f00143837bb10ad68e0bb2a5736a003518db2f2efd875518: Status 404 returned error can't find the container with id 8d314d6739bbeea0f00143837bb10ad68e0bb2a5736a003518db2f2efd875518 Oct 30 18:35:37.883396 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.883376 2575 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:35:37.889542 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.889516 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qv54m" Oct 30 18:35:37.896677 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.896653 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:37.898932 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:37.898909 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7bc982_8239_4919_84ca_8b7ee2f95fc7.slice/crio-76b83fe6a2757870c668ab18513af15d5fcd4f64464a9b797a88bbd4bc0b54c0 WatchSource:0}: Error finding container 76b83fe6a2757870c668ab18513af15d5fcd4f64464a9b797a88bbd4bc0b54c0: Status 404 returned error can't find the container with id 76b83fe6a2757870c668ab18513af15d5fcd4f64464a9b797a88bbd4bc0b54c0 Oct 30 18:35:37.905930 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:37.905908 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod007a2514_b71b_4588_ad8c_3cc364e353d6.slice/crio-c02157b1f462baaf2d0b4374bf2873d4f0f411d9758e5faf03c4ec66ef244729 WatchSource:0}: Error finding container c02157b1f462baaf2d0b4374bf2873d4f0f411d9758e5faf03c4ec66ef244729: Status 404 returned error can't find the container with id c02157b1f462baaf2d0b4374bf2873d4f0f411d9758e5faf03c4ec66ef244729 Oct 30 18:35:37.914034 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.914011 2575 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:35:37.919219 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.919199 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:35:37.930414 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:37.930382 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4632d42f_41b0_4a3d_bc08_c813f2f72cc1.slice/crio-d85eb7b1c5a956b5c3f164267ab518cf06a12fa47e48ee30360e426a2ea8252b WatchSource:0}: Error finding container d85eb7b1c5a956b5c3f164267ab518cf06a12fa47e48ee30360e426a2ea8252b: Status 404 returned error can't find the container with id d85eb7b1c5a956b5c3f164267ab518cf06a12fa47e48ee30360e426a2ea8252b Oct 30 18:35:37.934875 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.934857 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:35:37.943675 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:37.943642 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da3a0a5_bd8e_4364_ae65_51d6c71513f7.slice/crio-b6d096caa125cea09342649b064492677942c462f950523c64bacba56a338cf9 WatchSource:0}: Error finding container b6d096caa125cea09342649b064492677942c462f950523c64bacba56a338cf9: Status 404 returned error can't find the container with id b6d096caa125cea09342649b064492677942c462f950523c64bacba56a338cf9 Oct 30 18:35:37.955270 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.955248 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:35:37.964681 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:37.964659 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba85233e_cc2d_4df5_a6ac_0901f57b4b03.slice/crio-4611b4685b1b1477b77b8cd3e7b17bd017ca1bad8683b3239464c93a0213fa73 WatchSource:0}: Error finding container 4611b4685b1b1477b77b8cd3e7b17bd017ca1bad8683b3239464c93a0213fa73: Status 404 returned error can't find the container with id 4611b4685b1b1477b77b8cd3e7b17bd017ca1bad8683b3239464c93a0213fa73 Oct 30 18:35:37.969087 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.969058 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:35:37.974976 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.974960 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:35:37.978789 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:37.978765 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d85957_1f67_4dfc_8ad1_c30f04b0b3f7.slice/crio-c1ae33372da8d0f7542ca8205faa0f29fe80f57f8768caf3c3f5564c8ff54634 WatchSource:0}: Error finding container c1ae33372da8d0f7542ca8205faa0f29fe80f57f8768caf3c3f5564c8ff54634: Status 404 returned error can't find the container with id c1ae33372da8d0f7542ca8205faa0f29fe80f57f8768caf3c3f5564c8ff54634 Oct 30 18:35:37.980194 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:37.980176 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:35:37.984805 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:37.984777 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e96d8b_df57_498e_b290_39e0eb573f94.slice/crio-169323b3fb9b9562426c210394a336fe3ac83cea1dbaeed861a3a1e3e82cc670 WatchSource:0}: Error finding container 169323b3fb9b9562426c210394a336fe3ac83cea1dbaeed861a3a1e3e82cc670: Status 404 returned error can't find the container with id 169323b3fb9b9562426c210394a336fe3ac83cea1dbaeed861a3a1e3e82cc670 Oct 30 18:35:37.991015 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:35:37.990987 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c64ea11_4f4d_4101_9d92_684e9cd106ac.slice/crio-4f01339848e3b66d76bd18b4c5ede78fa8dbc003931046a0917b7e0b1ad2527c WatchSource:0}: Error finding container 4f01339848e3b66d76bd18b4c5ede78fa8dbc003931046a0917b7e0b1ad2527c: Status 404 returned error can't find the container with id 4f01339848e3b66d76bd18b4c5ede78fa8dbc003931046a0917b7e0b1ad2527c Oct 30 18:35:38.192914 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.192872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:38.193103 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.192973 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:38.193103 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:38.193078 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:35:38.193103 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:38.193099 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 18:35:38.193277 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:38.193150 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs podName:f12964ad-e99d-45a0-87e9-4fc1722d6e25 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:39.193135372 +0000 UTC m=+3.084589266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs") pod "network-metrics-daemon-njrxt" (UID: "f12964ad-e99d-45a0-87e9-4fc1722d6e25") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:35:38.193277 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:38.193166 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret podName:3ddec812-a5d4-45b1-8a57-70a9b5914964 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:39.193159636 +0000 UTC m=+3.084613514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret") pod "global-pull-secret-syncer-54kx8" (UID: "3ddec812-a5d4-45b1-8a57-70a9b5914964") : object "kube-system"/"original-pull-secret" not registered Oct 30 18:35:38.293971 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.293885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c87bw\" (UniqueName: \"kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw\") pod \"network-check-target-9dktd\" (UID: \"c176ae98-07b8-4c0f-a658-987a76e39e50\") " pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:38.294148 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:38.294073 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 18:35:38.294148 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:38.294092 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 18:35:38.294148 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:38.294102 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c87bw for pod openshift-network-diagnostics/network-check-target-9dktd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:35:38.294148 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:38.294150 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw podName:c176ae98-07b8-4c0f-a658-987a76e39e50 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:39.294136268 +0000 UTC m=+3.185590161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c87bw" (UniqueName: "kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw") pod "network-check-target-9dktd" (UID: "c176ae98-07b8-4c0f-a658-987a76e39e50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:35:38.315275 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.315226 2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:35:38.573928 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.573812 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 18:30:37 +0000 UTC" deadline="2028-03-27 19:21:35.987421984 +0000 UTC" Oct 30 18:35:38.573928 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.573876 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12336h45m57.413550251s" Oct 30 18:35:38.613105 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.613036 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5tlrv" event={"ID":"60d85957-1f67-4dfc-8ad1-c30f04b0b3f7","Type":"ContainerStarted","Data":"c1ae33372da8d0f7542ca8205faa0f29fe80f57f8768caf3c3f5564c8ff54634"} Oct 30 18:35:38.616086 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.616055 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m82d8" event={"ID":"ba85233e-cc2d-4df5-a6ac-0901f57b4b03","Type":"ContainerStarted","Data":"4611b4685b1b1477b77b8cd3e7b17bd017ca1bad8683b3239464c93a0213fa73"} Oct 30 18:35:38.631546 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.627407 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" event={"ID":"007a2514-b71b-4588-ad8c-3cc364e353d6","Type":"ContainerStarted","Data":"c02157b1f462baaf2d0b4374bf2873d4f0f411d9758e5faf03c4ec66ef244729"} Oct 30 18:35:38.634708 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.634677 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qv54m" event={"ID":"3c7bc982-8239-4919-84ca-8b7ee2f95fc7","Type":"ContainerStarted","Data":"76b83fe6a2757870c668ab18513af15d5fcd4f64464a9b797a88bbd4bc0b54c0"} Oct 30 18:35:38.641127 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.641091 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" event={"ID":"0a1141f188cb159776b4a1af048cbc31","Type":"ContainerStarted","Data":"6dbb4604499dc985263db6c12e4fb65abdccca23771082893592db9ec8e58a98"} Oct 30 18:35:38.644944 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.644882 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zcm2q" event={"ID":"8c64ea11-4f4d-4101-9d92-684e9cd106ac","Type":"ContainerStarted","Data":"4f01339848e3b66d76bd18b4c5ede78fa8dbc003931046a0917b7e0b1ad2527c"} Oct 30 18:35:38.648333 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.648298 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-znlrr" event={"ID":"b4e96d8b-df57-498e-b290-39e0eb573f94","Type":"ContainerStarted","Data":"169323b3fb9b9562426c210394a336fe3ac83cea1dbaeed861a3a1e3e82cc670"} Oct 30 18:35:38.665214 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.665175 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" event={"ID":"4da3a0a5-bd8e-4364-ae65-51d6c71513f7","Type":"ContainerStarted","Data":"b6d096caa125cea09342649b064492677942c462f950523c64bacba56a338cf9"} Oct 30 18:35:38.674748 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.674709 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwf76" event={"ID":"4632d42f-41b0-4a3d-bc08-c813f2f72cc1","Type":"ContainerStarted","Data":"d85eb7b1c5a956b5c3f164267ab518cf06a12fa47e48ee30360e426a2ea8252b"} Oct 30 18:35:38.677157 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.677124 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q7q62" event={"ID":"de091251-1364-4040-87b4-d6cc3a29c932","Type":"ContainerStarted","Data":"8d314d6739bbeea0f00143837bb10ad68e0bb2a5736a003518db2f2efd875518"} Oct 30 18:35:38.690090 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:38.690058 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" event={"ID":"40d34cdd4c09d30482e59285c4804c2a","Type":"ContainerStarted","Data":"6d5d9b0326a238be3818b2de56c5c90aa0271e5f8abea9b9ba9e60c47a437e27"} Oct 30 18:35:39.031812 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:39.031699 2575 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:35:39.201562 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:39.201515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:39.201765 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:39.201596 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:39.201765 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:39.201743 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:35:39.201890 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:39.201813 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs podName:f12964ad-e99d-45a0-87e9-4fc1722d6e25 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:41.201792168 +0000 UTC m=+5.093246067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs") pod "network-metrics-daemon-njrxt" (UID: "f12964ad-e99d-45a0-87e9-4fc1722d6e25") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:35:39.202283 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:39.202259 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 18:35:39.202362 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:39.202329 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret podName:3ddec812-a5d4-45b1-8a57-70a9b5914964 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:41.202311946 +0000 UTC m=+5.093765842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret") pod "global-pull-secret-syncer-54kx8" (UID: "3ddec812-a5d4-45b1-8a57-70a9b5914964") : object "kube-system"/"original-pull-secret" not registered Oct 30 18:35:39.302551 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:39.302450 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c87bw\" (UniqueName: \"kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw\") pod \"network-check-target-9dktd\" (UID: \"c176ae98-07b8-4c0f-a658-987a76e39e50\") " pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:39.302768 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:39.302745 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 18:35:39.302861 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:39.302774 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 18:35:39.302861 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:39.302788 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c87bw for pod openshift-network-diagnostics/network-check-target-9dktd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:35:39.302970 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:39.302849 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw podName:c176ae98-07b8-4c0f-a658-987a76e39e50 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:41.302831394 +0000 UTC m=+5.194285288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c87bw" (UniqueName: "kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw") pod "network-check-target-9dktd" (UID: "c176ae98-07b8-4c0f-a658-987a76e39e50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:35:39.575220 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:39.575110 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 18:30:37 +0000 UTC" deadline="2028-04-26 13:02:34.039702869 +0000 UTC" Oct 30 18:35:39.575220 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:39.575150 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13050h26m54.46455754s" Oct 30 18:35:39.601168 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:39.601127 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:39.601539 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:39.601288 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:35:39.602052 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:39.602029 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:39.602164 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:39.602135 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:35:39.602227 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:39.602211 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:39.602319 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:39.602277 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:35:41.218059 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:41.217328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:41.218059 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:41.217451 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:41.218059 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:41.217596 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 18:35:41.218059 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:41.217666 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret podName:3ddec812-a5d4-45b1-8a57-70a9b5914964 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:45.217647325 +0000 UTC m=+9.109101223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret") pod "global-pull-secret-syncer-54kx8" (UID: "3ddec812-a5d4-45b1-8a57-70a9b5914964") : object "kube-system"/"original-pull-secret" not registered Oct 30 18:35:41.218059 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:41.217998 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:35:41.218059 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:41.218034 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs podName:f12964ad-e99d-45a0-87e9-4fc1722d6e25 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:45.218024079 +0000 UTC m=+9.109477971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs") pod "network-metrics-daemon-njrxt" (UID: "f12964ad-e99d-45a0-87e9-4fc1722d6e25") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:35:41.318746 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:41.318588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c87bw\" (UniqueName: \"kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw\") pod \"network-check-target-9dktd\" (UID: \"c176ae98-07b8-4c0f-a658-987a76e39e50\") " pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:41.318916 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:41.318776 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 18:35:41.318916 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:41.318802 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 18:35:41.318916 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:41.318815 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c87bw for pod openshift-network-diagnostics/network-check-target-9dktd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:35:41.318916 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:41.318872 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw podName:c176ae98-07b8-4c0f-a658-987a76e39e50 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:45.318854382 +0000 UTC m=+9.210308275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c87bw" (UniqueName: "kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw") pod "network-check-target-9dktd" (UID: "c176ae98-07b8-4c0f-a658-987a76e39e50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:35:41.601396 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:41.601313 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:41.601573 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:41.601477 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:35:41.601893 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:41.601869 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:41.602028 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:41.602004 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:35:41.602094 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:41.602072 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:41.602197 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:41.602165 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:35:41.712684 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:41.711574 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwf76" event={"ID":"4632d42f-41b0-4a3d-bc08-c813f2f72cc1","Type":"ContainerStarted","Data":"c84c9eb90a5e6c26c2f33216108be35a7ed67bc2a818980c09ec69ed43de0bed"} Oct 30 18:35:42.725769 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:42.724968 2575 generic.go:356] "Generic (PLEG): container finished" podID="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" containerID="c84c9eb90a5e6c26c2f33216108be35a7ed67bc2a818980c09ec69ed43de0bed" exitCode=0 Oct 30 18:35:42.725769 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:42.725045 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwf76" event={"ID":"4632d42f-41b0-4a3d-bc08-c813f2f72cc1","Type":"ContainerDied","Data":"c84c9eb90a5e6c26c2f33216108be35a7ed67bc2a818980c09ec69ed43de0bed"} Oct 30 18:35:42.740195 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:42.739259 2575 generic.go:356] "Generic (PLEG): container finished" podID="40d34cdd4c09d30482e59285c4804c2a" containerID="35b156e389b17448c4a1e1d8bb59d9fa6135245cf9fee6248ec84320d0987ba8" exitCode=0 Oct 30 18:35:42.740195 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:42.739351 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" event={"ID":"40d34cdd4c09d30482e59285c4804c2a","Type":"ContainerDied","Data":"35b156e389b17448c4a1e1d8bb59d9fa6135245cf9fee6248ec84320d0987ba8"} Oct 30 18:35:42.744912 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:42.744493 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" event={"ID":"0a1141f188cb159776b4a1af048cbc31","Type":"ContainerStarted","Data":"94599eda7c4a08d8c6f9b66ee5c859cc1db1e847fc6b5935dbde3a75ee19ae07"} Oct 30 18:35:42.856899 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:42.856838 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" podStartSLOduration=5.856823011 podStartE2EDuration="5.856823011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:35:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:35:42.820147555 +0000 UTC m=+6.711601523" watchObservedRunningTime="2026-10-30 18:35:42.856823011 +0000 UTC m=+6.748276909" Oct 30 18:35:43.600811 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:43.600779 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:43.600811 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:43.600803 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:43.601025 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:43.600898 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:35:43.601025 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:43.600973 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:35:43.601025 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:43.601025 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:43.601178 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:43.601085 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:35:43.750237 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:43.750199 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zcm2q" event={"ID":"8c64ea11-4f4d-4101-9d92-684e9cd106ac","Type":"ContainerStarted","Data":"197bf87a69c631672aebb67b963ca4c06e92602de6eedef3cd3b732f22008aa0"} Oct 30 18:35:43.759077 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:43.759042 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" event={"ID":"40d34cdd4c09d30482e59285c4804c2a","Type":"ContainerStarted","Data":"67b477da57f953df54dcf042abd556d63f5f7b5ce8ae2878398d29e66501ebeb"} Oct 30 18:35:43.762888 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:43.762814 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5tlrv" event={"ID":"60d85957-1f67-4dfc-8ad1-c30f04b0b3f7","Type":"ContainerStarted","Data":"fac1af29f352dca8ca32ae4a0f91301443cb1d3be312b18e7144a603352cf804"} Oct 30 18:35:43.788421 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:43.787486 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zcm2q" podStartSLOduration=1.401717768 podStartE2EDuration="6.787468418s" totalImagesPullingTime="5.38575065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:35:43.786836416 +0000 UTC m=+7.678290314" watchObservedRunningTime="2026-10-30 18:35:43.787468418 +0000 UTC m=+7.678922319" Oct 30 18:35:43.861704 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:43.860530 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5tlrv" podStartSLOduration=2.245942626 podStartE2EDuration="6.860510489s" totalImagesPullingTime="4.614567863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:35:43.824022144 +0000 UTC m=+7.715476045" watchObservedRunningTime="2026-10-30 18:35:43.860510489 +0000 UTC m=+7.751964388" Oct 30 18:35:43.909566 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:43.909392 2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:35:43.910238 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:43.910031 2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:35:43.950424 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:43.947273 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" podStartSLOduration=6.947256441 podStartE2EDuration="6.947256441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:35:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:35:43.861687667 +0000 UTC m=+7.753141565" watchObservedRunningTime="2026-10-30 18:35:43.947256441 +0000 UTC m=+7.838710361" Oct 30 18:35:44.235944 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:44.235835 2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:35:44.236912 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:44.236653 2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:35:44.771493 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:44.771400 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" event={"ID":"4da3a0a5-bd8e-4364-ae65-51d6c71513f7","Type":"ContainerStarted","Data":"255f0a4c46715fe7e8232ed62474f04a5f9b6398903a95e278aa8777032b2b78"} Oct 30 18:35:45.255123 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:45.255083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:45.255280 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:45.255177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:45.255332 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:45.255296 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 18:35:45.255397 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:45.255355 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret podName:3ddec812-a5d4-45b1-8a57-70a9b5914964 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:53.255337599 +0000 UTC m=+17.146791482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret") pod "global-pull-secret-syncer-54kx8" (UID: "3ddec812-a5d4-45b1-8a57-70a9b5914964") : object "kube-system"/"original-pull-secret" not registered Oct 30 18:35:45.255809 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:45.255788 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:35:45.255890 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:45.255850 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs podName:f12964ad-e99d-45a0-87e9-4fc1722d6e25 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:53.255833962 +0000 UTC m=+17.147287858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs") pod "network-metrics-daemon-njrxt" (UID: "f12964ad-e99d-45a0-87e9-4fc1722d6e25") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:35:45.355809 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:45.355770 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c87bw\" (UniqueName: \"kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw\") pod \"network-check-target-9dktd\" (UID: \"c176ae98-07b8-4c0f-a658-987a76e39e50\") " pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:45.356065 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:45.356012 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 18:35:45.356065 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:45.356040 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 18:35:45.356065 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:45.356053 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c87bw for pod openshift-network-diagnostics/network-check-target-9dktd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:35:45.356231 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:45.356111 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw podName:c176ae98-07b8-4c0f-a658-987a76e39e50 nodeName:}" failed. No retries permitted until 2026-10-30 18:35:53.356094156 +0000 UTC m=+17.247548047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c87bw" (UniqueName: "kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw") pod "network-check-target-9dktd" (UID: "c176ae98-07b8-4c0f-a658-987a76e39e50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:35:45.601855 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:45.600951 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:45.601855 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:45.601100 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:35:45.601855 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:45.601521 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:45.601855 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:45.601614 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:35:45.601855 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:45.601666 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:45.601855 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:45.601730 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:35:46.112699 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:46.112679 2575 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 18:35:46.552229 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:46.551173 2575 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T18:35:46.112695874Z","UUID":"8ed670cb-d7aa-4d76-af7c-48e82fe36447","Handler":null,"Name":"","Endpoint":""} Oct 30 18:35:46.556354 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:46.556311 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 18:35:46.556354 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:46.556347 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 18:35:46.777265 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:46.777183 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qv54m" event={"ID":"3c7bc982-8239-4919-84ca-8b7ee2f95fc7","Type":"ContainerStarted","Data":"0a03b198cb52e0cfb4c52d70e19985da759d2348143450c91b75a8127d39ad00"} Oct 30 18:35:46.779296 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:46.779265 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" event={"ID":"4da3a0a5-bd8e-4364-ae65-51d6c71513f7","Type":"ContainerStarted","Data":"1c8dee596d3bddba1adbe53757dccafacf5f7d7d8b540ccdaeefde3e12e1825f"} Oct 30 18:35:46.780897 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:46.780875 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q7q62" event={"ID":"de091251-1364-4040-87b4-d6cc3a29c932","Type":"ContainerStarted","Data":"efdac323d5d4cc2b66f9b36b5cedb3c802483f47bb1eeb5c3671fa0d89a46f6d"} Oct 30 18:35:46.816439 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:46.814828 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-qv54m" podStartSLOduration=1.3810915449999999 podStartE2EDuration="9.814811153s" totalImagesPullingTime="8.433719608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:35:46.814429341 +0000 UTC m=+10.705883240" watchObservedRunningTime="2026-10-30 18:35:46.814811153 +0000 UTC m=+10.706265051" Oct 30 18:35:46.852860 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:46.852814 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-q7q62" podStartSLOduration=2.043051093 podStartE2EDuration="9.852799682s" totalImagesPullingTime="7.809748589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:35:46.852613233 +0000 UTC m=+10.744067130" watchObservedRunningTime="2026-10-30 18:35:46.852799682 +0000 UTC m=+10.744253580" Oct 30 18:35:47.601094 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:47.600906 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:47.601547 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:47.601193 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:35:47.601682 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:47.601589 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:47.601742 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:47.601724 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:35:47.601850 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:47.601833 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:47.601950 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:47.601923 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:35:47.787153 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:47.787117 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" event={"ID":"4da3a0a5-bd8e-4364-ae65-51d6c71513f7","Type":"ContainerStarted","Data":"ba6ef6d0a7d1c2e4fb6722d189830e96fbea249152a80c7ae0fe5269e845560b"} Oct 30 18:35:47.790006 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:47.789978 2575 generic.go:356] "Generic (PLEG): container finished" podID="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" containerID="df8da2f66d17e5471f9028965c8cf3de7ae3274e170075ed726ab651692582d1" exitCode=0 Oct 30 18:35:47.790261 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:47.790221 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwf76" event={"ID":"4632d42f-41b0-4a3d-bc08-c813f2f72cc1","Type":"ContainerDied","Data":"df8da2f66d17e5471f9028965c8cf3de7ae3274e170075ed726ab651692582d1"} Oct 30 18:35:47.791930 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:47.791906 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m82d8" event={"ID":"ba85233e-cc2d-4df5-a6ac-0901f57b4b03","Type":"ContainerStarted","Data":"918521cea103addf679eeaecd9769f3969dcf384797dbe421550403db2496e41"} Oct 30 18:35:47.825988 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:47.825938 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" podStartSLOduration=2.080768125 podStartE2EDuration="10.825919985s" totalImagesPullingTime="8.74515186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:35:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:35:47.825502235 +0000 UTC m=+11.716956138" watchObservedRunningTime="2026-10-30 18:35:47.825919985 +0000 UTC m=+11.717373877" Oct 30 18:35:47.904103 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:47.904004 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m82d8" podStartSLOduration=2.646328853 podStartE2EDuration="10.90398483s" totalImagesPullingTime="8.257655977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:35:47.863562946 +0000 UTC m=+11.755016844" watchObservedRunningTime="2026-10-30 18:35:47.90398483 +0000 UTC m=+11.795438729" Oct 30 18:35:48.794922 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:48.794875 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-znlrr" event={"ID":"b4e96d8b-df57-498e-b290-39e0eb573f94","Type":"ContainerStarted","Data":"8949f68f6dd12328a2bf13d7816fa5a441d0ceec457efef3de8fd664e83c719f"} Oct 30 18:35:48.796889 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:48.796862 2575 generic.go:356] "Generic (PLEG): container finished" podID="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" containerID="3655ec4877bd17fd6281ccba452a79caab16ee0b3a761b198facc8a6243d835c" exitCode=0 Oct 30 18:35:48.796995 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:48.796939 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwf76" event={"ID":"4632d42f-41b0-4a3d-bc08-c813f2f72cc1","Type":"ContainerDied","Data":"3655ec4877bd17fd6281ccba452a79caab16ee0b3a761b198facc8a6243d835c"} Oct 30 18:35:48.835595 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:48.835541 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-znlrr" podStartSLOduration=1.754116608 podStartE2EDuration="11.835528604s" totalImagesPullingTime="10.081411996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:35:48.835034992 +0000 UTC m=+12.726488891" watchObservedRunningTime="2026-10-30 18:35:48.835528604 +0000 UTC m=+12.726982539" Oct 30 18:35:49.601013 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:49.600969 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:49.601201 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:49.601022 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:49.601201 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:49.601076 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:49.601201 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:49.601091 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:35:49.601201 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:49.601162 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:35:49.601365 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:49.601215 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:35:50.803751 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:50.803716 2575 generic.go:356] "Generic (PLEG): container finished" podID="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" containerID="628d461ac4839cee8e4ad00f4ed69b5be5e8f5a457a3da1965a1355238ee7744" exitCode=0 Oct 30 18:35:50.804446 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:50.803768 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwf76" event={"ID":"4632d42f-41b0-4a3d-bc08-c813f2f72cc1","Type":"ContainerDied","Data":"628d461ac4839cee8e4ad00f4ed69b5be5e8f5a457a3da1965a1355238ee7744"} Oct 30 18:35:51.601102 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:51.601065 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:51.601281 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:51.601192 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:35:51.601525 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:51.601502 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:51.601620 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:51.601591 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:35:51.601738 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:51.601647 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:51.601792 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:51.601735 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:35:52.810627 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:52.810445 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:35:52.811063 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:52.811037 2575 generic.go:356] "Generic (PLEG): container finished" podID="007a2514-b71b-4588-ad8c-3cc364e353d6" containerID="03c46e22a2dec41e58c48148ba8d86a68a12509658f3390a680ebdb22aa2bfce" exitCode=1 Oct 30 18:35:52.811157 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:52.811141 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" event={"ID":"007a2514-b71b-4588-ad8c-3cc364e353d6","Type":"ContainerStarted","Data":"162175e700dde546a2a8affeb97b696043aea1daa5d5db9350ed45cf092c662b"} Oct 30 18:35:52.811231 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:52.811216 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" event={"ID":"007a2514-b71b-4588-ad8c-3cc364e353d6","Type":"ContainerDied","Data":"03c46e22a2dec41e58c48148ba8d86a68a12509658f3390a680ebdb22aa2bfce"} Oct 30 18:35:52.811284 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:52.811271 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" event={"ID":"007a2514-b71b-4588-ad8c-3cc364e353d6","Type":"ContainerStarted","Data":"ac47ab1e8571ae81c36d1e637cbfdb84ca638518b67f7de461fa324950ca2b54"} Oct 30 18:35:52.814393 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:52.814371 2575 generic.go:356] "Generic (PLEG): container finished" podID="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" containerID="618376fd638996f27616b80e7e96cff4473f2fe86c7eefd8647b437e661036e9" exitCode=0 Oct 30 18:35:52.814489 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:52.814427 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwf76" event={"ID":"4632d42f-41b0-4a3d-bc08-c813f2f72cc1","Type":"ContainerDied","Data":"618376fd638996f27616b80e7e96cff4473f2fe86c7eefd8647b437e661036e9"} Oct 30 18:35:53.319982 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:53.319759 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:53.319982 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:53.319901 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 18:35:53.320211 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:53.320001 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret podName:3ddec812-a5d4-45b1-8a57-70a9b5914964 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:09.319986275 +0000 UTC m=+33.211440151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret") pod "global-pull-secret-syncer-54kx8" (UID: "3ddec812-a5d4-45b1-8a57-70a9b5914964") : object "kube-system"/"original-pull-secret" not registered Oct 30 18:35:53.320211 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:53.320017 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:35:53.320211 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:53.319942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:53.320211 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:53.320064 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs podName:f12964ad-e99d-45a0-87e9-4fc1722d6e25 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:09.320051002 +0000 UTC m=+33.211504898 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs") pod "network-metrics-daemon-njrxt" (UID: "f12964ad-e99d-45a0-87e9-4fc1722d6e25") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 18:35:53.421334 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:53.421292 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c87bw\" (UniqueName: \"kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw\") pod \"network-check-target-9dktd\" (UID: \"c176ae98-07b8-4c0f-a658-987a76e39e50\") " pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:53.421518 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:53.421473 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 18:35:53.421518 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:53.421491 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 18:35:53.421518 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:53.421500 2575 projected.go:196] Error preparing data for projected volume kube-api-access-c87bw for pod openshift-network-diagnostics/network-check-target-9dktd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:35:53.421610 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:53.421545 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw podName:c176ae98-07b8-4c0f-a658-987a76e39e50 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:09.421533375 +0000 UTC m=+33.312987254 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c87bw" (UniqueName: "kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw") pod "network-check-target-9dktd" (UID: "c176ae98-07b8-4c0f-a658-987a76e39e50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 18:35:53.601648 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:53.601570 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:53.601648 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:53.601606 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:53.601869 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:53.601677 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:53.601869 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:53.601680 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:35:53.601869 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:53.601740 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:35:53.601869 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:53.601812 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:35:53.819900 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:53.819864 2575 generic.go:356] "Generic (PLEG): container finished" podID="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" containerID="b379492a8be5d6a61a2af98025f9fbc31fce685f234b79024402b92b9d666f2d" exitCode=0 Oct 30 18:35:53.820424 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:53.819943 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwf76" event={"ID":"4632d42f-41b0-4a3d-bc08-c813f2f72cc1","Type":"ContainerDied","Data":"b379492a8be5d6a61a2af98025f9fbc31fce685f234b79024402b92b9d666f2d"} Oct 30 18:35:53.822656 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:53.822632 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:35:53.822978 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:53.822959 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" event={"ID":"007a2514-b71b-4588-ad8c-3cc364e353d6","Type":"ContainerStarted","Data":"f73fc6bff0a45c7835a2efc84d33b425cc797b79120692bf968a3bb970b57bbb"} Oct 30 18:35:53.823053 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:53.823034 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" event={"ID":"007a2514-b71b-4588-ad8c-3cc364e353d6","Type":"ContainerStarted","Data":"6d34b4fc682316b52c949a74fd34dc4484a78b4ad0514dd4c9bc3fd674c072f8"} Oct 30 18:35:53.823109 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:53.823087 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" event={"ID":"007a2514-b71b-4588-ad8c-3cc364e353d6","Type":"ContainerStarted","Data":"2c4d95a95291340824ce9a9a12b5814b09b94c33206191b2e5bf99d639ef227a"} Oct 30 18:35:54.828180 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:54.828139 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwf76" event={"ID":"4632d42f-41b0-4a3d-bc08-c813f2f72cc1","Type":"ContainerStarted","Data":"f75736e9a5894a0387b2a6700054c0cb0c9fd5b70ffd32cffe828ec39b24202e"} Oct 30 18:35:54.894279 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:54.894231 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zwf76" podStartSLOduration=7.722631004 podStartE2EDuration="17.894216059s" totalImagesPullingTime="10.171585055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:35:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:35:54.893626481 +0000 UTC m=+18.785080378" watchObservedRunningTime="2026-10-30 18:35:54.894216059 +0000 UTC m=+18.785669955" Oct 30 18:35:55.601066 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:55.601031 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:55.601240 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:55.601097 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:55.601240 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:55.601121 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:55.601240 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:55.601199 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:35:55.601390 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:55.601238 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:35:55.601390 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:55.601301 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:35:55.833415 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:55.833373 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:35:55.833966 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:55.833732 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" event={"ID":"007a2514-b71b-4588-ad8c-3cc364e353d6","Type":"ContainerStarted","Data":"501e6ec0808fb2dcfdd980751e27db5b26b2c89f658529d7f31809a04fbf02e8"} Oct 30 18:35:57.601160 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:57.600975 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:57.601777 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:57.601008 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:57.601777 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:57.601242 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:35:57.601777 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:57.601053 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:57.601777 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:57.601319 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:35:57.601777 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:57.601379 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:35:57.840902 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:57.840874 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:35:57.841215 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:57.841193 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" event={"ID":"007a2514-b71b-4588-ad8c-3cc364e353d6","Type":"ContainerStarted","Data":"25abb8fe4f45fa17e81a6dfcfaebb7eb5fb78e21433fc5b2702b96c1b652057a"} Oct 30 18:35:57.841463 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:57.841448 2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:57.841598 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:57.841577 2575 scope.go:122] "RemoveContainer" containerID="03c46e22a2dec41e58c48148ba8d86a68a12509658f3390a680ebdb22aa2bfce" Oct 30 18:35:57.858026 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:57.858005 2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:58.849790 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:58.849764 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:35:58.850249 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:58.850126 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" event={"ID":"007a2514-b71b-4588-ad8c-3cc364e353d6","Type":"ContainerStarted","Data":"b192270a92539014d05df89587fd65be7741e2f2a853d7b18c3703b1da593ebf"} Oct 30 18:35:58.850342 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:58.850325 2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:58.850438 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:58.850418 2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:58.865207 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:58.865175 2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:35:58.940419 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:58.940366 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" podStartSLOduration=7.295425392 podStartE2EDuration="21.940352245s" totalImagesPullingTime="14.644926853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 18:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:35:58.927588346 +0000 UTC m=+22.819042246" watchObservedRunningTime="2026-10-30 18:35:58.940352245 +0000 UTC m=+22.831806169" Oct 30 18:35:59.280831 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:59.280800 2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9dktd"] Oct 30 18:35:59.280991 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:59.280918 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:35:59.281043 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:59.281022 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:35:59.283651 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:59.283629 2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-54kx8"] Oct 30 18:35:59.283729 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:59.283717 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:35:59.283808 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:59.283792 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:35:59.286547 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:59.286524 2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-njrxt"] Oct 30 18:35:59.286655 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:59.286641 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:35:59.286733 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:35:59.286719 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:35:59.675761 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:59.675731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:35:59.911851 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:35:59.911818 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:00.600913 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:00.600881 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:00.600913 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:00.600908 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:36:00.601235 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:00.601008 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:36:00.601235 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:00.601147 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:36:01.601483 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:01.601395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:01.601837 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:01.601524 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:36:01.868436 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:01.868350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:02.052025 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:02.051993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:02.222810 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:02.222781 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:02.600933 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:02.600859 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:36:02.600933 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:02.600883 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:02.601093 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:02.600966 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:36:02.601142 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:02.601088 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:36:03.601368 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:03.601336 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:03.601711 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:03.601461 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njrxt" podUID="f12964ad-e99d-45a0-87e9-4fc1722d6e25" Oct 30 18:36:03.931885 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:03.931853 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:04.154703 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:04.154667 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:04.601317 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:04.601276 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:04.601480 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:04.601327 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:36:04.601480 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:04.601430 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54kx8" podUID="3ddec812-a5d4-45b1-8a57-70a9b5914964" Oct 30 18:36:04.601804 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:04.601501 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dktd" podUID="c176ae98-07b8-4c0f-a658-987a76e39e50" Oct 30 18:36:05.311220 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.311038 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:05.360304 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.360234 2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeReady" Oct 30 18:36:05.360454 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.360356 2575 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 18:36:05.424588 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.424544 2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2s8kc"] Oct 30 18:36:05.426649 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.426619 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2s8kc" Oct 30 18:36:05.427929 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.427908 2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cl5d5"] Oct 30 18:36:05.429692 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.429676 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:05.446928 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.446908 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 18:36:05.447120 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.447103 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-hhckc\"" Oct 30 18:36:05.447120 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.447114 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 18:36:05.447213 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.447102 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 18:36:05.447213 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.447110 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 18:36:05.457120 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.457098 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fs7jl\"" Oct 30 18:36:05.457206 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.457135 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 18:36:05.458475 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.458459 2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cl5d5"] Oct 30 18:36:05.459200 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.459181 2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2s8kc"] Oct 30 18:36:05.492222 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.492182 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:05.508926 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.508898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/561cf55e-8877-4d9d-99cc-5e6ce09d70b4-cert\") pod \"ingress-canary-2s8kc\" (UID: \"561cf55e-8877-4d9d-99cc-5e6ce09d70b4\") " pod="openshift-ingress-canary/ingress-canary-2s8kc" Oct 30 18:36:05.509099 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.508931 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrfnj\" (UniqueName: \"kubernetes.io/projected/e6a05949-bb00-4825-8e16-28f198f39bfc-kube-api-access-nrfnj\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:05.509099 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.508971 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:05.509291 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.509148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twcf8\" (UniqueName: \"kubernetes.io/projected/561cf55e-8877-4d9d-99cc-5e6ce09d70b4-kube-api-access-twcf8\") pod \"ingress-canary-2s8kc\" (UID: \"561cf55e-8877-4d9d-99cc-5e6ce09d70b4\") " pod="openshift-ingress-canary/ingress-canary-2s8kc" Oct 30 18:36:05.509291 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.509215 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6a05949-bb00-4825-8e16-28f198f39bfc-tmp-dir\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:05.509386 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.509299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6a05949-bb00-4825-8e16-28f198f39bfc-config-volume\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:05.601022 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.600989 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:05.610185 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.610163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:05.610558 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.610191 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twcf8\" (UniqueName: \"kubernetes.io/projected/561cf55e-8877-4d9d-99cc-5e6ce09d70b4-kube-api-access-twcf8\") pod \"ingress-canary-2s8kc\" (UID: \"561cf55e-8877-4d9d-99cc-5e6ce09d70b4\") " pod="openshift-ingress-canary/ingress-canary-2s8kc" Oct 30 18:36:05.610558 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.610209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6a05949-bb00-4825-8e16-28f198f39bfc-tmp-dir\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:05.610558 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.610231 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6a05949-bb00-4825-8e16-28f198f39bfc-config-volume\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:05.610558 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.610308 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/561cf55e-8877-4d9d-99cc-5e6ce09d70b4-cert\") pod \"ingress-canary-2s8kc\" (UID: \"561cf55e-8877-4d9d-99cc-5e6ce09d70b4\") " pod="openshift-ingress-canary/ingress-canary-2s8kc" Oct 30 18:36:05.610558 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.610329 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrfnj\" (UniqueName: \"kubernetes.io/projected/e6a05949-bb00-4825-8e16-28f198f39bfc-kube-api-access-nrfnj\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:05.610558 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:05.610330 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 18:36:05.610558 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:05.610394 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls podName:e6a05949-bb00-4825-8e16-28f198f39bfc nodeName:}" failed. No retries permitted until 2026-10-30 18:36:06.110375032 +0000 UTC m=+30.001829123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls") pod "dns-default-cl5d5" (UID: "e6a05949-bb00-4825-8e16-28f198f39bfc") : secret "dns-default-metrics-tls" not found Oct 30 18:36:05.610816 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.610576 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6a05949-bb00-4825-8e16-28f198f39bfc-tmp-dir\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:05.610935 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.610914 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6a05949-bb00-4825-8e16-28f198f39bfc-config-volume\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:05.614232 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.614209 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/561cf55e-8877-4d9d-99cc-5e6ce09d70b4-cert\") pod \"ingress-canary-2s8kc\" (UID: \"561cf55e-8877-4d9d-99cc-5e6ce09d70b4\") " pod="openshift-ingress-canary/ingress-canary-2s8kc" Oct 30 18:36:05.616015 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.615998 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f688c\"" Oct 30 18:36:05.616074 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.616019 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 18:36:05.634008 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.633984 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrfnj\" (UniqueName: \"kubernetes.io/projected/e6a05949-bb00-4825-8e16-28f198f39bfc-kube-api-access-nrfnj\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:05.634112 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.634095 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twcf8\" (UniqueName: \"kubernetes.io/projected/561cf55e-8877-4d9d-99cc-5e6ce09d70b4-kube-api-access-twcf8\") pod \"ingress-canary-2s8kc\" (UID: \"561cf55e-8877-4d9d-99cc-5e6ce09d70b4\") " pod="openshift-ingress-canary/ingress-canary-2s8kc" Oct 30 18:36:05.738777 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:05.738744 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2s8kc" Oct 30 18:36:06.046835 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.046809 2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2s8kc"] Oct 30 18:36:06.047959 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:36:06.047933 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561cf55e_8877_4d9d_99cc_5e6ce09d70b4.slice/crio-9d51e68566ce64a932b7d851e1b9c7569b91c4b1c7290ec5a596a4d916642082 WatchSource:0}: Error finding container 9d51e68566ce64a932b7d851e1b9c7569b91c4b1c7290ec5a596a4d916642082: Status 404 returned error can't find the container with id 9d51e68566ce64a932b7d851e1b9c7569b91c4b1c7290ec5a596a4d916642082 Oct 30 18:36:06.113859 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.113828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:06.114025 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:06.113951 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 18:36:06.114025 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:06.114008 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls podName:e6a05949-bb00-4825-8e16-28f198f39bfc nodeName:}" failed. No retries permitted until 2026-10-30 18:36:07.113996772 +0000 UTC m=+31.005450660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls") pod "dns-default-cl5d5" (UID: "e6a05949-bb00-4825-8e16-28f198f39bfc") : secret "dns-default-metrics-tls" not found Oct 30 18:36:06.315233 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.315154 2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jlwt8"] Oct 30 18:36:06.322026 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.321998 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.337103 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.337083 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 18:36:06.340487 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.340462 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 18:36:06.340594 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.340501 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8frgd\"" Oct 30 18:36:06.342831 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.342809 2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jlwt8"] Oct 30 18:36:06.416128 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.416098 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/542dd4e6-a6db-48b8-b9cd-099c95ac9978-crio-socket\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.416268 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.416148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/542dd4e6-a6db-48b8-b9cd-099c95ac9978-data-volume\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.416268 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.416173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.416340 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.416295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.416340 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.416327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89q26\" (UniqueName: \"kubernetes.io/projected/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-api-access-89q26\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.439712 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.439682 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 18:36:06.439851 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.439840 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 18:36:06.462377 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.462336 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:06.516614 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.516581 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.516614 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.516617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89q26\" (UniqueName: \"kubernetes.io/projected/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-api-access-89q26\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.516812 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.516651 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/542dd4e6-a6db-48b8-b9cd-099c95ac9978-crio-socket\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.516812 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.516684 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/542dd4e6-a6db-48b8-b9cd-099c95ac9978-data-volume\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.516812 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.516711 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.516812 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:06.516751 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 18:36:06.516812 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:06.516798 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 18:36:06.517040 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:06.517019 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls podName:542dd4e6-a6db-48b8-b9cd-099c95ac9978 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:07.016907334 +0000 UTC m=+30.908361222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jlwt8" (UID: "542dd4e6-a6db-48b8-b9cd-099c95ac9978") : secret "insights-runtime-extractor-tls" not found Oct 30 18:36:06.517172 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.517138 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/542dd4e6-a6db-48b8-b9cd-099c95ac9978-crio-socket\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.517243 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:06.517217 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm podName:542dd4e6-a6db-48b8-b9cd-099c95ac9978 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:07.017196578 +0000 UTC m=+30.908650456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jlwt8" (UID: "542dd4e6-a6db-48b8-b9cd-099c95ac9978") : configmap "kube-rbac-proxy" not found Oct 30 18:36:06.517388 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.517369 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/542dd4e6-a6db-48b8-b9cd-099c95ac9978-data-volume\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.542271 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.542242 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89q26\" (UniqueName: \"kubernetes.io/projected/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-api-access-89q26\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:06.604445 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.604353 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:36:06.604445 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.604396 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:06.635852 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.635819 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:06.664886 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.664855 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 18:36:06.664886 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.664889 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 18:36:06.717309 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.717273 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-99dwj\"" Oct 30 18:36:06.717309 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.717291 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 18:36:06.717532 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.717354 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-2f6h7\"" Oct 30 18:36:06.854291 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.854244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:06.872001 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:06.871900 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2s8kc" event={"ID":"561cf55e-8877-4d9d-99cc-5e6ce09d70b4","Type":"ContainerStarted","Data":"9d51e68566ce64a932b7d851e1b9c7569b91c4b1c7290ec5a596a4d916642082"} Oct 30 18:36:07.009987 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.009956 2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz"] Oct 30 18:36:07.020305 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.020273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:07.020488 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.020334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:07.020488 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:07.020417 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 18:36:07.020488 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:07.020463 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 18:36:07.020488 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:07.020488 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm podName:542dd4e6-a6db-48b8-b9cd-099c95ac9978 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:08.020473831 +0000 UTC m=+31.911927720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jlwt8" (UID: "542dd4e6-a6db-48b8-b9cd-099c95ac9978") : configmap "kube-rbac-proxy" not found Oct 30 18:36:07.020623 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:07.020511 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls podName:542dd4e6-a6db-48b8-b9cd-099c95ac9978 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:08.020497667 +0000 UTC m=+31.911951571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jlwt8" (UID: "542dd4e6-a6db-48b8-b9cd-099c95ac9978") : secret "insights-runtime-extractor-tls" not found Oct 30 18:36:07.039567 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.039538 2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz"] Oct 30 18:36:07.039691 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.039665 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz" Oct 30 18:36:07.048000 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.047971 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:07.054364 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.054227 2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8dj6h\"" Oct 30 18:36:07.054364 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.054228 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 18:36:07.054364 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.054310 2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 18:36:07.121217 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.121183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2ql4\" (UniqueName: \"kubernetes.io/projected/ce3b5df4-9eee-4317-92a1-769775ab3464-kube-api-access-x2ql4\") pod \"migrator-66df5d496b-9mbqz\" (UID: \"ce3b5df4-9eee-4317-92a1-769775ab3464\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz" Oct 30 18:36:07.121422 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.121244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:07.121422 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:07.121371 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 18:36:07.121526 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:07.121478 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls podName:e6a05949-bb00-4825-8e16-28f198f39bfc nodeName:}" failed. No retries permitted until 2026-10-30 18:36:09.121456088 +0000 UTC m=+33.012909971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls") pod "dns-default-cl5d5" (UID: "e6a05949-bb00-4825-8e16-28f198f39bfc") : secret "dns-default-metrics-tls" not found Oct 30 18:36:07.222106 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.222067 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2ql4\" (UniqueName: \"kubernetes.io/projected/ce3b5df4-9eee-4317-92a1-769775ab3464-kube-api-access-x2ql4\") pod \"migrator-66df5d496b-9mbqz\" (UID: \"ce3b5df4-9eee-4317-92a1-769775ab3464\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz" Oct 30 18:36:07.225920 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.225884 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:07.247099 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.247067 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2ql4\" (UniqueName: \"kubernetes.io/projected/ce3b5df4-9eee-4317-92a1-769775ab3464-kube-api-access-x2ql4\") pod \"migrator-66df5d496b-9mbqz\" (UID: \"ce3b5df4-9eee-4317-92a1-769775ab3464\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz" Oct 30 18:36:07.364036 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.363990 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz" Oct 30 18:36:07.670432 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.670385 2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz"] Oct 30 18:36:07.670895 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:36:07.670873 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce3b5df4_9eee_4317_92a1_769775ab3464.slice/crio-f13476410ea33a6fbb9a4199fb906b607f8b72b81a8b48c17f4fa8f0aa9c0bf5 WatchSource:0}: Error finding container f13476410ea33a6fbb9a4199fb906b607f8b72b81a8b48c17f4fa8f0aa9c0bf5: Status 404 returned error can't find the container with id f13476410ea33a6fbb9a4199fb906b607f8b72b81a8b48c17f4fa8f0aa9c0bf5 Oct 30 18:36:07.674623 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.674599 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:07.846572 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.846532 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:07.875101 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:07.875067 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz" event={"ID":"ce3b5df4-9eee-4317-92a1-769775ab3464","Type":"ContainerStarted","Data":"f13476410ea33a6fbb9a4199fb906b607f8b72b81a8b48c17f4fa8f0aa9c0bf5"} Oct 30 18:36:08.028892 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:08.028804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:08.029054 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:08.028932 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 18:36:08.029054 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:08.029002 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm podName:542dd4e6-a6db-48b8-b9cd-099c95ac9978 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:10.028983968 +0000 UTC m=+33.920437848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jlwt8" (UID: "542dd4e6-a6db-48b8-b9cd-099c95ac9978") : configmap "kube-rbac-proxy" not found Oct 30 18:36:08.029054 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:08.029025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:08.029208 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:08.029125 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 18:36:08.029208 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:08.029170 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls podName:542dd4e6-a6db-48b8-b9cd-099c95ac9978 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:10.029158014 +0000 UTC m=+33.920611927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jlwt8" (UID: "542dd4e6-a6db-48b8-b9cd-099c95ac9978") : secret "insights-runtime-extractor-tls" not found Oct 30 18:36:08.473005 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:08.472977 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:09.137579 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.137546 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:09.138061 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:09.137729 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 18:36:09.138061 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:09.137813 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls podName:e6a05949-bb00-4825-8e16-28f198f39bfc nodeName:}" failed. No retries permitted until 2026-10-30 18:36:13.137792358 +0000 UTC m=+37.029246247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls") pod "dns-default-cl5d5" (UID: "e6a05949-bb00-4825-8e16-28f198f39bfc") : secret "dns-default-metrics-tls" not found Oct 30 18:36:09.339156 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.339120 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:09.339380 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.339167 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:09.339380 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:09.339255 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 18:36:09.339380 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:09.339313 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs podName:f12964ad-e99d-45a0-87e9-4fc1722d6e25 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:41.339300708 +0000 UTC m=+65.230754585 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs") pod "network-metrics-daemon-njrxt" (UID: "f12964ad-e99d-45a0-87e9-4fc1722d6e25") : secret "metrics-daemon-secret" not found Oct 30 18:36:09.355459 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.355435 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:09.358842 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.358826 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:09.439951 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.439921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c87bw\" (UniqueName: \"kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw\") pod \"network-check-target-9dktd\" (UID: \"c176ae98-07b8-4c0f-a658-987a76e39e50\") " pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:36:09.442141 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.442121 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c87bw\" (UniqueName: \"kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw\") pod \"network-check-target-9dktd\" (UID: \"c176ae98-07b8-4c0f-a658-987a76e39e50\") " pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:36:09.634286 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.634210 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:36:09.671309 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.671269 2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-54kx8"] Oct 30 18:36:09.672592 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:36:09.672552 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ddec812_a5d4_45b1_8a57_70a9b5914964.slice/crio-c4464621f4062e3a049fea785a00f54d615c5451bddb5659a0d8d67aa0a39a79 WatchSource:0}: Error finding container c4464621f4062e3a049fea785a00f54d615c5451bddb5659a0d8d67aa0a39a79: Status 404 returned error can't find the container with id c4464621f4062e3a049fea785a00f54d615c5451bddb5659a0d8d67aa0a39a79 Oct 30 18:36:09.881670 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.881631 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2s8kc" event={"ID":"561cf55e-8877-4d9d-99cc-5e6ce09d70b4","Type":"ContainerStarted","Data":"a4b7620d5f24cf8d804fc54fa76dbefb624d66cb3e6c83efd03b700be83af2b6"} Oct 30 18:36:09.883082 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.883055 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz" event={"ID":"ce3b5df4-9eee-4317-92a1-769775ab3464","Type":"ContainerStarted","Data":"784430234b42eb75c4a3f9b03e456f8319c62812e12d759294e7415e59485d78"} Oct 30 18:36:09.884051 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.884031 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-54kx8" event={"ID":"3ddec812-a5d4-45b1-8a57-70a9b5914964","Type":"ContainerStarted","Data":"c4464621f4062e3a049fea785a00f54d615c5451bddb5659a0d8d67aa0a39a79"} Oct 30 18:36:09.922154 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.922105 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2s8kc" podStartSLOduration=2.012518486 podStartE2EDuration="4.922092805s" totalImagesPullingTime="2.909574319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:09.92153756 +0000 UTC m=+33.812991459" watchObservedRunningTime="2026-10-30 18:36:09.922092805 +0000 UTC m=+33.813546702" Oct 30 18:36:09.936931 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.936904 2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9dktd"] Oct 30 18:36:09.938261 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:36:09.938240 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc176ae98_07b8_4c0f_a658_987a76e39e50.slice/crio-e77af51ff5c18c12d2f0057900acfeda28cfa67f88008cde4d45232e982e1f6e WatchSource:0}: Error finding container e77af51ff5c18c12d2f0057900acfeda28cfa67f88008cde4d45232e982e1f6e: Status 404 returned error can't find the container with id e77af51ff5c18c12d2f0057900acfeda28cfa67f88008cde4d45232e982e1f6e Oct 30 18:36:09.961082 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:09.961035 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz" podStartSLOduration=2.493672216 podStartE2EDuration="3.961021423s" totalImagesPullingTime="1.467349207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:09.960801427 +0000 UTC m=+33.852255325" watchObservedRunningTime="2026-10-30 18:36:09.961021423 +0000 UTC m=+33.852475319" Oct 30 18:36:10.044924 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:10.044888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:10.045101 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:10.045061 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:10.045101 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:10.045071 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 18:36:10.045205 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:10.045132 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm podName:542dd4e6-a6db-48b8-b9cd-099c95ac9978 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:14.045116172 +0000 UTC m=+37.936570071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jlwt8" (UID: "542dd4e6-a6db-48b8-b9cd-099c95ac9978") : configmap "kube-rbac-proxy" not found Oct 30 18:36:10.045205 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:10.045143 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 18:36:10.045205 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:10.045196 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls podName:542dd4e6-a6db-48b8-b9cd-099c95ac9978 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:14.045183059 +0000 UTC m=+37.936636952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jlwt8" (UID: "542dd4e6-a6db-48b8-b9cd-099c95ac9978") : secret "insights-runtime-extractor-tls" not found Oct 30 18:36:10.888524 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:10.888460 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9dktd" event={"ID":"c176ae98-07b8-4c0f-a658-987a76e39e50","Type":"ContainerStarted","Data":"e77af51ff5c18c12d2f0057900acfeda28cfa67f88008cde4d45232e982e1f6e"} Oct 30 18:36:11.329168 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:11.329134 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:11.961302 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:11.961263 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:13.170809 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:13.170766 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:13.171262 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:13.170923 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 18:36:13.171262 ip-10-0-135-218 kubenswrapper[2575]: E1030 18:36:13.170988 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls podName:e6a05949-bb00-4825-8e16-28f198f39bfc nodeName:}" failed. No retries permitted until 2026-10-30 18:36:21.170972973 +0000 UTC m=+45.062426866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls") pod "dns-default-cl5d5" (UID: "e6a05949-bb00-4825-8e16-28f198f39bfc") : secret "dns-default-metrics-tls" not found Oct 30 18:36:13.897503 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:13.897462 2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9dktd" event={"ID":"c176ae98-07b8-4c0f-a658-987a76e39e50","Type":"ContainerStarted","Data":"38d215ee63c1c52bc792dc264a663a808f50e9cb1f819a1bf674d163b1f3f7f1"} Oct 30 18:36:13.897800 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:13.897780 2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:36:13.938137 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:13.938087 2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9dktd" podStartSLOduration=33.593910293 podStartE2EDuration="36.938073154s" totalImagesPullingTime="3.344162861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:13.93727487 +0000 UTC m=+37.828728781" watchObservedRunningTime="2026-10-30 18:36:13.938073154 +0000 UTC m=+37.829527051" Oct 30 18:36:14.072991 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:14.072935 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:14.076973 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:14.076952 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:14.077037 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:14.077006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:14.077444 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:14.077416 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:14.079187 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:14.079167 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:14.138700 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:14.138660 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:14.244698 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:14.244666 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:14.446512 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:14.446486 2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jlwt8"] Oct 30 18:36:14.447105 ip-10-0-135-218 kubenswrapper[2575]: W1030 18:36:14.447090 2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542dd4e6_a6db_48b8_b9cd_099c95ac9978.slice/crio-ffb1e98bb84484e0e107f5c5cc449403fc3011b0581833feb9d48ff56075be62 WatchSource:0}: Error finding container ffb1e98bb84484e0e107f5c5cc449403fc3011b0581833feb9d48ff56075be62: Status 404 returned error can't find the container with id ffb1e98bb84484e0e107f5c5cc449403fc3011b0581833feb9d48ff56075be62 Oct 30 18:36:14.637433 ip-10-0-135-218 kubenswrapper[2575]: I1030 18:36:14.637376 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:14.679160 ip-10-0-135-218 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 18:36:14.689802 ip-10-0-135-218 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 18:36:14.689981 ip-10-0-135-218 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 18:36:14.690031 ip-10-0-135-218 systemd[1]: kubelet.service: Consumed 2.317s CPU time. Oct 30 18:36:14.704060 ip-10-0-135-218 systemd[1]: Starting Kubernetes Kubelet... Oct 30 18:36:14.800196 ip-10-0-135-218 kubenswrapper[4494]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 18:36:14.800196 ip-10-0-135-218 kubenswrapper[4494]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 18:36:14.800196 ip-10-0-135-218 kubenswrapper[4494]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 18:36:14.800929 ip-10-0-135-218 kubenswrapper[4494]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 18:36:14.803327 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803231 4494 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:14.803327 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803326 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:14.803327 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803330 4494 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803334 4494 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803337 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803340 4494 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803343 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803346 4494 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803348 4494 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803351 4494 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803354 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803356 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803359 4494 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803362 4494 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803364 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803367 4494 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803370 4494 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803372 4494 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803375 4494 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803377 4494 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803380 4494 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803382 4494 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:14.803481 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803385 4494 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803387 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803392 4494 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803395 4494 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803399 4494 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803420 4494 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803425 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803428 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803431 4494 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803438 4494 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803441 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803443 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803447 4494 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803449 4494 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803452 4494 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803455 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803458 4494 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803460 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803463 4494 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:14.803954 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803465 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803468 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803470 4494 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803473 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803476 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803478 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803482 4494 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803486 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803488 4494 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803491 4494 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803494 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803497 4494 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803499 4494 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803502 4494 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803504 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803507 4494 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803510 4494 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803515 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803518 4494 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:14.804410 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803520 4494 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803523 4494 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803526 4494 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803529 4494 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803531 4494 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803534 4494 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803537 4494 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803540 4494 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803542 4494 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803545 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803548 4494 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803550 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803553 4494 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803556 4494 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803558 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803561 4494 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803563 4494 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803566 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803568 4494 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803571 4494 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:14.804908 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803574 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803577 4494 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803579 4494 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803582 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803584 4494 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803587 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803590 4494 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803592 4494 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803594 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803597 4494 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803601 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803603 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803606 4494 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803610 4494 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803612 4494 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803615 4494 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803617 4494 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803620 4494 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803624 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803626 4494 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:14.805390 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803629 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803632 4494 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803634 4494 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803637 4494 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803639 4494 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.803642 4494 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804454 4494 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804461 4494 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804464 4494 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804467 4494 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804470 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804472 4494 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804475 4494 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804478 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804486 4494 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804489 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804491 4494 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804496 4494 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804499 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:14.805877 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804503 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804507 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804510 4494 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804513 4494 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804516 4494 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804518 4494 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804521 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804523 4494 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804526 4494 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804528 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804531 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804533 4494 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804536 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804538 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804541 4494 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804544 4494 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804546 4494 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804549 4494 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804551 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:14.806337 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804554 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804556 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804559 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804561 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804563 4494 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804566 4494 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804569 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804571 4494 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804574 4494 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804578 4494 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804582 4494 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804585 4494 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804588 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804591 4494 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804593 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804596 4494 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804598 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804601 4494 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804603 4494 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:14.806795 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804606 4494 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804608 4494 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804611 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804613 4494 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804616 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804618 4494 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804621 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804624 4494 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804626 4494 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804629 4494 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804631 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804634 4494 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804636 4494 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804640 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804642 4494 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804645 4494 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804648 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804650 4494 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804653 4494 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804656 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:14.807243 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804658 4494 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804660 4494 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804663 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804666 4494 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804669 4494 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804671 4494 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804674 4494 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804677 4494 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804679 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804682 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804684 4494 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804687 4494 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804689 4494 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804692 4494 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804694 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804699 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804702 4494 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804705 4494 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804707 4494 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804710 4494 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:14.807739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804713 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804715 4494 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804718 4494 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804720 4494 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804723 4494 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804725 4494 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804728 4494 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804731 4494 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804734 4494 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804736 4494 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804739 4494 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804741 4494 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804744 4494 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804746 4494 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.804749 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805290 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805295 4494 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805301 4494 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805304 4494 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805307 4494 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:14.808239 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805309 4494 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805312 4494 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805314 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805317 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805320 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805322 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805325 4494 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805330 4494 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805332 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805336 4494 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805340 4494 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805343 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805349 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805354 4494 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805357 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805359 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805362 4494 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805365 4494 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805367 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:14.808729 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805370 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805372 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805375 4494 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805378 4494 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805380 4494 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805383 4494 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805385 4494 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805388 4494 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805391 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805394 4494 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.805397 4494 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806065 4494 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806073 4494 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806076 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806078 4494 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806082 4494 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806085 4494 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806088 4494 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806090 4494 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:14.809173 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806093 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806097 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806100 4494 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806102 4494 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806105 4494 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806107 4494 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806112 4494 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806114 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806117 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806119 4494 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806122 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806124 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806126 4494 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806129 4494 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806132 4494 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806134 4494 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806137 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806139 4494 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806142 4494 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:14.809630 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806145 4494 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806147 4494 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806149 4494 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806152 4494 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806161 4494 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806164 4494 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806166 4494 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806169 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806171 4494 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806174 4494 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806176 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806179 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806182 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806184 4494 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806187 4494 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806190 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806193 4494 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806196 4494 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806200 4494 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:14.810164 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806205 4494 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806207 4494 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806210 4494 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806212 4494 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806216 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806219 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806221 4494 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806224 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806226 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806229 4494 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806232 4494 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806234 4494 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806236 4494 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806239 4494 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806241 4494 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806244 4494 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806246 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806249 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806253 4494 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806256 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:14.810663 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806258 4494 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806261 4494 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806263 4494 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806266 4494 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.806269 4494 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806370 4494 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806378 4494 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806386 4494 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806391 4494 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806395 4494 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806399 4494 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806418 4494 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806426 4494 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806430 4494 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806433 4494 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806437 4494 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806440 4494 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806444 4494 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806447 4494 flags.go:64] FLAG: --cgroup-root="" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806450 4494 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806453 4494 flags.go:64] FLAG: --client-ca-file="" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806456 4494 flags.go:64] FLAG: --cloud-provider="external" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806459 4494 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806463 4494 flags.go:64] FLAG: --cluster-domain="" Oct 30 18:36:14.811129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806466 4494 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806469 4494 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806472 4494 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806475 4494 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806479 4494 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806483 4494 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806486 4494 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806490 4494 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806493 4494 flags.go:64] FLAG: --contention-profiling="false" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806496 4494 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806500 4494 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806503 4494 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806506 4494 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806510 4494 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806513 4494 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806517 4494 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806520 4494 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806523 4494 flags.go:64] FLAG: --enable-server="true" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806526 4494 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806531 4494 flags.go:64] FLAG: --event-burst="100" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806535 4494 flags.go:64] FLAG: --event-qps="50" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806538 4494 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806541 4494 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806544 4494 flags.go:64] FLAG: --eviction-hard="" Oct 30 18:36:14.811711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806549 4494 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806552 4494 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806555 4494 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806558 4494 flags.go:64] FLAG: --eviction-soft="" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806561 4494 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806564 4494 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806567 4494 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806570 4494 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806573 4494 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806576 4494 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806579 4494 flags.go:64] FLAG: --feature-gates="" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806583 4494 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806587 4494 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806590 4494 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806593 4494 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806596 4494 flags.go:64] FLAG: --healthz-port="10248" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806601 4494 flags.go:64] FLAG: --help="false" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806604 4494 flags.go:64] FLAG: --hostname-override="ip-10-0-135-218.ec2.internal" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806607 4494 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806610 4494 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806613 4494 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806616 4494 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806620 4494 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806623 4494 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 18:36:14.812264 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806626 4494 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806649 4494 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806653 4494 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806657 4494 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806661 4494 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806664 4494 flags.go:64] FLAG: --kube-reserved="" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806667 4494 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806670 4494 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806673 4494 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806676 4494 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806679 4494 flags.go:64] FLAG: --lock-file="" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806682 4494 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806685 4494 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806688 4494 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806694 4494 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806697 4494 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806700 4494 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806703 4494 flags.go:64] FLAG: --logging-format="text" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806706 4494 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806709 4494 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806713 4494 flags.go:64] FLAG: --manifest-url="" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806716 4494 flags.go:64] FLAG: --manifest-url-header="" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806721 4494 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806724 4494 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806731 4494 flags.go:64] FLAG: --max-pods="110" Oct 30 18:36:14.812920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806735 4494 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806738 4494 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806741 4494 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806745 4494 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806748 4494 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806751 4494 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806754 4494 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806763 4494 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806767 4494 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806770 4494 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806773 4494 flags.go:64] FLAG: --pod-cidr="" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806777 4494 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806780 4494 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806783 4494 flags.go:64] FLAG: --pods-per-core="0" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806786 4494 flags.go:64] FLAG: --port="10250" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806789 4494 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806792 4494 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03ed5fb1fd9bd7ddf" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806796 4494 flags.go:64] FLAG: --qos-reserved="" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806799 4494 flags.go:64] FLAG: --read-only-port="10255" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806802 4494 flags.go:64] FLAG: --register-node="true" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806805 4494 flags.go:64] FLAG: --register-with-taints="" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806810 4494 flags.go:64] FLAG: --registry-burst="10" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806813 4494 flags.go:64] FLAG: --registry-qps="5" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806816 4494 flags.go:64] FLAG: --reserved-cpus="" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806819 4494 flags.go:64] FLAG: --reserved-memory="" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806823 4494 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 18:36:14.813586 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806826 4494 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806829 4494 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806832 4494 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806835 4494 flags.go:64] FLAG: --runonce="false" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806838 4494 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806842 4494 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806845 4494 flags.go:64] FLAG: --seccomp-default="false" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806849 4494 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806852 4494 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806855 4494 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806858 4494 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806862 4494 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806865 4494 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806868 4494 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806871 4494 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806873 4494 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806877 4494 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806882 4494 flags.go:64] FLAG: --system-cgroups="" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806885 4494 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806890 4494 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806893 4494 flags.go:64] FLAG: --tls-cert-file="" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806896 4494 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806900 4494 flags.go:64] FLAG: --tls-min-version="" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806902 4494 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806905 4494 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 18:36:14.814213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806909 4494 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806912 4494 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806915 4494 flags.go:64] FLAG: --v="2" Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806919 4494 flags.go:64] FLAG: --version="false" Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806923 4494 flags.go:64] FLAG: --vmodule="" Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806927 4494 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.806931 4494 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807074 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807078 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807081 4494 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807084 4494 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807087 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807091 4494 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807094 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807096 4494 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807099 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807102 4494 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807105 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807108 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807111 4494 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807113 4494 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:14.814888 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807116 4494 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807118 4494 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807121 4494 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807124 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807127 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807130 4494 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807132 4494 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807135 4494 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807138 4494 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807140 4494 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807143 4494 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807146 4494 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807148 4494 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807151 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807153 4494 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807157 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807159 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807162 4494 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807164 4494 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:14.815382 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807167 4494 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807170 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807172 4494 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807175 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807179 4494 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807183 4494 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807187 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807190 4494 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807193 4494 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807197 4494 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807199 4494 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807202 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807205 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807208 4494 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807210 4494 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807213 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807216 4494 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807219 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807222 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:14.815883 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807224 4494 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807227 4494 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807229 4494 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807232 4494 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807234 4494 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807237 4494 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807239 4494 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807242 4494 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807245 4494 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807247 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807250 4494 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807253 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807255 4494 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807258 4494 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807260 4494 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807263 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807265 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807269 4494 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807272 4494 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807274 4494 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:14.816354 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807277 4494 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807280 4494 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807282 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807285 4494 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807287 4494 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807290 4494 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807293 4494 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807296 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807298 4494 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807302 4494 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807305 4494 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807307 4494 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807310 4494 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807312 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807316 4494 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807320 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807323 4494 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807326 4494 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807329 4494 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:14.816918 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807331 4494 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807334 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807337 4494 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807339 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807342 4494 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807345 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807347 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807350 4494 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807352 4494 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807355 4494 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807359 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807361 4494 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807364 4494 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807367 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807369 4494 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:14.818643 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.807395 4494 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807448 4494 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807455 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807459 4494 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807462 4494 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807465 4494 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807468 4494 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807470 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807475 4494 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807477 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807480 4494 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807482 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807485 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807487 4494 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807490 4494 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807493 4494 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807495 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807498 4494 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807501 4494 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:14.819079 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807503 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807506 4494 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807508 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807511 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807513 4494 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807516 4494 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807518 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807521 4494 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807525 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807528 4494 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807530 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807533 4494 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807535 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807538 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807540 4494 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807543 4494 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807546 4494 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807549 4494 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807551 4494 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807554 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:14.819589 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807556 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807560 4494 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807563 4494 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807565 4494 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807568 4494 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807571 4494 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807574 4494 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807576 4494 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807579 4494 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807581 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807583 4494 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807586 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807588 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807591 4494 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807593 4494 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807596 4494 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807599 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807601 4494 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807604 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:14.820063 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807606 4494 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807611 4494 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807614 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807617 4494 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807620 4494 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807622 4494 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807626 4494 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807628 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807631 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807634 4494 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807637 4494 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807640 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807642 4494 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807646 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807650 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807652 4494 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807655 4494 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807657 4494 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807660 4494 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:14.820709 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807662 4494 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807665 4494 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807667 4494 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807670 4494 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807672 4494 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807675 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807677 4494 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807680 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807682 4494 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807685 4494 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807688 4494 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807690 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807692 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807695 4494 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807699 4494 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807702 4494 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807704 4494 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807707 4494 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807709 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807711 4494 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:14.821375 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807714 4494 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807717 4494 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807720 4494 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807723 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807726 4494 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807729 4494 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807732 4494 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807735 4494 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807738 4494 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.807741 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.811666 4494 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.811684 4494 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.811702 4494 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.811707 4494 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811763 4494 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811768 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811772 4494 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811775 4494 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811778 4494 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:14.822088 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811781 4494 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811784 4494 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811786 4494 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811789 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811791 4494 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811794 4494 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811797 4494 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811799 4494 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811802 4494 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811805 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811808 4494 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811810 4494 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811813 4494 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811816 4494 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811818 4494 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811821 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811824 4494 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811827 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811830 4494 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811832 4494 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:14.822964 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811835 4494 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811837 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811840 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811842 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811846 4494 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811848 4494 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811851 4494 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811853 4494 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811856 4494 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811858 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811861 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811863 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811866 4494 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811868 4494 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811871 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811873 4494 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811876 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811878 4494 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811881 4494 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:14.823785 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811884 4494 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811887 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811890 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811892 4494 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811894 4494 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811897 4494 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811900 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811902 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811904 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811907 4494 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811910 4494 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811914 4494 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811917 4494 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811920 4494 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811923 4494 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811925 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811928 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811930 4494 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811933 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:14.824584 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811936 4494 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811939 4494 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811941 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811944 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811946 4494 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811948 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811951 4494 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811954 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811956 4494 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811959 4494 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811961 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811964 4494 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811966 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811969 4494 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811972 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811974 4494 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811977 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811980 4494 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811982 4494 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811985 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:14.825381 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811987 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811990 4494 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811993 4494 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811996 4494 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.811998 4494 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812001 4494 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812003 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812006 4494 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812010 4494 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812014 4494 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812017 4494 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812019 4494 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812022 4494 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812025 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812028 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812030 4494 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812033 4494 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812035 4494 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812038 4494 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:14.826241 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812040 4494 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812043 4494 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812045 4494 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812048 4494 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.812075 4494 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812215 4494 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812219 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812222 4494 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812225 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812228 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812230 4494 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812233 4494 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812235 4494 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812238 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812240 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:14.827056 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812243 4494 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812247 4494 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812250 4494 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812254 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812257 4494 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812259 4494 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812262 4494 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812264 4494 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812267 4494 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812270 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812272 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812276 4494 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812279 4494 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812282 4494 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812284 4494 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812287 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812289 4494 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812292 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812295 4494 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:14.827758 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812297 4494 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812300 4494 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812302 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812305 4494 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812307 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812310 4494 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812313 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812315 4494 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812317 4494 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812320 4494 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812322 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812325 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812327 4494 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812330 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812333 4494 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812335 4494 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812338 4494 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812341 4494 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812343 4494 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812346 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:14.828608 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812348 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812351 4494 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812353 4494 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812356 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812358 4494 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812362 4494 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812364 4494 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812367 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812370 4494 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812372 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812374 4494 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812377 4494 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812379 4494 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812382 4494 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812385 4494 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812388 4494 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812392 4494 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812395 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812398 4494 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:14.829513 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812415 4494 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812418 4494 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812421 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812424 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812426 4494 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812429 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812431 4494 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812435 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812437 4494 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812440 4494 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812443 4494 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812445 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812447 4494 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812450 4494 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812452 4494 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812455 4494 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812457 4494 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812460 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812462 4494 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812465 4494 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:14.830370 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812468 4494 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812471 4494 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812473 4494 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812476 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812479 4494 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812481 4494 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812484 4494 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812486 4494 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812489 4494 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812491 4494 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812494 4494 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812497 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812499 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812502 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812504 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812507 4494 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812509 4494 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:14.831341 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812512 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.812535 4494 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812567 4494 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812571 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812575 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812577 4494 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812581 4494 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812586 4494 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812589 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812591 4494 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812594 4494 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812597 4494 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812599 4494 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812602 4494 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812604 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 18:36:14.832071 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812607 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812610 4494 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812612 4494 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812615 4494 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812617 4494 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812620 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812622 4494 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812625 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812627 4494 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812630 4494 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812632 4494 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812635 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812637 4494 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812640 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812642 4494 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812645 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812647 4494 feature_gate.go:386] unrecognized feature gate: Example Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812650 4494 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812652 4494 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812655 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 18:36:14.832745 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812657 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812660 4494 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812667 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812669 4494 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812672 4494 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812675 4494 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812677 4494 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812680 4494 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812683 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812685 4494 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812688 4494 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812690 4494 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812693 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812696 4494 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812699 4494 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812702 4494 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812704 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812707 4494 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812709 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812712 4494 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 18:36:14.833571 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812714 4494 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812716 4494 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812719 4494 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812721 4494 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812725 4494 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812728 4494 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812732 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812735 4494 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812737 4494 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812740 4494 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812742 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812745 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812747 4494 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812751 4494 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812755 4494 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812758 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812761 4494 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812763 4494 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812766 4494 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 18:36:14.834319 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812768 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812771 4494 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812773 4494 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812776 4494 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812778 4494 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812781 4494 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812784 4494 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812787 4494 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812790 4494 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812792 4494 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812795 4494 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812797 4494 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812800 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812802 4494 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812805 4494 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812807 4494 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812810 4494 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812812 4494 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812815 4494 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 18:36:14.835137 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812817 4494 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812820 4494 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812823 4494 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812825 4494 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812828 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812831 4494 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812833 4494 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812838 4494 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812841 4494 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812844 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812846 4494 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812850 4494 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812853 4494 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812855 4494 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:14.812858 4494 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.812915 4494 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.813876 4494 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.813951 4494 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.814132 4494 server.go:1014] "Starting client certificate rotation" Oct 30 18:36:14.835656 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.814273 4494 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 18:36:14.836122 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.814313 4494 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 18:30:36 +0000 UTC" deadline="2028-07-23 20:01:32.3774812 +0000 UTC" Oct 30 18:36:14.836122 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.814339 4494 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15169h25m17.563144211s" Oct 30 18:36:14.836122 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.814593 4494 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 18:36:14.836122 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.816116 4494 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 18:36:14.836122 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.818659 4494 log.go:25] "Validated CRI v1 runtime API" Oct 30 18:36:14.836122 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.820221 4494 log.go:25] "Validated CRI v1 image API" Oct 30 18:36:14.836122 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.821021 4494 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 18:36:14.836122 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.823203 4494 fs.go:135] Filesystem UUIDs: map[11cd716f-38bb-4937-9cfa-79256c4854d6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7fe1bac4-667c-4988-9d9e-4105da58c19e:/dev/nvme0n1p3] Oct 30 18:36:14.836378 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.823225 4494 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4611b4685b1b1477b77b8cd3e7b17bd017ca1bad8683b3239464c93a0213fa73/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4611b4685b1b1477b77b8cd3e7b17bd017ca1bad8683b3239464c93a0213fa73/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4f01339848e3b66d76bd18b4c5ede78fa8dbc003931046a0917b7e0b1ad2527c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4f01339848e3b66d76bd18b4c5ede78fa8dbc003931046a0917b7e0b1ad2527c/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6d5d9b0326a238be3818b2de56c5c90aa0271e5f8abea9b9ba9e60c47a437e27/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6d5d9b0326a238be3818b2de56c5c90aa0271e5f8abea9b9ba9e60c47a437e27/userdata/shm major:0 minor:49 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6dbb4604499dc985263db6c12e4fb65abdccca23771082893592db9ec8e58a98/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6dbb4604499dc985263db6c12e4fb65abdccca23771082893592db9ec8e58a98/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/76b83fe6a2757870c668ab18513af15d5fcd4f64464a9b797a88bbd4bc0b54c0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/76b83fe6a2757870c668ab18513af15d5fcd4f64464a9b797a88bbd4bc0b54c0/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8d314d6739bbeea0f00143837bb10ad68e0bb2a5736a003518db2f2efd875518/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8d314d6739bbeea0f00143837bb10ad68e0bb2a5736a003518db2f2efd875518/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9d51e68566ce64a932b7d851e1b9c7569b91c4b1c7290ec5a596a4d916642082/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9d51e68566ce64a932b7d851e1b9c7569b91c4b1c7290ec5a596a4d916642082/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b6d096caa125cea09342649b064492677942c462f950523c64bacba56a338cf9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b6d096caa125cea09342649b064492677942c462f950523c64bacba56a338cf9/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c02157b1f462baaf2d0b4374bf2873d4f0f411d9758e5faf03c4ec66ef244729/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c02157b1f462baaf2d0b4374bf2873d4f0f411d9758e5faf03c4ec66ef244729/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c1ae33372da8d0f7542ca8205faa0f29fe80f57f8768caf3c3f5564c8ff54634/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c1ae33372da8d0f7542ca8205faa0f29fe80f57f8768caf3c3f5564c8ff54634/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c4464621f4062e3a049fea785a00f54d615c5451bddb5659a0d8d67aa0a39a79/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c4464621f4062e3a049fea785a00f54d615c5451bddb5659a0d8d67aa0a39a79/userdata/shm major:0 minor:225 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d85eb7b1c5a956b5c3f164267ab518cf06a12fa47e48ee30360e426a2ea8252b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d85eb7b1c5a956b5c3f164267ab518cf06a12fa47e48ee30360e426a2ea8252b/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e77af51ff5c18c12d2f0057900acfeda28cfa67f88008cde4d45232e982e1f6e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e77af51ff5c18c12d2f0057900acfeda28cfa67f88008cde4d45232e982e1f6e/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f13476410ea33a6fbb9a4199fb906b607f8b72b81a8b48c17f4fa8f0aa9c0bf5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f13476410ea33a6fbb9a4199fb906b607f8b72b81a8b48c17f4fa8f0aa9c0bf5/userdata/shm major:0 minor:208 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ffb1e98bb84484e0e107f5c5cc449403fc3011b0581833feb9d48ff56075be62/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ffb1e98bb84484e0e107f5c5cc449403fc3011b0581833feb9d48ff56075be62/userdata/shm major:0 minor:241 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/007a2514-b71b-4588-ad8c-3cc364e353d6/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/007a2514-b71b-4588-ad8c-3cc364e353d6/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/007a2514-b71b-4588-ad8c-3cc364e353d6/volumes/kubernetes.io~projected/kube-api-access-sxb7n:{mountpoint:/var/lib/kubelet/pods/007a2514-b71b-4588-ad8c-3cc364e353d6/volumes/kubernetes.io~projected/kube-api-access-sxb7n major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/007a2514-b71b-4588-ad8c-3cc364e353d6/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/007a2514-b71b-4588-ad8c-3cc364e353d6/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3c7bc982-8239-4919-84ca-8b7ee2f95fc7/volumes/kubernetes.io~projected/kube-api-access-9brbk:{mountpoint:/var/lib/kubelet/pods/3c7bc982-8239-4919-84ca-8b7ee2f95fc7/volumes/kubernetes.io~projected/kube-api-access-9brbk major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3ddec812-a5d4-45b1-8a57-70a9b5914964/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/3ddec812-a5d4-45b1-8a57-70a9b5914964/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4632d42f-41b0-4a3d-bc08-c813f2f72cc1/volumes/kubernetes.io~projected/kube-api-access-5hngs:{mountpoint:/var/lib/kubelet/pods/4632d42f-41b0-4a3d-bc08-c813f2f72cc1/volumes/kubernetes.io~projected/kube-api-access-5hngs major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4da3a0a5-bd8e-4364-ae65-51d6c71513f7/volumes/kubernetes.io~projected/kube-api-access-gm2hc:{mountpoint:/var/lib/kubelet/pods/4da3a0a5-bd8e-4364-ae65-51d6c71513f7/volumes/kubernetes.io~projected/kube-api-access-gm2hc major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/542dd4e6-a6db-48b8-b9cd-099c95ac9978/volumes/kubernetes.io~projected/kube-api-access-89q26:{mountpoint:/var/lib/kubelet/pods/542dd4e6-a6db-48b8-b9cd-099c95ac9978/volumes/kubernetes.io~projected/kube-api-access-89q26 major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/542dd4e6-a6db-48b8-b9cd-099c95ac9978/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/542dd4e6-a6db-48b8-b9cd-099c95ac9978/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/561cf55e-8877-4d9d-99cc-5e6ce09d70b4/volumes/kubernetes.io~projected/kube-api-access-twcf8:{mountpoint:/var/lib/kubelet/pods/561cf55e-8877-4d9d-99cc-5e6ce09d70b4/volumes/kubernetes.io~projected/kube-api-access-twcf8 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/561cf55e-8877-4d9d-99cc-5e6ce09d70b4/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/561cf55e-8877-4d9d-99cc-5e6ce09d70b4/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c64ea11-4f4d-4101-9d92-684e9cd106ac/volumes/kubernetes.io~projected/kube-api-access-jr78f:{mountpoint:/var/lib/kubelet/pods/8c64ea11-4f4d-4101-9d92-684e9cd106ac/volumes/kubernetes.io~projected/kube-api-access-jr78f major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b4e96d8b-df57-498e-b290-39e0eb573f94/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/b4e96d8b-df57-498e-b290-39e0eb573f94/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b4e96d8b-df57-498e-b290-39e0eb573f94/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/b4e96d8b-df57-498e-b290-39e0eb573f94/volumes/kubernetes.io~empty-dir/tmp major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b4e96d8b-df57-498e-b290-39e0eb573f94/volumes/kubernetes.io~projected/kube-api-access-nfb6x:{mountpoint:/var/lib/kubelet/pods/b4e96d8b-df57-498e-b290-39e0eb573f94/volumes/kubernetes.io~projected/kube-api-access-nfb6x major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ba85233e-cc2d-4df5-a6ac-0901f57b4b03/volumes/kubernetes.io~projected/kube-api-access-vcjg6:{mountpoint:/var/lib/kubelet/pods/ba85233e-cc2d-4df5-a6ac-0901f57b4b03/volumes/kubernetes.io~projected/kube-api-access-vcjg6 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c176ae98-07b8-4c0f-a658-987a76e39e50/volumes/kubernetes.io~projected/kube-api-access-c87bw:{mountpoint:/var/lib/kubelet/pods/c176ae98-07b8-4c0f-a658-987a76e39e50/volumes/kubernetes.io~projected/kube-api-access-c87bw major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ce3b5df4-9eee-4317-92a1-769775ab3464/volumes/kubernetes.io~projected/kube-api-access-x2ql4:{mountpoint:/var/lib/kubelet/pods/ce3b5df4-9eee-4317-92a1-769775ab3464/volumes/kubernetes.io~projected/kube-api-access-x2ql4 major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/de091251-1364-4040-87b4-d6cc3a29c932/volumes/kubernetes.io~projected/kube-api-access-qm7zz:{mountpoint:/var/lib/kubelet/pods/de091251-1364-4040-87b4-d6cc3a29c932/volumes/kubernetes.io~projected/kube-api-access-qm7zz major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e6a05949-bb00-4825-8e16-28f198f39bfc/volumes/kubernetes.io~projected/kube-api-access-nrfnj:{mountpoint:/var/lib/kubelet/pods/e6a05949-bb00-4825-8e16-28f198f39bfc/volumes/kubernetes.io~projected/kube-api-access-nrfnj major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f12964ad-e99d-45a0-87e9-4fc1722d6e25/volumes/kubernetes.io~projected/kube-api-access-ksj94:{mountpoint:/var/lib/kubelet/pods/f12964ad-e99d-45a0-87e9-4fc1722d6e25/volumes/kubernetes.io~projected/kube-api-access-ksj94 major:0 minor:63 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/f7ded48f93ac6527fd79d9bae6f70ec27267c1bdc78c9cebd734644c0c09ad9f/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/7a9eb79ca9927f25f65f0beba1c3dd7bfed7383bda2c0561259fc721310ccf10/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/e23acb1f872c37a3dcd69b7476b422814cc29e666e57412aa86e93981a9f754c/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/bee91618dd433d350dffe104de0e25318c9a10ae309c8551128d83583e55409d/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-113:{mountpoint:/var/lib/containers/storage/overlay/6457f43e762ccef60e0fe01e8aa078f20dbdbe285696d84ac526b0d811721713/merged major:0 minor:113 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/a70a9007177f9b9e764c5d2edb8cef0c964c8c9ac3343bc40d80c67bebde23b0/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/344082e7dc7ff5d12cd0319f5e8a8a14b264701178cd5920080e78675bbb8024/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/ce289159ab1e34461c335165a88615cc5daa2bfd227311d02a3122379b06fead/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/edac889e67edab9168e567feda31564414f5d1716c04a95fb6d9387cf592cdf1/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/4449a63315093121e4d2dc1e8190d5474ea04f01b36cbc884a779c548f2f7f23/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/2071d5f153ac305ac5050acd43560a203772d9acb19dc93e6498401c33afa449/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/da46eb09175128fcc8ceb7a32d104c218fbd2d4109987575b64408c853bd8ba4/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/2732e475dba06b7dacf1cca96e63a9ffd3a345e0640b37a908898119694274d8/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/0d346c61b8c70ad2e95a4a16f740795b2348b2a8e663561bd95c06b1beb428de/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-159:{mountpoint:/var/lib/containers/storage/overlay/cf92636fbd199b080a0b6e47cb2ce6455bbb38289bbc8dd4a24f5944a4bd9375/merged major:0 minor:159 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/392e1ebb0dea2f662e9b1d788deef11b1c27af35343fdc10971dfd496fd7c4a5/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-169:{mountpoint:/var/lib/containers/storage/overlay/519c4ee2166470069587dc4631154477c432f3382428c2f70c28aef7349e27a1/merged major:0 minor:169 fsType:overlay blockSize:0} overlay_0-176:{mountpoint:/var/lib/containers/storage/overlay/8a7c0d1126bd1879e819dea68b0b3a88b69f025b387ab1e56a51ea1b2d06e86f/merged major:0 minor:176 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/05f496fcc8bec81f1b1eec90b8734b30f244c6d5b6a6de386f08a478c074840b/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/4808941659cde49af341ab5a9524119430eeb412a913f5fa48bc38c75dc55c6b/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/674add6aedc702e982574efef855a1fe1cc40ff1d7a33699b4d83de57954924e/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/c86d1cc968f644f1ee42b3cf63b43164bee7c74641e5456271691cf6cb80f280/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-210:{mountpoint:/var/lib/containers/storage/overlay/73bb19822fcc891ce7c8e52f0f0c0dc19c5e918ce7c438390fe3274d69222dc7/merged major:0 minor:210 fsType:overlay blockSize:0} overlay_0-212:{mountpoint:/var/lib/containers/storage/overlay/e6f8bfc672962e658abdb1e021191133d99e983cb3b2c73e117e6473f36ad198/merged major:0 minor:212 fsType:overlay blockSize:0} overlay_0-214:{mountpoint:/var/lib/containers/storage/overlay/de0ab1b06eed3411c8d9e0ad05f6a1643d4ecfe30fd7d9b261b745e4796567c0/merged major:0 minor:214 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/216e81e34826f9693ff6801fb701ecf331221889aa179dbe56e586cda075f597/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-232:{mountpoint:/var/lib/containers/storage/overlay/c59a8f163708945d1685a7218cc8bc215d2d6524944ba582e68928f8161bc6e1/merged major:0 minor:232 fsType:overlay blockSize:0} overlay_0-234:{mountpoint:/var/lib/containers/storage/overlay/fd685ae66c5afd91b4fac0a8f703cca439bef342d4550179ffd0f16bdeafc523/merged major:0 minor:234 fsType:overlay blockSize:0} overlay_0-243:{mountpoint:/var/lib/containers/storage/overlay/4db042db09c78b90ffe7b256639a46d98da57c563fca90cac965640e24a5a551/merged major:0 minor:243 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/6628afd1e1fbce5f4e0116bbd91e9b4aadfefe1036aa02c84994c3f743a7de49/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/92787a43602952e940dcab170a2c7b23099e9cebaf207b914ffa4d5f84596389/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-50:{mountpoint:/var/lib/containers/storage/overlay/15c7ad9b4691384acfead1b7e9682493e7ec37f5b6effc48ac43ca8c8b3cd0cb/merged major:0 minor:50 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/227926f7a1948375ae6a02661699722eb67495fd6fedea9f3cc11a3e7ed530e5/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/7270c16cf69009615b2157234708b0a170cd1fd0db3cf50b8b78653f052ddfbe/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/226405baf037cd8257c93f35810f6f667e421fc6b82b595439c8c46d3518b9ad/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/fd4de5c2a2a1055e5023c8bb14e8abef42ac5b0ab569a7abdb12fc6264eb0eca/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/c1052182d4650c8e943450298a8b21cc3cb355de5a3dfb1b9c3818836d9c1389/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/8a1f73207724cc948a87e993ac3d9b9c3525bdb19777e465747b5e3c5dfa8c91/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/dc3b82949ee43ef15c39c77395fbb98152a9401ada7b2266bf7d5f1102fa6179/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/f292023db9f833a7a3d7054634629c43094f3de7c4be2a4c6d75db3c9aef9132/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/10b3c808449b36eea95572bfe03bea3d250ebcbb02d7bd6873bf03c4d565fbe9/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.832264 4494 manager.go:217] Machine: {Timestamp:2026-10-30 18:36:14.831473795 +0000 UTC m=+0.060323340 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199604 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21a91fd6379e8c436d73aa2f32f0e9 SystemUUID:ec21a91f-d637-9e8c-436d-73aa2f32f0e9 BootID:6c8f9c64-44a5-4941-b414-29d77ae8b942 Filesystems:[{Device:/run/containers/storage/overlay-containers/76b83fe6a2757870c668ab18513af15d5fcd4f64464a9b797a88bbd4bc0b54c0/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/542dd4e6-a6db-48b8-b9cd-099c95ac9978/volumes/kubernetes.io~projected/kube-api-access-89q26 DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c1ae33372da8d0f7542ca8205faa0f29fe80f57f8768caf3c3f5564c8ff54634/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-210 DeviceMajor:0 DeviceMinor:210 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-214 DeviceMajor:0 DeviceMinor:214 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-243 DeviceMajor:0 DeviceMinor:243 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-50 DeviceMajor:0 DeviceMinor:50 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3ddec812-a5d4-45b1-8a57-70a9b5914964/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:220 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/007a2514-b71b-4588-ad8c-3cc364e353d6/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/007a2514-b71b-4588-ad8c-3cc364e353d6/volumes/kubernetes.io~projected/kube-api-access-sxb7n DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9d51e68566ce64a932b7d851e1b9c7569b91c4b1c7290ec5a596a4d916642082/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c176ae98-07b8-4c0f-a658-987a76e39e50/volumes/kubernetes.io~projected/kube-api-access-c87bw DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e77af51ff5c18c12d2f0057900acfeda28cfa67f88008cde4d45232e982e1f6e/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ffb1e98bb84484e0e107f5c5cc449403fc3011b0581833feb9d48ff56075be62/userdata/shm DeviceMajor:0 DeviceMinor:241 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/b4e96d8b-df57-498e-b290-39e0eb573f94/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4da3a0a5-bd8e-4364-ae65-51d6c71513f7/volumes/kubernetes.io~projected/kube-api-access-gm2hc DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/561cf55e-8877-4d9d-99cc-5e6ce09d70b4/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8d314d6739bbeea0f00143837bb10ad68e0bb2a5736a003518db2f2efd875518/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b4e96d8b-df57-498e-b290-39e0eb573f94/volumes/kubernetes.io~projected/kube-api-access-nfb6x DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4632d42f-41b0-4a3d-bc08-c813f2f72cc1/volumes/kubernetes.io~projected/kube-api-access-5hngs DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b6d096caa125cea09342649b064492677942c462f950523c64bacba56a338cf9/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-176 DeviceMajor:0 DeviceMinor:176 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-234 DeviceMajor:0 DeviceMinor:234 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/f12964ad-e99d-45a0-87e9-4fc1722d6e25/volumes/kubernetes.io~projected/kube-api-access-ksj94 DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f13476410ea33a6fbb9a4199fb906b607f8b72b81a8b48c17f4fa8f0aa9c0bf5/userdata/shm DeviceMajor:0 DeviceMinor:208 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/3c7bc982-8239-4919-84ca-8b7ee2f95fc7/volumes/kubernetes.io~projected/kube-api-access-9brbk DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-113 DeviceMajor:0 DeviceMinor:113 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-212 DeviceMajor:0 DeviceMinor:212 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/542dd4e6-a6db-48b8-b9cd-099c95ac9978/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:236 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6d5d9b0326a238be3818b2de56c5c90aa0271e5f8abea9b9ba9e60c47a437e27/userdata/shm DeviceMajor:0 DeviceMinor:49 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4f01339848e3b66d76bd18b4c5ede78fa8dbc003931046a0917b7e0b1ad2527c/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e6a05949-bb00-4825-8e16-28f198f39bfc/volumes/kubernetes.io~projected/kube-api-access-nrfnj DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8c64ea11-4f4d-4101-9d92-684e9cd106ac/volumes/kubernetes.io~projected/kube-api-access-jr78f DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c02157b1f462baaf2d0b4374bf2873d4f0f411d9758e5faf03c4ec66ef244729/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-159 DeviceMajor:0 DeviceMinor:159 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/007a2514-b71b-4588-ad8c-3cc364e353d6/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c4464621f4062e3a049fea785a00f54d615c5451bddb5659a0d8d67aa0a39a79/userdata/shm DeviceMajor:0 DeviceMinor:225 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b4e96d8b-df57-498e-b290-39e0eb573f94/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/de091251-1364-4040-87b4-d6cc3a29c932/volumes/kubernetes.io~projected/kube-api-access-qm7zz DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d85eb7b1c5a956b5c3f164267ab518cf06a12fa47e48ee30360e426a2ea8252b/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4611b4685b1b1477b77b8cd3e7b17bd017ca1bad8683b3239464c93a0213fa73/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ce3b5df4-9eee-4317-92a1-769775ab3464/volumes/kubernetes.io~projected/kube-api-access-x2ql4 DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-232 DeviceMajor:0 DeviceMinor:232 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ba85233e-cc2d-4df5-a6ac-0901f57b4b03/volumes/kubernetes.io~projected/kube-api-access-vcjg6 DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-169 DeviceMajor:0 DeviceMinor:169 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/561cf55e-8877-4d9d-99cc-5e6ce09d70b4/volumes/kubernetes.io~projected/kube-api-access-twcf8 DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6dbb4604499dc985263db6c12e4fb65abdccca23771082893592db9ec8e58a98/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:9d51e68566ce64a MacAddress:9e:fd:cf:e9:55:b0 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:dc:19:6a:b3 Speed:0 Mtu:9001} {Name:br-int MacAddress:22:15:cf:61:14:e6 Speed:0 Mtu:8901} {Name:c4464621f4062e3 MacAddress:36:f6:17:52:04:00 Speed:10000 Mtu:8901} {Name:e77af51ff5c18c1 MacAddress:42:67:d5:67:2c:61 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:dc:19:6a:b3 Speed:0 Mtu:9001} {Name:f13476410ea33a6 MacAddress:ce:a1:cd:a1:31:91 Speed:10000 Mtu:8901} {Name:ffb1e98bb84484e MacAddress:c6:61:43:18:11:63 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:62:dd:25:38:a2:10 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:8a:37:a2:6c:36:b9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.832677 4494 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.832739 4494 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.833082 4494 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.833113 4494 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-218.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.833318 4494 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.833330 4494 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.833344 4494 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.833390 4494 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.833529 4494 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.833764 4494 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.833934 4494 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.833986 4494 kubelet.go:493] "Attempting to sync node with API server" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.834006 4494 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.834021 4494 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.834036 4494 kubelet.go:405] "Adding apiserver pod source" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.834049 4494 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.834825 4494 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.834838 4494 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 18:36:14.836538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.835386 4494 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 18:36:14.843882 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.843867 4494 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 18:36:14.843882 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.843881 4494 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 18:36:14.844005 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.843982 4494 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 18:36:14.844185 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844173 4494 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 18:36:14.844213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844203 4494 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 18:36:14.844301 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844291 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 18:36:14.844331 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844306 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 18:36:14.844331 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844312 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 18:36:14.844331 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844317 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 18:36:14.844331 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844325 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 18:36:14.844331 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844330 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 18:36:14.844533 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844336 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 18:36:14.844533 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844341 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 18:36:14.844533 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844348 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 18:36:14.844533 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844354 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 18:36:14.844533 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844363 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 18:36:14.844533 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844371 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 18:36:14.844533 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844394 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 18:36:14.844533 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.844400 4494 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 18:36:14.848340 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.848319 4494 server.go:1263] "Started kubelet" Oct 30 18:36:14.848454 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.848378 4494 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 18:36:14.848573 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.848518 4494 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 18:36:14.848632 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.848593 4494 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 18:36:14.848848 ip-10-0-135-218 systemd[1]: Started Kubernetes Kubelet. Oct 30 18:36:14.849028 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.848998 4494 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 18:36:14.849850 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.849836 4494 server.go:317] "Adding debug handlers to kubelet server" Oct 30 18:36:14.851005 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.850987 4494 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 18:36:14.851099 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.851016 4494 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 18:36:14.851184 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.851149 4494 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 18:30:37 +0000 UTC" deadline="2028-08-03 18:40:52.720860994 +0000 UTC" Oct 30 18:36:14.851246 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.851185 4494 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15432h4m37.869678841s" Oct 30 18:36:14.851246 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.851237 4494 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 18:36:14.851246 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.851244 4494 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 18:36:14.851664 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:14.851645 4494 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found" Oct 30 18:36:14.852421 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.852394 4494 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 18:36:14.853839 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.853752 4494 factory.go:153] Registering CRI-O factory Oct 30 18:36:14.853839 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.853772 4494 factory.go:223] Registration of the crio container factory successfully Oct 30 18:36:14.853839 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.853824 4494 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 18:36:14.853839 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.853835 4494 factory.go:55] Registering systemd factory Oct 30 18:36:14.853839 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.853843 4494 factory.go:223] Registration of the systemd container factory successfully Oct 30 18:36:14.854117 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.853859 4494 factory.go:103] Registering Raw factory Oct 30 18:36:14.854117 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.853873 4494 manager.go:1199] Started watching for new ooms in manager Oct 30 18:36:14.854262 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.854232 4494 manager.go:319] Starting recovery of all containers Oct 30 18:36:14.855040 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855003 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="007a2514-b71b-4588-ad8c-3cc364e353d6" volumeName="kubernetes.io/projected/007a2514-b71b-4588-ad8c-3cc364e353d6-kube-api-access-sxb7n" seLinuxMountContext="" Oct 30 18:36:14.855095 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855041 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="542dd4e6-a6db-48b8-b9cd-099c95ac9978" volumeName="kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm" seLinuxMountContext="" Oct 30 18:36:14.855095 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855058 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="542dd4e6-a6db-48b8-b9cd-099c95ac9978" volumeName="kubernetes.io/empty-dir/542dd4e6-a6db-48b8-b9cd-099c95ac9978-data-volume" seLinuxMountContext="" Oct 30 18:36:14.855095 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855072 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="542dd4e6-a6db-48b8-b9cd-099c95ac9978" volumeName="kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls" seLinuxMountContext="" Oct 30 18:36:14.855095 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855083 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60d85957-1f67-4dfc-8ad1-c30f04b0b3f7" volumeName="kubernetes.io/secret/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7-agent-certs" seLinuxMountContext="" Oct 30 18:36:14.855215 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855097 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce3b5df4-9eee-4317-92a1-769775ab3464" volumeName="kubernetes.io/projected/ce3b5df4-9eee-4317-92a1-769775ab3464-kube-api-access-x2ql4" seLinuxMountContext="" Oct 30 18:36:14.855215 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855110 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e6a05949-bb00-4825-8e16-28f198f39bfc" volumeName="kubernetes.io/configmap/e6a05949-bb00-4825-8e16-28f198f39bfc-config-volume" seLinuxMountContext="" Oct 30 18:36:14.855215 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855147 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4e96d8b-df57-498e-b290-39e0eb573f94" volumeName="kubernetes.io/empty-dir/b4e96d8b-df57-498e-b290-39e0eb573f94-tmp" seLinuxMountContext="" Oct 30 18:36:14.855215 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855165 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4e96d8b-df57-498e-b290-39e0eb573f94" volumeName="kubernetes.io/projected/b4e96d8b-df57-498e-b290-39e0eb573f94-kube-api-access-nfb6x" seLinuxMountContext="" Oct 30 18:36:14.855215 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855177 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e6a05949-bb00-4825-8e16-28f198f39bfc" volumeName="kubernetes.io/projected/e6a05949-bb00-4825-8e16-28f198f39bfc-kube-api-access-nrfnj" seLinuxMountContext="" Oct 30 18:36:14.855215 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855191 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f12964ad-e99d-45a0-87e9-4fc1722d6e25" volumeName="kubernetes.io/projected/f12964ad-e99d-45a0-87e9-4fc1722d6e25-kube-api-access-ksj94" seLinuxMountContext="" Oct 30 18:36:14.855215 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855203 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="007a2514-b71b-4588-ad8c-3cc364e353d6" volumeName="kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-ovnkube-script-lib" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855217 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="007a2514-b71b-4588-ad8c-3cc364e353d6" volumeName="kubernetes.io/secret/007a2514-b71b-4588-ad8c-3cc364e353d6-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855230 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3ddec812-a5d4-45b1-8a57-70a9b5914964" volumeName="kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855250 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4da3a0a5-bd8e-4364-ae65-51d6c71513f7" volumeName="kubernetes.io/projected/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-kube-api-access-gm2hc" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855262 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3c7bc982-8239-4919-84ca-8b7ee2f95fc7" volumeName="kubernetes.io/projected/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-kube-api-access-9brbk" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855275 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="542dd4e6-a6db-48b8-b9cd-099c95ac9978" volumeName="kubernetes.io/projected/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-api-access-89q26" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855288 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60d85957-1f67-4dfc-8ad1-c30f04b0b3f7" volumeName="kubernetes.io/configmap/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7-konnectivity-ca" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855300 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c64ea11-4f4d-4101-9d92-684e9cd106ac" volumeName="kubernetes.io/configmap/8c64ea11-4f4d-4101-9d92-684e9cd106ac-serviceca" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855312 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba85233e-cc2d-4df5-a6ac-0901f57b4b03" volumeName="kubernetes.io/configmap/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-iptables-alerter-script" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855324 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3c7bc982-8239-4919-84ca-8b7ee2f95fc7" volumeName="kubernetes.io/empty-dir/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-tmp-dir" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855336 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="561cf55e-8877-4d9d-99cc-5e6ce09d70b4" volumeName="kubernetes.io/projected/561cf55e-8877-4d9d-99cc-5e6ce09d70b4-kube-api-access-twcf8" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855348 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="561cf55e-8877-4d9d-99cc-5e6ce09d70b4" volumeName="kubernetes.io/secret/561cf55e-8877-4d9d-99cc-5e6ce09d70b4-cert" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855362 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4e96d8b-df57-498e-b290-39e0eb573f94" volumeName="kubernetes.io/empty-dir/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-tuned" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855378 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c176ae98-07b8-4c0f-a658-987a76e39e50" volumeName="kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw" seLinuxMountContext="" Oct 30 18:36:14.855389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855390 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="de091251-1364-4040-87b4-d6cc3a29c932" volumeName="kubernetes.io/configmap/de091251-1364-4040-87b4-d6cc3a29c932-cni-binary-copy" seLinuxMountContext="" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855419 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="de091251-1364-4040-87b4-d6cc3a29c932" volumeName="kubernetes.io/projected/de091251-1364-4040-87b4-d6cc3a29c932-kube-api-access-qm7zz" seLinuxMountContext="" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855432 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="007a2514-b71b-4588-ad8c-3cc364e353d6" volumeName="kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-env-overrides" seLinuxMountContext="" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855449 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" volumeName="kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855464 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" volumeName="kubernetes.io/projected/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-kube-api-access-5hngs" seLinuxMountContext="" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855477 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" volumeName="kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cni-binary-copy" seLinuxMountContext="" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855490 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="de091251-1364-4040-87b4-d6cc3a29c932" volumeName="kubernetes.io/configmap/de091251-1364-4040-87b4-d6cc3a29c932-multus-daemon-config" seLinuxMountContext="" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855502 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e6a05949-bb00-4825-8e16-28f198f39bfc" volumeName="kubernetes.io/empty-dir/e6a05949-bb00-4825-8e16-28f198f39bfc-tmp-dir" seLinuxMountContext="" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855514 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" volumeName="kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855525 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c64ea11-4f4d-4101-9d92-684e9cd106ac" volumeName="kubernetes.io/projected/8c64ea11-4f4d-4101-9d92-684e9cd106ac-kube-api-access-jr78f" seLinuxMountContext="" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855538 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba85233e-cc2d-4df5-a6ac-0901f57b4b03" volumeName="kubernetes.io/projected/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-kube-api-access-vcjg6" seLinuxMountContext="" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855550 4494 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="007a2514-b71b-4588-ad8c-3cc364e353d6" volumeName="kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-ovnkube-config" seLinuxMountContext="" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855563 4494 reconstruct.go:97] "Volume reconstruction finished" Oct 30 18:36:14.855763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.855571 4494 reconciler.go:29] "Reconciler: start to sync state" Oct 30 18:36:14.867666 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.867640 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:36:14.868541 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.868505 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:36:14.878131 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.878087 4494 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 18:36:14.879626 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.879603 4494 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 18:36:14.879626 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.879627 4494 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 18:36:14.879782 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.879693 4494 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 18:36:14.879782 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:14.879739 4494 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 18:36:14.891840 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.891811 4494 generic.go:356] "Generic (PLEG): container finished" podID="40d34cdd4c09d30482e59285c4804c2a" containerID="35b156e389b17448c4a1e1d8bb59d9fa6135245cf9fee6248ec84320d0987ba8" exitCode=0 Oct 30 18:36:14.901919 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.901893 4494 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:36:14.901919 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.901902 4494 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 18:36:14.902117 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.902027 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:36:14.902457 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.902439 4494 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:36:14.902558 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.902498 4494 generic.go:356] "Generic (PLEG): container finished" podID="007a2514-b71b-4588-ad8c-3cc364e353d6" containerID="03c46e22a2dec41e58c48148ba8d86a68a12509658f3390a680ebdb22aa2bfce" exitCode=1 Oct 30 18:36:14.915285 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.915261 4494 generic.go:356] "Generic (PLEG): container finished" podID="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" containerID="b379492a8be5d6a61a2af98025f9fbc31fce685f234b79024402b92b9d666f2d" exitCode=0 Oct 30 18:36:14.915285 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.915282 4494 generic.go:356] "Generic (PLEG): container finished" podID="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" containerID="618376fd638996f27616b80e7e96cff4473f2fe86c7eefd8647b437e661036e9" exitCode=0 Oct 30 18:36:14.915285 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.915289 4494 generic.go:356] "Generic (PLEG): container finished" podID="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" containerID="628d461ac4839cee8e4ad00f4ed69b5be5e8f5a457a3da1965a1355238ee7744" exitCode=0 Oct 30 18:36:14.915500 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.915295 4494 generic.go:356] "Generic (PLEG): container finished" podID="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" containerID="3655ec4877bd17fd6281ccba452a79caab16ee0b3a761b198facc8a6243d835c" exitCode=0 Oct 30 18:36:14.915500 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.915304 4494 generic.go:356] "Generic (PLEG): container finished" podID="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" containerID="df8da2f66d17e5471f9028965c8cf3de7ae3274e170075ed726ab651692582d1" exitCode=0 Oct 30 18:36:14.915500 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.915312 4494 generic.go:356] "Generic (PLEG): container finished" podID="4632d42f-41b0-4a3d-bc08-c813f2f72cc1" containerID="c84c9eb90a5e6c26c2f33216108be35a7ed67bc2a818980c09ec69ed43de0bed" exitCode=0 Oct 30 18:36:14.917037 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.917016 4494 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:36:14.917037 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.917042 4494 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 18:36:14.924006 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.923991 4494 manager.go:324] Recovery completed Oct 30 18:36:14.939714 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.939646 4494 cpu_manager.go:226] "Starting" policy="none" Oct 30 18:36:14.939714 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.939670 4494 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 18:36:14.939714 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.939690 4494 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 18:36:14.939886 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.939869 4494 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 18:36:14.939917 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.939888 4494 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 18:36:14.939917 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.939905 4494 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 18:36:14.939917 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.939910 4494 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 18:36:14.939917 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.939916 4494 policy_none.go:50] "Start" Oct 30 18:36:14.940029 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.939929 4494 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 18:36:14.940029 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.939940 4494 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 18:36:14.940087 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.940076 4494 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 18:36:14.940087 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.940082 4494 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 18:36:14.940139 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.940088 4494 policy_none.go:44] "Start" Oct 30 18:36:14.944372 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.943909 4494 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 18:36:14.949833 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.949821 4494 manager.go:341] "Starting Device Plugin manager" Oct 30 18:36:14.949902 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:14.949845 4494 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 18:36:14.949902 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.949853 4494 server.go:87] "Starting device plugin registration server" Oct 30 18:36:14.950152 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.950141 4494 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 18:36:14.950197 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.950155 4494 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 18:36:14.950242 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.950228 4494 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 18:36:14.950347 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.950312 4494 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 18:36:14.950433 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.950354 4494 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 18:36:14.950433 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.950361 4494 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 18:36:14.951209 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.951135 4494 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T18:36:14.950344288Z","UUID":"71cce3eb-60d7-45c9-9377-ca39d7d86079","Handler":null,"Name":"","Endpoint":""} Oct 30 18:36:14.951444 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:14.951422 4494 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 18:36:14.952305 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.952288 4494 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 18:36:14.952372 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.952326 4494 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 18:36:14.979903 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.979857 4494 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal"] Oct 30 18:36:14.980299 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.980272 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" event={"ID":"40d34cdd4c09d30482e59285c4804c2a","Type":"ContainerStarted","Data":"67b477da57f953df54dcf042abd556d63f5f7b5ce8ae2878398d29e66501ebeb"} Oct 30 18:36:14.980369 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.980306 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" event={"ID":"40d34cdd4c09d30482e59285c4804c2a","Type":"ContainerDied","Data":"35b156e389b17448c4a1e1d8bb59d9fa6135245cf9fee6248ec84320d0987ba8"} Oct 30 18:36:14.980369 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.980321 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" event={"ID":"40d34cdd4c09d30482e59285c4804c2a","Type":"ContainerStarted","Data":"6d5d9b0326a238be3818b2de56c5c90aa0271e5f8abea9b9ba9e60c47a437e27"} Oct 30 18:36:14.980484 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.980385 4494 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:36:14.980532 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.980479 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" event={"ID":"0a1141f188cb159776b4a1af048cbc31","Type":"ContainerStarted","Data":"94599eda7c4a08d8c6f9b66ee5c859cc1db1e847fc6b5935dbde3a75ee19ae07"} Oct 30 18:36:14.980532 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.980508 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" event={"ID":"0a1141f188cb159776b4a1af048cbc31","Type":"ContainerStarted","Data":"6dbb4604499dc985263db6c12e4fb65abdccca23771082893592db9ec8e58a98"} Oct 30 18:36:14.980622 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:14.980593 4494 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.005318 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.005292 4494 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 18:36:15.005470 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:15.005339 4494 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-218.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.005827 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.005816 4494 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 18:36:15.005868 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:15.005840 4494 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.050390 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.050357 4494 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 18:36:15.051648 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.051632 4494 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory" Oct 30 18:36:15.051725 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.051662 4494 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 18:36:15.051725 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.051673 4494 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID" Oct 30 18:36:15.051725 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.051703 4494 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.089858 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.089829 4494 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.090004 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.089924 4494 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.103761 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.103738 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40d34cdd4c09d30482e59285c4804c2a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"40d34cdd4c09d30482e59285c4804c2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.103869 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.103766 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40d34cdd4c09d30482e59285c4804c2a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"40d34cdd4c09d30482e59285c4804c2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.103869 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.103783 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a1141f188cb159776b4a1af048cbc31-config\") pod \"kube-apiserver-proxy-ip-10-0-135-218.ec2.internal\" (UID: \"0a1141f188cb159776b4a1af048cbc31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.204388 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.204301 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40d34cdd4c09d30482e59285c4804c2a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"40d34cdd4c09d30482e59285c4804c2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.204388 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.204333 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40d34cdd4c09d30482e59285c4804c2a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"40d34cdd4c09d30482e59285c4804c2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.204388 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.204350 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a1141f188cb159776b4a1af048cbc31-config\") pod \"kube-apiserver-proxy-ip-10-0-135-218.ec2.internal\" (UID: \"0a1141f188cb159776b4a1af048cbc31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.204617 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.204446 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40d34cdd4c09d30482e59285c4804c2a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"40d34cdd4c09d30482e59285c4804c2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.204617 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.204508 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40d34cdd4c09d30482e59285c4804c2a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"40d34cdd4c09d30482e59285c4804c2a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.204617 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.204536 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a1141f188cb159776b4a1af048cbc31-config\") pod \"kube-apiserver-proxy-ip-10-0-135-218.ec2.internal\" (UID: \"0a1141f188cb159776b4a1af048cbc31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.834852 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.834817 4494 apiserver.go:52] "Watching apiserver" Oct 30 18:36:15.893188 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.893159 4494 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 18:36:15.893613 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.893594 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal","openshift-network-operator/iptables-alerter-m82d8","kube-system/konnectivity-agent-5tlrv","openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz","openshift-network-diagnostics/network-check-target-9dktd","openshift-ovn-kubernetes/ovnkube-node-vksqc","openshift-insights/insights-runtime-extractor-jlwt8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal","openshift-multus/network-metrics-daemon-njrxt","openshift-multus/multus-additional-cni-plugins-zwf76","openshift-cluster-node-tuning-operator/tuned-znlrr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx","openshift-dns/dns-default-cl5d5","openshift-dns/node-resolver-qv54m","kube-system/global-pull-secret-syncer-54kx8","openshift-ingress-canary/ingress-canary-2s8kc","openshift-image-registry/node-ca-zcm2q","openshift-multus/multus-q7q62"] Oct 30 18:36:15.894023 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.894003 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:15.900474 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.900449 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:15.911518 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.911496 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 18:36:15.911518 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.911495 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 18:36:15.911676 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.911547 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 18:36:15.911842 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.911829 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 18:36:15.911890 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.911829 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 18:36:15.911937 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.911912 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 18:36:15.912016 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912003 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 18:36:15.912077 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912052 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 18:36:15.912159 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912146 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vrsg5\"" Oct 30 18:36:15.912159 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912154 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 18:36:15.912256 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912165 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 18:36:15.912256 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912178 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 18:36:15.912256 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912233 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-2f6h7\"" Oct 30 18:36:15.912374 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912281 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-p2p55\"" Oct 30 18:36:15.912374 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912290 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-z5jb4\"" Oct 30 18:36:15.912374 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912285 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 18:36:15.912374 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912311 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f688c\"" Oct 30 18:36:15.912853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912839 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6x4zm\"" Oct 30 18:36:15.912932 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.912920 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 18:36:15.913035 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.913023 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 18:36:15.913204 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.913191 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 18:36:15.913241 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.913222 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 18:36:15.913241 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.913236 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 18:36:15.913322 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.913311 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 18:36:15.922314 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.922301 4494 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.922426 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.922415 4494 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.925516 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.925500 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9gvp2\"" Oct 30 18:36:15.925588 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.925572 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 18:36:15.925642 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.925577 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m2hrx\"" Oct 30 18:36:15.925683 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.925652 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 18:36:15.925855 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.925840 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fs7jl\"" Oct 30 18:36:15.925963 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.925946 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 18:36:15.926032 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.925973 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-hhckc\"" Oct 30 18:36:15.926032 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.925992 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j94tm\"" Oct 30 18:36:15.926032 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.926015 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 18:36:15.926156 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.926084 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m478x\"" Oct 30 18:36:15.926156 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.926092 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-99dwj\"" Oct 30 18:36:15.926156 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.926133 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 18:36:15.926259 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.926154 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8dj6h\"" Oct 30 18:36:15.926259 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.926159 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 18:36:15.926259 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.926169 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 18:36:15.926259 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.926224 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7mnv2\"" Oct 30 18:36:15.926451 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.926430 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 18:36:15.926668 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.926655 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8frgd\"" Oct 30 18:36:15.926878 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.926866 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 18:36:15.927062 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927044 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 18:36:15.927135 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927115 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 18:36:15.927191 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927178 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 18:36:15.927191 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927186 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 18:36:15.927275 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927192 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 18:36:15.927275 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927228 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 18:36:15.927275 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927237 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 18:36:15.927388 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927230 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 18:36:15.927388 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927344 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 18:36:15.927388 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927348 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 18:36:15.927388 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927348 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 18:36:15.927631 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927375 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 18:36:15.927631 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927390 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 18:36:15.927631 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927426 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 18:36:15.927631 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.927438 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 18:36:15.947125 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.947105 4494 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 18:36:15.947198 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:15.947155 4494 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-218.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.947510 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.947498 4494 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 18:36:15.947554 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:15.947543 4494 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" Oct 30 18:36:15.953540 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.953527 4494 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 18:36:15.968919 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:15.968895 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:16.008371 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008337 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.008371 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008370 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:16.008598 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008388 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de091251-1364-4040-87b4-d6cc3a29c932-multus-daemon-config\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.008598 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008454 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6a05949-bb00-4825-8e16-28f198f39bfc-tmp-dir\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:16.008598 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008485 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksj94\" (UniqueName: \"kubernetes.io/projected/f12964ad-e99d-45a0-87e9-4fc1722d6e25-kube-api-access-ksj94\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:16.008598 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008514 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysctl-d\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.008598 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008563 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6a05949-bb00-4825-8e16-28f198f39bfc-tmp-dir\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:16.008598 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008592 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfb6x\" (UniqueName: \"kubernetes.io/projected/b4e96d8b-df57-498e-b290-39e0eb573f94-kube-api-access-nfb6x\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.008847 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008627 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.008847 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008649 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-cni-bin\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.008847 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008673 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-env-overrides\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.008847 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008693 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-socket-dir-parent\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.008847 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008750 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de091251-1364-4040-87b4-d6cc3a29c932-multus-daemon-config\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.008847 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008784 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-netns\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.008847 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008827 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4e96d8b-df57-498e-b290-39e0eb573f94-tmp\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.009163 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008852 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.009163 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008882 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-slash\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.009163 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008917 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4e96d8b-df57-498e-b290-39e0eb573f94-tmp\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.009163 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008918 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-env-overrides\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.009163 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008916 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-cni-netd\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.009163 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008969 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hngs\" (UniqueName: \"kubernetes.io/projected/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-kube-api-access-5hngs\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.009163 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.008986 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/542dd4e6-a6db-48b8-b9cd-099c95ac9978-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:16.009163 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009025 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-cnibin\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.009163 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009097 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-kubelet\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.009163 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009142 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-conf-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.009542 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009188 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.009542 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009225 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-ovn\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.009542 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009262 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cnibin\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.009542 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009281 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.009542 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009318 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c87bw\" (UniqueName: \"kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw\") pod \"network-check-target-9dktd\" (UID: \"c176ae98-07b8-4c0f-a658-987a76e39e50\") " pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:36:16.009542 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009347 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm2hc\" (UniqueName: \"kubernetes.io/projected/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-kube-api-access-gm2hc\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.009542 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009386 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/561cf55e-8877-4d9d-99cc-5e6ce09d70b4-cert\") pod \"ingress-canary-2s8kc\" (UID: \"561cf55e-8877-4d9d-99cc-5e6ce09d70b4\") " pod="openshift-ingress-canary/ingress-canary-2s8kc" Oct 30 18:36:16.009542 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009430 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-etc-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.009542 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009452 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-etc-kubernetes\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009549 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-device-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009594 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6a05949-bb00-4825-8e16-28f198f39bfc-config-volume\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009677 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9brbk\" (UniqueName: \"kubernetes.io/projected/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-kube-api-access-9brbk\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009737 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysctl-conf\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009790 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009852 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6a05949-bb00-4825-8e16-28f198f39bfc-config-volume\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009853 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-registration-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009891 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysconfig\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009944 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-tuned\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009963 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-ovnkube-config\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009979 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.009996 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr78f\" (UniqueName: \"kubernetes.io/projected/8c64ea11-4f4d-4101-9d92-684e9cd106ac-kube-api-access-jr78f\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:36:16.010018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010020 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-hosts-file\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010025 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010042 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2ql4\" (UniqueName: \"kubernetes.io/projected/ce3b5df4-9eee-4317-92a1-769775ab3464-kube-api-access-x2ql4\") pod \"migrator-66df5d496b-9mbqz\" (UID: \"ce3b5df4-9eee-4317-92a1-769775ab3464\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010040 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-tuned\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010142 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-run-netns\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010180 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-ovnkube-config\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010212 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/561cf55e-8877-4d9d-99cc-5e6ce09d70b4-cert\") pod \"ingress-canary-2s8kc\" (UID: \"561cf55e-8877-4d9d-99cc-5e6ce09d70b4\") " pod="openshift-ingress-canary/ingress-canary-2s8kc" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010238 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/542dd4e6-a6db-48b8-b9cd-099c95ac9978-crio-socket\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010301 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-system-cni-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010340 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de091251-1364-4040-87b4-d6cc3a29c932-cni-binary-copy\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010340 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ddec812-a5d4-45b1-8a57-70a9b5914964-original-pull-secret\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010369 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-host-slash\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010434 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-systemd\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010452 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-var-lib-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010476 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.010502 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010502 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010532 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-cni-bin\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010536 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de091251-1364-4040-87b4-d6cc3a29c932-cni-binary-copy\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010551 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-cni-multus\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010580 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-run\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010599 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-node-log\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010624 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-log-socket\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010669 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-k8s-cni-cncf-io\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010679 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010702 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twcf8\" (UniqueName: \"kubernetes.io/projected/561cf55e-8877-4d9d-99cc-5e6ce09d70b4-kube-api-access-twcf8\") pod \"ingress-canary-2s8kc\" (UID: \"561cf55e-8877-4d9d-99cc-5e6ce09d70b4\") " pod="openshift-ingress-canary/ingress-canary-2s8kc" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010722 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010770 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7-konnectivity-ca\") pod \"konnectivity-agent-5tlrv\" (UID: \"60d85957-1f67-4dfc-8ad1-c30f04b0b3f7\") " pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010803 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-multus-certs\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010856 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010895 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-socket-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.010922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010925 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-sys-fs\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010947 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010978 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-var-lib-kubelet\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.010995 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-host\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011019 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011000 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7-konnectivity-ca\") pod \"konnectivity-agent-5tlrv\" (UID: \"60d85957-1f67-4dfc-8ad1-c30f04b0b3f7\") " pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011021 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-system-cni-dir\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011063 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ddec812-a5d4-45b1-8a57-70a9b5914964-dbus\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011120 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7-agent-certs\") pod \"konnectivity-agent-5tlrv\" (UID: \"60d85957-1f67-4dfc-8ad1-c30f04b0b3f7\") " pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011168 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-cni-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011276 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-iptables-alerter-script\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011321 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60d85957-1f67-4dfc-8ad1-c30f04b0b3f7-agent-certs\") pod \"konnectivity-agent-5tlrv\" (UID: \"60d85957-1f67-4dfc-8ad1-c30f04b0b3f7\") " pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011328 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-kubelet\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011412 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/542dd4e6-a6db-48b8-b9cd-099c95ac9978-data-volume\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011435 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcjg6\" (UniqueName: \"kubernetes.io/projected/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-kube-api-access-vcjg6\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011459 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011479 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrfnj\" (UniqueName: \"kubernetes.io/projected/e6a05949-bb00-4825-8e16-28f198f39bfc-kube-api-access-nrfnj\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011494 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-tmp-dir\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011494 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/542dd4e6-a6db-48b8-b9cd-099c95ac9978-data-volume\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:16.011519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011511 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-iptables-alerter-script\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011542 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-kubernetes\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011558 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-sys\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011581 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011609 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-modprobe-d\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011638 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/007a2514-b71b-4588-ad8c-3cc364e353d6-ovn-node-metrics-cert\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011643 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-tmp-dir\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011683 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm7zz\" (UniqueName: \"kubernetes.io/projected/de091251-1364-4040-87b4-d6cc3a29c932-kube-api-access-qm7zz\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011747 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c64ea11-4f4d-4101-9d92-684e9cd106ac-serviceca\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011803 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-lib-modules\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011897 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ddec812-a5d4-45b1-8a57-70a9b5914964-kubelet-config\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011923 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89q26\" (UniqueName: \"kubernetes.io/projected/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-api-access-89q26\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.011951 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-hostroot\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.012033 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c64ea11-4f4d-4101-9d92-684e9cd106ac-host\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.012049 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-systemd-units\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.012083 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-systemd\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.012085 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/007a2514-b71b-4588-ad8c-3cc364e353d6-ovn-node-metrics-cert\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.012116 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-ovnkube-script-lib\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.012276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.012138 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxb7n\" (UniqueName: \"kubernetes.io/projected/007a2514-b71b-4588-ad8c-3cc364e353d6-kube-api-access-sxb7n\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.013001 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.012737 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c64ea11-4f4d-4101-9d92-684e9cd106ac-serviceca\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:36:16.013001 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.012963 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/007a2514-b71b-4588-ad8c-3cc364e353d6-ovnkube-script-lib\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.031749 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.031728 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksj94\" (UniqueName: \"kubernetes.io/projected/f12964ad-e99d-45a0-87e9-4fc1722d6e25-kube-api-access-ksj94\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:16.032185 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.032169 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hngs\" (UniqueName: \"kubernetes.io/projected/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-kube-api-access-5hngs\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.034630 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.034615 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm2hc\" (UniqueName: \"kubernetes.io/projected/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-kube-api-access-gm2hc\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.034700 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.034682 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfb6x\" (UniqueName: \"kubernetes.io/projected/b4e96d8b-df57-498e-b290-39e0eb573f94-kube-api-access-nfb6x\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.035144 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.035124 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr78f\" (UniqueName: \"kubernetes.io/projected/8c64ea11-4f4d-4101-9d92-684e9cd106ac-kube-api-access-jr78f\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:36:16.035389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.035361 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm7zz\" (UniqueName: \"kubernetes.io/projected/de091251-1364-4040-87b4-d6cc3a29c932-kube-api-access-qm7zz\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.035389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.035378 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c87bw\" (UniqueName: \"kubernetes.io/projected/c176ae98-07b8-4c0f-a658-987a76e39e50-kube-api-access-c87bw\") pod \"network-check-target-9dktd\" (UID: \"c176ae98-07b8-4c0f-a658-987a76e39e50\") " pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:36:16.035702 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.035679 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrfnj\" (UniqueName: \"kubernetes.io/projected/e6a05949-bb00-4825-8e16-28f198f39bfc-kube-api-access-nrfnj\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:16.035771 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.035719 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcjg6\" (UniqueName: \"kubernetes.io/projected/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-kube-api-access-vcjg6\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:36:16.035771 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.035757 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89q26\" (UniqueName: \"kubernetes.io/projected/542dd4e6-a6db-48b8-b9cd-099c95ac9978-kube-api-access-89q26\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:16.035875 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.035861 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2ql4\" (UniqueName: \"kubernetes.io/projected/ce3b5df4-9eee-4317-92a1-769775ab3464-kube-api-access-x2ql4\") pod \"migrator-66df5d496b-9mbqz\" (UID: \"ce3b5df4-9eee-4317-92a1-769775ab3464\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-9mbqz" Oct 30 18:36:16.035946 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.035929 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twcf8\" (UniqueName: \"kubernetes.io/projected/561cf55e-8877-4d9d-99cc-5e6ce09d70b4-kube-api-access-twcf8\") pod \"ingress-canary-2s8kc\" (UID: \"561cf55e-8877-4d9d-99cc-5e6ce09d70b4\") " pod="openshift-ingress-canary/ingress-canary-2s8kc" Oct 30 18:36:16.040258 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.040237 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9brbk\" (UniqueName: \"kubernetes.io/projected/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-kube-api-access-9brbk\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:36:16.040802 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.040788 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxb7n\" (UniqueName: \"kubernetes.io/projected/007a2514-b71b-4588-ad8c-3cc364e353d6-kube-api-access-sxb7n\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.112682 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112604 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-host-slash\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:36:16.112682 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112646 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-systemd\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.112682 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112665 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-var-lib-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.112682 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112680 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112697 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-cni-bin\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112716 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-cni-multus\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112717 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba85233e-cc2d-4df5-a6ac-0901f57b4b03-host-slash\") pod \"iptables-alerter-m82d8\" (UID: \"ba85233e-cc2d-4df5-a6ac-0901f57b4b03\") " pod="openshift-network-operator/iptables-alerter-m82d8" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112737 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-run\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112748 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-systemd\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112762 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112775 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-node-log\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112787 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-cni-bin\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112791 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-run\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112803 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-cni-multus\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112820 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-var-lib-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112826 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-node-log\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112833 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-log-socket\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112878 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-log-socket\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112885 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-k8s-cni-cncf-io\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112929 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-multus-certs\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112951 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112968 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-k8s-cni-cncf-io\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.112975 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-socket-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.112994 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113000 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-sys-fs\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113011 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-multus-certs\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113016 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113027 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113028 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-socket-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113041 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-var-lib-kubelet\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113055 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-host\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113070 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-sys-fs\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113076 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-system-cni-dir\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:16.113088 4494 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113100 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ddec812-a5d4-45b1-8a57-70a9b5914964-dbus\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113113 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-var-lib-kubelet\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113124 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-host\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113132 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-system-cni-dir\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:16.113163 4494 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs podName:f12964ad-e99d-45a0-87e9-4fc1722d6e25 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:16.613146717 +0000 UTC m=+1.841996262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs") pod "network-metrics-daemon-njrxt" (UID: "f12964ad-e99d-45a0-87e9-4fc1722d6e25") : secret "metrics-daemon-secret" not found Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113176 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-cni-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113163 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ddec812-a5d4-45b1-8a57-70a9b5914964-dbus\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113198 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-kubelet\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113232 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-kubelet\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113231 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113255 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-cni-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113265 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-kubernetes\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113286 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-sys\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113307 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113330 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-kubernetes\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113332 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-modprobe-d\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113365 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-lib-modules\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113376 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113373 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-sys\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113388 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ddec812-a5d4-45b1-8a57-70a9b5914964-kubelet-config\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113427 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-hostroot\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113444 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c64ea11-4f4d-4101-9d92-684e9cd106ac-host\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113450 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-modprobe-d\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113454 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ddec812-a5d4-45b1-8a57-70a9b5914964-kubelet-config\") pod \"global-pull-secret-syncer-54kx8\" (UID: \"3ddec812-a5d4-45b1-8a57-70a9b5914964\") " pod="kube-system/global-pull-secret-syncer-54kx8" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113458 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-systemd-units\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113490 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-systemd\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113495 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c64ea11-4f4d-4101-9d92-684e9cd106ac-host\") pod \"node-ca-zcm2q\" (UID: \"8c64ea11-4f4d-4101-9d92-684e9cd106ac\") " pod="openshift-image-registry/node-ca-zcm2q" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113510 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysctl-d\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113500 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-lib-modules\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113525 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113534 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-systemd\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113516 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-systemd-units\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113554 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-cni-bin\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113572 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113538 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-hostroot\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113585 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-cni-bin\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113582 4494 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113579 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-socket-dir-parent\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113613 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysctl-d\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113623 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-netns\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113646 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-slash\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113654 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-run-netns\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113661 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-cni-netd\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113681 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-cnibin\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113622 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-socket-dir-parent\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113705 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-kubelet\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113683 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-cni-netd\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113720 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-cnibin\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113725 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-slash\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113727 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-conf-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113750 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-host-var-lib-kubelet\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113755 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-multus-conf-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113766 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113790 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-ovn\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113812 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cnibin\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113833 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-etc-selinux\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113835 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113854 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-run-ovn\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113875 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-cnibin\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.113820 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113880 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4632d42f-41b0-4a3d-bc08-c813f2f72cc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwf76\" (UID: \"4632d42f-41b0-4a3d-bc08-c813f2f72cc1\") " pod="openshift-multus/multus-additional-cni-plugins-zwf76" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113876 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-etc-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113906 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-etc-openvswitch\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113921 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-etc-kubernetes\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113944 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-device-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113958 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-etc-kubernetes\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113968 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysctl-conf\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113993 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-registration-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.114021 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysconfig\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.114048 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysconfig\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.113989 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-device-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.114023 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4da3a0a5-bd8e-4364-ae65-51d6c71513f7-registration-dir\") pod \"aws-ebs-csi-driver-node-cg7kx\" (UID: \"4da3a0a5-bd8e-4364-ae65-51d6c71513f7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cg7kx" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.114048 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-hosts-file\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.114086 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c7bc982-8239-4919-84ca-8b7ee2f95fc7-hosts-file\") pod \"node-resolver-qv54m\" (UID: \"3c7bc982-8239-4919-84ca-8b7ee2f95fc7\") " pod="openshift-dns/node-resolver-qv54m" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.114095 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-run-netns\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.114111 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/542dd4e6-a6db-48b8-b9cd-099c95ac9978-crio-socket\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.114120 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4e96d8b-df57-498e-b290-39e0eb573f94-etc-sysctl-conf\") pod \"tuned-znlrr\" (UID: \"b4e96d8b-df57-498e-b290-39e0eb573f94\") " pod="openshift-cluster-node-tuning-operator/tuned-znlrr" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.114126 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-system-cni-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.114157 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/007a2514-b71b-4588-ad8c-3cc364e353d6-host-run-netns\") pod \"ovnkube-node-vksqc\" (UID: \"007a2514-b71b-4588-ad8c-3cc364e353d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.114180 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/542dd4e6-a6db-48b8-b9cd-099c95ac9978-crio-socket\") pod \"insights-runtime-extractor-jlwt8\" (UID: \"542dd4e6-a6db-48b8-b9cd-099c95ac9978\") " pod="openshift-insights/insights-runtime-extractor-jlwt8" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.114200 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de091251-1364-4040-87b4-d6cc3a29c932-system-cni-dir\") pod \"multus-q7q62\" (UID: \"de091251-1364-4040-87b4-d6cc3a29c932\") " pod="openshift-multus/multus-q7q62" Oct 30 18:36:16.115758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.115632 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6a05949-bb00-4825-8e16-28f198f39bfc-metrics-tls\") pod \"dns-default-cl5d5\" (UID: \"e6a05949-bb00-4825-8e16-28f198f39bfc\") " pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:16.146510 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.146474 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:16.201386 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.201360 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:16.202837 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.202816 4494 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 18:36:16.332097 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.332068 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:16.372642 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.372578 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qv54m_3c7bc982-8239-4919-84ca-8b7ee2f95fc7/dns-node-resolver/0.log" Oct 30 18:36:16.540341 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.540197 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cl5d5"] Oct 30 18:36:16.542926 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:16.542892 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a05949_bb00_4825_8e16_28f198f39bfc.slice/crio-1fe501f2807393c6caed64f4512a632622fe659ad2cffd7c41d709260848c6bd WatchSource:0}: Error finding container 1fe501f2807393c6caed64f4512a632622fe659ad2cffd7c41d709260848c6bd: Status 404 returned error can't find the container with id 1fe501f2807393c6caed64f4512a632622fe659ad2cffd7c41d709260848c6bd Oct 30 18:36:16.618986 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.618955 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:16.619120 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:16.619103 4494 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 18:36:16.619165 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:16.619156 4494 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs podName:f12964ad-e99d-45a0-87e9-4fc1722d6e25 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:17.619143237 +0000 UTC m=+2.847992761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs") pod "network-metrics-daemon-njrxt" (UID: "f12964ad-e99d-45a0-87e9-4fc1722d6e25") : secret "metrics-daemon-secret" not found Oct 30 18:36:16.624685 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.624616 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:16.836050 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.836012 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:16.929189 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:16.929149 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cl5d5" event={"ID":"e6a05949-bb00-4825-8e16-28f198f39bfc","Type":"ContainerStarted","Data":"1fe501f2807393c6caed64f4512a632622fe659ad2cffd7c41d709260848c6bd"} Oct 30 18:36:17.195526 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:17.195427 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:17.365838 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:17.365794 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:17.367110 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:17.367085 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zcm2q_8c64ea11-4f4d-4101-9d92-684e9cd106ac/node-ca/0.log" Oct 30 18:36:17.536024 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:17.535994 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:17.545224 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:17.545200 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:17.625763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:17.625727 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:17.625948 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:17.625854 4494 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 18:36:17.626016 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:17.625948 4494 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs podName:f12964ad-e99d-45a0-87e9-4fc1722d6e25 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:19.62592629 +0000 UTC m=+4.854775833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs") pod "network-metrics-daemon-njrxt" (UID: "f12964ad-e99d-45a0-87e9-4fc1722d6e25") : secret "metrics-daemon-secret" not found Oct 30 18:36:17.768277 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:17.768208 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2s8kc_561cf55e-8877-4d9d-99cc-5e6ce09d70b4/serve-healthcheck-canary/0.log" Oct 30 18:36:17.835883 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:17.835808 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:17.935911 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:17.935872 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jlwt8" event={"ID":"542dd4e6-a6db-48b8-b9cd-099c95ac9978","Type":"ContainerStarted","Data":"3082de65159157e59a42958b978be96505d034099f3de959a99f615651c6093a"} Oct 30 18:36:18.028742 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:18.028635 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:18.228868 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:18.228832 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:18.359576 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:18.359502 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:18.359729 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:18.359715 4494 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 18:36:18.370928 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:18.370903 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-9mbqz_ce3b5df4-9eee-4317-92a1-769775ab3464/migrator/0.log" Oct 30 18:36:18.622573 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:18.622519 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:18.943799 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:18.943759 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cl5d5" event={"ID":"e6a05949-bb00-4825-8e16-28f198f39bfc","Type":"ContainerStarted","Data":"65952ab0c44f94d3e838c30301327bb0889499dbcd8e349aa6c8eccbedcc9720"} Oct 30 18:36:18.944168 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:18.943848 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cl5d5" event={"ID":"e6a05949-bb00-4825-8e16-28f198f39bfc","Type":"ContainerStarted","Data":"074b658505eb61cfb188a4fd42df1d35dbabb003537f81f36f295b3c5d1c49e6"} Oct 30 18:36:18.944168 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:18.943892 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:19.446656 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:19.446617 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:19.640650 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:19.640609 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:19.640794 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:19.640744 4494 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 18:36:19.640851 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:19.640797 4494 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs podName:f12964ad-e99d-45a0-87e9-4fc1722d6e25 nodeName:}" failed. No retries permitted until 2026-10-30 18:36:23.640784384 +0000 UTC m=+8.869633908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs") pod "network-metrics-daemon-njrxt" (UID: "f12964ad-e99d-45a0-87e9-4fc1722d6e25") : secret "metrics-daemon-secret" not found Oct 30 18:36:19.827057 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:19.826951 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:19.949276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:19.949234 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jlwt8" event={"ID":"542dd4e6-a6db-48b8-b9cd-099c95ac9978","Type":"ContainerStarted","Data":"e382e8bc59805d667240b021d552d13f002560bae6469327a3f829d223315907"} Oct 30 18:36:20.029184 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:20.029144 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:20.200130 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:20.200098 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:20.377835 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:20.377801 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:20.630729 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:20.630614 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:20.730519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:20.730494 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vksqc" Oct 30 18:36:21.427592 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:21.427550 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:21.826649 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:21.826546 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:22.023768 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:22.023720 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:22.277127 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:22.277088 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:22.477642 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:22.477597 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:22.651684 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:22.651593 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:22.830839 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:22.830799 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:23.006942 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:23.006906 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:23.430564 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:23.430528 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:23.662082 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:23.662042 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:23.664221 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:23.664199 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f12964ad-e99d-45a0-87e9-4fc1722d6e25-metrics-certs\") pod \"network-metrics-daemon-njrxt\" (UID: \"f12964ad-e99d-45a0-87e9-4fc1722d6e25\") " pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:23.695223 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:23.695168 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njrxt" Oct 30 18:36:23.732772 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:23.732727 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:36:23.825926 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:23.825890 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:23.849023 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:23.848988 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:36:23.980281 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:23.980260 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-njrxt"] Oct 30 18:36:23.982062 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:23.982032 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf12964ad_e99d_45a0_87e9_4fc1722d6e25.slice/crio-1ecc3c5467d316dc15e0f9564164e9b41c1ba4a5c01770d972b7c6bccaa6489e WatchSource:0}: Error finding container 1ecc3c5467d316dc15e0f9564164e9b41c1ba4a5c01770d972b7c6bccaa6489e: Status 404 returned error can't find the container with id 1ecc3c5467d316dc15e0f9564164e9b41c1ba4a5c01770d972b7c6bccaa6489e Oct 30 18:36:24.023002 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:24.022955 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:24.198721 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:24.198688 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:24.370092 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:24.370007 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:24.620068 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:24.620026 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:24.818763 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:24.818742 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:24.966324 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:24.966287 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-njrxt" event={"ID":"f12964ad-e99d-45a0-87e9-4fc1722d6e25","Type":"ContainerStarted","Data":"4faaea4714fefcf2093cc36f28016fa219ec2f1b7df827a1dd4d6798d963d5b8"} Oct 30 18:36:24.966487 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:24.966336 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-njrxt" event={"ID":"f12964ad-e99d-45a0-87e9-4fc1722d6e25","Type":"ContainerStarted","Data":"7486662febf8ebbe2c34882a1b5c9f142aec24d356f13d5008a838fbe3c440c7"} Oct 30 18:36:24.966487 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:24.966353 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-njrxt" event={"ID":"f12964ad-e99d-45a0-87e9-4fc1722d6e25","Type":"ContainerStarted","Data":"1ecc3c5467d316dc15e0f9564164e9b41c1ba4a5c01770d972b7c6bccaa6489e"} Oct 30 18:36:25.685416 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:25.685370 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:25.857378 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:25.857345 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:26.027437 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:26.027297 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:26.201147 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:26.201099 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:26.378205 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:26.378114 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:27.744441 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.744392 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:27.810364 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.810337 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj"] Oct 30 18:36:27.812718 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.812697 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj" Oct 30 18:36:27.824617 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.824594 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-cnp26"] Oct 30 18:36:27.826398 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.826380 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-cnp26" Oct 30 18:36:27.842068 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.842048 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Oct 30 18:36:27.842068 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.842063 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pddjf\"" Oct 30 18:36:27.846141 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.846120 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj"] Oct 30 18:36:27.855922 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.855873 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 18:36:27.856033 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.856019 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 18:36:27.856424 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.856396 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-cnp26"] Oct 30 18:36:27.889619 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.889595 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dddc6011-5636-47a2-bc75-b1188a0b6e23-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-5dxpj\" (UID: \"dddc6011-5636-47a2-bc75-b1188a0b6e23\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj" Oct 30 18:36:27.944877 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.944843 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-6xk8c\"" Oct 30 18:36:27.990098 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.990072 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dddc6011-5636-47a2-bc75-b1188a0b6e23-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-5dxpj\" (UID: \"dddc6011-5636-47a2-bc75-b1188a0b6e23\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj" Oct 30 18:36:27.990250 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.990106 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvrx9\" (UniqueName: \"kubernetes.io/projected/a72d383b-6b31-4a23-91c5-fe2ad5904509-kube-api-access-lvrx9\") pod \"downloads-6dd789c8b7-cnp26\" (UID: \"a72d383b-6b31-4a23-91c5-fe2ad5904509\") " pod="openshift-console/downloads-6dd789c8b7-cnp26" Oct 30 18:36:27.990250 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.990137 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a72d383b-6b31-4a23-91c5-fe2ad5904509-tmp\") pod \"downloads-6dd789c8b7-cnp26\" (UID: \"a72d383b-6b31-4a23-91c5-fe2ad5904509\") " pod="openshift-console/downloads-6dd789c8b7-cnp26" Oct 30 18:36:27.992504 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:27.992484 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dddc6011-5636-47a2-bc75-b1188a0b6e23-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-5dxpj\" (UID: \"dddc6011-5636-47a2-bc75-b1188a0b6e23\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj" Oct 30 18:36:28.007278 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.007221 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:28.091058 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.091026 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvrx9\" (UniqueName: \"kubernetes.io/projected/a72d383b-6b31-4a23-91c5-fe2ad5904509-kube-api-access-lvrx9\") pod \"downloads-6dd789c8b7-cnp26\" (UID: \"a72d383b-6b31-4a23-91c5-fe2ad5904509\") " pod="openshift-console/downloads-6dd789c8b7-cnp26" Oct 30 18:36:28.091171 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.091078 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a72d383b-6b31-4a23-91c5-fe2ad5904509-tmp\") pod \"downloads-6dd789c8b7-cnp26\" (UID: \"a72d383b-6b31-4a23-91c5-fe2ad5904509\") " pod="openshift-console/downloads-6dd789c8b7-cnp26" Oct 30 18:36:28.091481 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.091464 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a72d383b-6b31-4a23-91c5-fe2ad5904509-tmp\") pod \"downloads-6dd789c8b7-cnp26\" (UID: \"a72d383b-6b31-4a23-91c5-fe2ad5904509\") " pod="openshift-console/downloads-6dd789c8b7-cnp26" Oct 30 18:36:28.120156 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.120120 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvrx9\" (UniqueName: \"kubernetes.io/projected/a72d383b-6b31-4a23-91c5-fe2ad5904509-kube-api-access-lvrx9\") pod \"downloads-6dd789c8b7-cnp26\" (UID: \"a72d383b-6b31-4a23-91c5-fe2ad5904509\") " pod="openshift-console/downloads-6dd789c8b7-cnp26" Oct 30 18:36:28.122794 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.122779 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj" Oct 30 18:36:28.135045 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.135024 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-cnp26" Oct 30 18:36:28.199452 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.199374 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:28.410895 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.410868 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj"] Oct 30 18:36:28.411790 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:28.411766 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddddc6011_5636_47a2_bc75_b1188a0b6e23.slice/crio-302f07576fb4d91ebca265c0a8d7b1037b8972be26cd6b46b4c3434b003adec4 WatchSource:0}: Error finding container 302f07576fb4d91ebca265c0a8d7b1037b8972be26cd6b46b4c3434b003adec4: Status 404 returned error can't find the container with id 302f07576fb4d91ebca265c0a8d7b1037b8972be26cd6b46b4c3434b003adec4 Oct 30 18:36:28.444936 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.444908 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-cnp26"] Oct 30 18:36:28.445660 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:28.445638 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72d383b_6b31_4a23_91c5_fe2ad5904509.slice/crio-1ef54b6f62e8adb18ab11ee899b0bc26e04f202abfdb27926b26b95db7fa9ecf WatchSource:0}: Error finding container 1ef54b6f62e8adb18ab11ee899b0bc26e04f202abfdb27926b26b95db7fa9ecf: Status 404 returned error can't find the container with id 1ef54b6f62e8adb18ab11ee899b0bc26e04f202abfdb27926b26b95db7fa9ecf Oct 30 18:36:28.952661 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.951935 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cl5d5" Oct 30 18:36:28.983308 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.983239 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-cnp26" event={"ID":"a72d383b-6b31-4a23-91c5-fe2ad5904509","Type":"ContainerStarted","Data":"1ef54b6f62e8adb18ab11ee899b0bc26e04f202abfdb27926b26b95db7fa9ecf"} Oct 30 18:36:28.984775 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:28.984724 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj" event={"ID":"dddc6011-5636-47a2-bc75-b1188a0b6e23","Type":"ContainerStarted","Data":"302f07576fb4d91ebca265c0a8d7b1037b8972be26cd6b46b4c3434b003adec4"} Oct 30 18:36:29.994794 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:29.994754 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj" event={"ID":"dddc6011-5636-47a2-bc75-b1188a0b6e23","Type":"ContainerStarted","Data":"4ca38ffd51cac453f8b8d13e3192ea1a95a7f59e1fdb98bfa5a4736d70ad63ac"} Oct 30 18:36:29.995313 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:29.995284 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj" Oct 30 18:36:30.000387 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:30.000365 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj" Oct 30 18:36:30.040378 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:30.040320 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-5dxpj" podStartSLOduration=2.046551187 podStartE2EDuration="3.040309061s" totalImagesPullingTime="993.757874ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:30.03982298 +0000 UTC m=+15.268672528" watchObservedRunningTime="2026-10-30 18:36:30.040309061 +0000 UTC m=+15.269158602" Oct 30 18:36:31.088868 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.088834 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:31.141202 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.141172 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5"] Oct 30 18:36:31.143267 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.143247 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.178823 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.178794 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 30 18:36:31.178979 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.178831 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 18:36:31.178979 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.178858 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-s4g5k\"" Oct 30 18:36:31.178979 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.178884 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 18:36:31.178979 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.178956 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 30 18:36:31.179112 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.178996 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 18:36:31.179579 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.179557 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5"] Oct 30 18:36:31.264437 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.264385 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:31.313116 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.313082 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d75bad9-1276-44c5-a2c4-9258ac202234-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-6j9f5\" (UID: \"5d75bad9-1276-44c5-a2c4-9258ac202234\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.313358 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.313129 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d75bad9-1276-44c5-a2c4-9258ac202234-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-6j9f5\" (UID: \"5d75bad9-1276-44c5-a2c4-9258ac202234\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.313358 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.313152 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d75bad9-1276-44c5-a2c4-9258ac202234-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-6j9f5\" (UID: \"5d75bad9-1276-44c5-a2c4-9258ac202234\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.313358 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.313288 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrq4m\" (UniqueName: \"kubernetes.io/projected/5d75bad9-1276-44c5-a2c4-9258ac202234-kube-api-access-jrq4m\") pod \"prometheus-operator-9cd89b74c-6j9f5\" (UID: \"5d75bad9-1276-44c5-a2c4-9258ac202234\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.413664 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.413626 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d75bad9-1276-44c5-a2c4-9258ac202234-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-6j9f5\" (UID: \"5d75bad9-1276-44c5-a2c4-9258ac202234\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.413836 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.413679 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d75bad9-1276-44c5-a2c4-9258ac202234-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-6j9f5\" (UID: \"5d75bad9-1276-44c5-a2c4-9258ac202234\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.413836 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.413733 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrq4m\" (UniqueName: \"kubernetes.io/projected/5d75bad9-1276-44c5-a2c4-9258ac202234-kube-api-access-jrq4m\") pod \"prometheus-operator-9cd89b74c-6j9f5\" (UID: \"5d75bad9-1276-44c5-a2c4-9258ac202234\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.413836 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.413764 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d75bad9-1276-44c5-a2c4-9258ac202234-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-6j9f5\" (UID: \"5d75bad9-1276-44c5-a2c4-9258ac202234\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.414769 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.414743 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d75bad9-1276-44c5-a2c4-9258ac202234-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-6j9f5\" (UID: \"5d75bad9-1276-44c5-a2c4-9258ac202234\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.416233 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.416208 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d75bad9-1276-44c5-a2c4-9258ac202234-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-6j9f5\" (UID: \"5d75bad9-1276-44c5-a2c4-9258ac202234\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.416326 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.416303 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d75bad9-1276-44c5-a2c4-9258ac202234-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-6j9f5\" (UID: \"5d75bad9-1276-44c5-a2c4-9258ac202234\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.439730 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.439702 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrq4m\" (UniqueName: \"kubernetes.io/projected/5d75bad9-1276-44c5-a2c4-9258ac202234-kube-api-access-jrq4m\") pod \"prometheus-operator-9cd89b74c-6j9f5\" (UID: \"5d75bad9-1276-44c5-a2c4-9258ac202234\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.439925 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.439897 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:31.455904 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.455884 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" Oct 30 18:36:31.488360 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.488330 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f4f9f7bcf-fptp9"] Oct 30 18:36:31.491212 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.490790 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.513153 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.513131 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 30 18:36:31.513505 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.513487 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 30 18:36:31.513618 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.513611 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xmbpw\"" Oct 30 18:36:31.513731 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.513647 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 30 18:36:31.513768 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.513730 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 30 18:36:31.513807 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.513795 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 30 18:36:31.514850 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.514831 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4f9f7bcf-fptp9"] Oct 30 18:36:31.616298 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.616259 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-oauth-serving-cert\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.616507 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.616313 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-oauth-config\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.616507 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.616333 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02a7b956-25dd-45a1-8dcd-bae15d840eee-tmp\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.616507 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.616461 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-serving-cert\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.616507 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.616485 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-config\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.616507 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.616501 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-service-ca\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.616729 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.616598 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khrbn\" (UniqueName: \"kubernetes.io/projected/02a7b956-25dd-45a1-8dcd-bae15d840eee-kube-api-access-khrbn\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.717853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.717772 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-oauth-config\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.717853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.717817 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02a7b956-25dd-45a1-8dcd-bae15d840eee-tmp\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.717853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.717851 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-serving-cert\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.718139 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.717882 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-config\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.718139 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.717902 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-service-ca\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.718139 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.717944 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khrbn\" (UniqueName: \"kubernetes.io/projected/02a7b956-25dd-45a1-8dcd-bae15d840eee-kube-api-access-khrbn\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.718139 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.717972 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-oauth-serving-cert\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.718273 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.718200 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02a7b956-25dd-45a1-8dcd-bae15d840eee-tmp\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.718963 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.718937 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-service-ca\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.719072 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.718946 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-oauth-serving-cert\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.719383 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.719362 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-config\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.720761 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.720743 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-oauth-config\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.720761 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.720752 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-serving-cert\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.743644 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.743614 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khrbn\" (UniqueName: \"kubernetes.io/projected/02a7b956-25dd-45a1-8dcd-bae15d840eee-kube-api-access-khrbn\") pod \"console-6f4f9f7bcf-fptp9\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:31.756638 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.756606 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5"] Oct 30 18:36:31.758611 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:31.758585 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d75bad9_1276_44c5_a2c4_9258ac202234.slice/crio-8e45ef8cf9f3809072242b07abe22c0c019e60234f58cb169fb319683fb2c81f WatchSource:0}: Error finding container 8e45ef8cf9f3809072242b07abe22c0c019e60234f58cb169fb319683fb2c81f: Status 404 returned error can't find the container with id 8e45ef8cf9f3809072242b07abe22c0c019e60234f58cb169fb319683fb2c81f Oct 30 18:36:31.803853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:31.803813 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:32.003243 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:32.003165 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" event={"ID":"5d75bad9-1276-44c5-a2c4-9258ac202234","Type":"ContainerStarted","Data":"8e45ef8cf9f3809072242b07abe22c0c019e60234f58cb169fb319683fb2c81f"} Oct 30 18:36:32.101796 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:32.101769 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4f9f7bcf-fptp9"] Oct 30 18:36:32.103431 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:32.103391 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a7b956_25dd_45a1_8dcd_bae15d840eee.slice/crio-da005a124af83ceb3450e697b4293cdb34a7aa3cc19ed5d8d866fa5ed110e38d WatchSource:0}: Error finding container da005a124af83ceb3450e697b4293cdb34a7aa3cc19ed5d8d866fa5ed110e38d: Status 404 returned error can't find the container with id da005a124af83ceb3450e697b4293cdb34a7aa3cc19ed5d8d866fa5ed110e38d Oct 30 18:36:32.207368 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:32.207305 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:32.377348 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:32.377236 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:33.018664 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:33.018549 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4f9f7bcf-fptp9" event={"ID":"02a7b956-25dd-45a1-8dcd-bae15d840eee","Type":"ContainerStarted","Data":"da005a124af83ceb3450e697b4293cdb34a7aa3cc19ed5d8d866fa5ed110e38d"} Oct 30 18:36:33.999788 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:33.999751 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:34.024681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:34.024646 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" event={"ID":"5d75bad9-1276-44c5-a2c4-9258ac202234","Type":"ContainerStarted","Data":"c858f1f3cef1cc02f20412ac1d8c4777d7b167abbd9bfb067a60f9d6b7fa9972"} Oct 30 18:36:34.024855 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:34.024709 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" event={"ID":"5d75bad9-1276-44c5-a2c4-9258ac202234","Type":"ContainerStarted","Data":"e1070906d5fb621dd381be5f3eeb007648bb019cf576c069314584d75adf2e5a"} Oct 30 18:36:34.072975 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:34.072426 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-6j9f5" podStartSLOduration=1.786350028 podStartE2EDuration="3.072393418s" totalImagesPullingTime="1.28604339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:34.072256502 +0000 UTC m=+19.301106049" watchObservedRunningTime="2026-10-30 18:36:34.072393418 +0000 UTC m=+19.301242966" Oct 30 18:36:35.526580 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.526539 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:35.717451 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.717350 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:35.777469 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.777366 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cd8bq"] Oct 30 18:36:35.780538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.780371 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:35.790993 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.790966 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf"] Oct 30 18:36:35.793590 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.793569 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:35.814256 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.814215 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf"] Oct 30 18:36:35.842383 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.842348 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 18:36:35.842588 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.842531 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Oct 30 18:36:35.842980 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.842953 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 18:36:35.843086 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.843058 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Oct 30 18:36:35.843086 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.843071 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 18:36:35.843181 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.843098 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zld24\"" Oct 30 18:36:35.843181 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.843107 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Oct 30 18:36:35.843181 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.843138 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-srv8p\"" Oct 30 18:36:35.900001 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.899967 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:35.948526 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.948493 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:35.948526 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.948531 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77ffd04a-7f05-499a-91af-0bb3b95f906f-metrics-client-ca\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:35.948772 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.948553 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:35.948772 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.948677 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:35.948772 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.948730 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77ffd04a-7f05-499a-91af-0bb3b95f906f-root\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:35.948880 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.948835 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-wtmp\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:35.948932 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.948878 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-accelerators-collector-config\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:35.948985 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.948944 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77ffd04a-7f05-499a-91af-0bb3b95f906f-sys\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:35.948985 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.948972 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9qzv\" (UniqueName: \"kubernetes.io/projected/77ffd04a-7f05-499a-91af-0bb3b95f906f-kube-api-access-g9qzv\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:35.949077 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.949009 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-tls\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:35.949077 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.949035 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:35.949077 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.949069 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:35.949247 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.949099 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-textfile\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:35.949247 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.949152 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:35.949247 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:35.949187 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njd2z\" (UniqueName: \"kubernetes.io/projected/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-kube-api-access-njd2z\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.033094 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.033004 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4f9f7bcf-fptp9" event={"ID":"02a7b956-25dd-45a1-8dcd-bae15d840eee","Type":"ContainerStarted","Data":"c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377"} Oct 30 18:36:36.049524 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.049497 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.049681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.049542 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77ffd04a-7f05-499a-91af-0bb3b95f906f-metrics-client-ca\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.049681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.049567 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.049681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.049597 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.049681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.049637 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77ffd04a-7f05-499a-91af-0bb3b95f906f-root\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.049681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.049659 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-wtmp\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.049914 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.049804 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-wtmp\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.049914 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.049860 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77ffd04a-7f05-499a-91af-0bb3b95f906f-root\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.049914 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.049900 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-accelerators-collector-config\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.050052 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.049933 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77ffd04a-7f05-499a-91af-0bb3b95f906f-sys\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.050052 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.049957 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9qzv\" (UniqueName: \"kubernetes.io/projected/77ffd04a-7f05-499a-91af-0bb3b95f906f-kube-api-access-g9qzv\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.050052 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.049990 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-tls\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.050052 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.050014 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.050052 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.050045 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.050270 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.050070 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-textfile\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.050270 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.050099 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.050270 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.050127 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njd2z\" (UniqueName: \"kubernetes.io/projected/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-kube-api-access-njd2z\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.050270 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.050184 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.050270 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.050216 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77ffd04a-7f05-499a-91af-0bb3b95f906f-metrics-client-ca\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.050518 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.050284 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.050644 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.050616 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77ffd04a-7f05-499a-91af-0bb3b95f906f-sys\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.050724 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.050704 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-textfile\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.050879 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.050836 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.051133 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.051110 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-accelerators-collector-config\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.052520 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.052501 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-tls\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.052614 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.052527 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.052755 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.052731 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77ffd04a-7f05-499a-91af-0bb3b95f906f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.053079 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.053050 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.075379 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.075354 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njd2z\" (UniqueName: \"kubernetes.io/projected/6c017ade-ad44-403b-9abb-fa8d0a4cfb62-kube-api-access-njd2z\") pod \"kube-state-metrics-5dc8d7d89b-562bf\" (UID: \"6c017ade-ad44-403b-9abb-fa8d0a4cfb62\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.076200 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.076180 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9qzv\" (UniqueName: \"kubernetes.io/projected/77ffd04a-7f05-499a-91af-0bb3b95f906f-kube-api-access-g9qzv\") pod \"node-exporter-cd8bq\" (UID: \"77ffd04a-7f05-499a-91af-0bb3b95f906f\") " pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.080369 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.080324 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6f4f9f7bcf-fptp9" podStartSLOduration=2.175230021 podStartE2EDuration="5.080310526s" totalImagesPullingTime="2.905080505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:36.08004626 +0000 UTC m=+21.308895806" watchObservedRunningTime="2026-10-30 18:36:36.080310526 +0000 UTC m=+21.309160073" Oct 30 18:36:36.082108 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.082084 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:36.096431 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.096391 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cd8bq" Oct 30 18:36:36.106701 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.106684 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" Oct 30 18:36:36.107028 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:36.107005 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ffd04a_7f05_499a_91af_0bb3b95f906f.slice/crio-c191da59365ec1827ec84961d5fc4880406b20b0aacfcea8004e31ac3373dcb8 WatchSource:0}: Error finding container c191da59365ec1827ec84961d5fc4880406b20b0aacfcea8004e31ac3373dcb8: Status 404 returned error can't find the container with id c191da59365ec1827ec84961d5fc4880406b20b0aacfcea8004e31ac3373dcb8 Oct 30 18:36:36.248019 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.247978 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:36.415902 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.415870 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf"] Oct 30 18:36:36.417032 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:36.417009 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c017ade_ad44_403b_9abb_fa8d0a4cfb62.slice/crio-f8c7e8b2255c0b2ed6b11349555f51c6f05b80601bb2ce317767ca777765f288 WatchSource:0}: Error finding container f8c7e8b2255c0b2ed6b11349555f51c6f05b80601bb2ce317767ca777765f288: Status 404 returned error can't find the container with id f8c7e8b2255c0b2ed6b11349555f51c6f05b80601bb2ce317767ca777765f288 Oct 30 18:36:36.423252 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.423225 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:36.906685 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:36.906610 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:37.039151 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.039048 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" event={"ID":"6c017ade-ad44-403b-9abb-fa8d0a4cfb62","Type":"ContainerStarted","Data":"f8c7e8b2255c0b2ed6b11349555f51c6f05b80601bb2ce317767ca777765f288"} Oct 30 18:36:37.043777 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.043743 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cd8bq" event={"ID":"77ffd04a-7f05-499a-91af-0bb3b95f906f","Type":"ContainerStarted","Data":"c191da59365ec1827ec84961d5fc4880406b20b0aacfcea8004e31ac3373dcb8"} Oct 30 18:36:37.113677 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.113643 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:36:37.116695 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.116665 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.121856 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.121820 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:37.135492 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.134676 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 18:36:37.135492 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.134874 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 18:36:37.135492 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.134978 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cn55f\"" Oct 30 18:36:37.135492 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.135044 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 18:36:37.135492 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.135102 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 18:36:37.135492 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.135186 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 18:36:37.135492 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.135251 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 18:36:37.135492 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.135312 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 18:36:37.135492 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.135449 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 18:36:37.151555 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.151523 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:36:37.234336 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.234305 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 18:36:37.259104 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.258996 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-web-config\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.259104 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.259050 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.259104 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.259069 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.259104 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.259100 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.259428 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.259146 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.259428 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.259177 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d66jt\" (UniqueName: \"kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-kube-api-access-d66jt\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.259428 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.259219 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.259428 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.259245 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.259428 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.259269 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.259428 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.259298 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-config-out\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.259428 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.259325 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.259428 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.259363 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.259428 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.259392 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.303247 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.295906 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.360660 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.360711 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.360739 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.360766 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-config-out\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.360794 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.360833 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.360863 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.360902 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-web-config\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.360927 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.360949 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.360982 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.361028 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.361058 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d66jt\" (UniqueName: \"kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-kube-api-access-d66jt\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.362853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.362544 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.365168 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.364844 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.367256 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.367199 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.367498 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.367459 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.368116 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.367954 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.369327 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.368207 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.369327 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.368576 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.369327 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.368766 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-web-config\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.369540 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.369460 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.369641 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.369615 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.370221 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.370198 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.370547 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.370528 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-config-out\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.386084 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.386061 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d66jt\" (UniqueName: \"kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-kube-api-access-d66jt\") pod \"alertmanager-main-0\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.439455 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.439370 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:36:37.497110 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.496998 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:37.768679 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.768651 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:36:37.784676 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:37.784646 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae390216_90db_4e00_81b1_993a88e497ac.slice/crio-e8e7e6efe3a0ce51064a0c9f9281f1db244ee4d30ab792afdb80f985c326b5f7 WatchSource:0}: Error finding container e8e7e6efe3a0ce51064a0c9f9281f1db244ee4d30ab792afdb80f985c326b5f7: Status 404 returned error can't find the container with id e8e7e6efe3a0ce51064a0c9f9281f1db244ee4d30ab792afdb80f985c326b5f7 Oct 30 18:36:37.912210 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.912182 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg"] Oct 30 18:36:37.915458 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.915437 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:37.933154 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.933131 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Oct 30 18:36:37.933629 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.933613 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Oct 30 18:36:37.933629 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.933625 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Oct 30 18:36:37.933775 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.933708 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Oct 30 18:36:37.933775 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.933749 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-14ll6u23oq5ag\"" Oct 30 18:36:37.933775 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.933751 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Oct 30 18:36:37.933903 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.933789 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fb8fz\"" Oct 30 18:36:37.939632 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:37.939607 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg"] Oct 30 18:36:38.049607 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.049522 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" event={"ID":"6c017ade-ad44-403b-9abb-fa8d0a4cfb62","Type":"ContainerStarted","Data":"ee8c2ec702b1d3f7d8b8bf267117f875e532a9916e36a48c0811f1d8de42c76f"} Oct 30 18:36:38.049607 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.049601 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" event={"ID":"6c017ade-ad44-403b-9abb-fa8d0a4cfb62","Type":"ContainerStarted","Data":"fa56833130f72f552a4d7f8100be91a7423d962779e0c82be01430dc470dfc1a"} Oct 30 18:36:38.049894 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.049634 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" event={"ID":"6c017ade-ad44-403b-9abb-fa8d0a4cfb62","Type":"ContainerStarted","Data":"cd1839fc49e4d094173e5faefd7ad3742475a48ce1c6c2446032db0f69d631d3"} Oct 30 18:36:38.051448 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.051418 4494 generic.go:356] "Generic (PLEG): container finished" podID="77ffd04a-7f05-499a-91af-0bb3b95f906f" containerID="9374cde5a496a3e0766886004dfbaca7f66f7cae4bfe86c616574a75d207c565" exitCode=0 Oct 30 18:36:38.051547 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.051522 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cd8bq" event={"ID":"77ffd04a-7f05-499a-91af-0bb3b95f906f","Type":"ContainerDied","Data":"9374cde5a496a3e0766886004dfbaca7f66f7cae4bfe86c616574a75d207c565"} Oct 30 18:36:38.053040 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.053015 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerStarted","Data":"e8e7e6efe3a0ce51064a0c9f9281f1db244ee4d30ab792afdb80f985c326b5f7"} Oct 30 18:36:38.070707 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.070677 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svmzk\" (UniqueName: \"kubernetes.io/projected/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-kube-api-access-svmzk\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.070802 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.070729 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-metrics-client-ca\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.070802 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.070760 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-grpc-tls\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.070802 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.070784 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-tmp\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.070958 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.070815 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.070958 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.070843 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-tls\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.070958 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.070910 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.070958 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.070936 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.071129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.070959 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.097488 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.097437 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" podStartSLOduration=1.7567237279999999 podStartE2EDuration="3.097422688s" totalImagesPullingTime="1.34069896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:38.095893897 +0000 UTC m=+23.324743465" watchObservedRunningTime="2026-10-30 18:36:38.097422688 +0000 UTC m=+23.326272230" Oct 30 18:36:38.172429 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.171624 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svmzk\" (UniqueName: \"kubernetes.io/projected/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-kube-api-access-svmzk\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.172429 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.171709 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-metrics-client-ca\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.172429 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.171735 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-grpc-tls\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.172429 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.171754 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-tmp\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.172429 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.171779 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.172429 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.171837 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-tls\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.172429 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.172035 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.172429 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.172099 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.172429 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.172162 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.172429 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.172251 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-tmp\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.172990 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.172639 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-metrics-client-ca\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.175444 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.175141 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.175444 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.175177 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.175735 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.175710 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-tls\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.176092 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.176071 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.176189 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.176170 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-grpc-tls\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.177705 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.177686 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.200434 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.197642 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svmzk\" (UniqueName: \"kubernetes.io/projected/fc9cba1a-169c-453d-971f-9e1fa9f1da9f-kube-api-access-svmzk\") pod \"thanos-querier-7c67c49dc9-vjbwg\" (UID: \"fc9cba1a-169c-453d-971f-9e1fa9f1da9f\") " pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.233759 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.233728 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:38.552926 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:38.552892 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg"] Oct 30 18:36:38.553845 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:38.553813 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9cba1a_169c_453d_971f_9e1fa9f1da9f.slice/crio-8a1b2aa1a70ff4e39ed7938985195a37e0452fe6fe60c98b8a5ab088bcf5908e WatchSource:0}: Error finding container 8a1b2aa1a70ff4e39ed7938985195a37e0452fe6fe60c98b8a5ab088bcf5908e: Status 404 returned error can't find the container with id 8a1b2aa1a70ff4e39ed7938985195a37e0452fe6fe60c98b8a5ab088bcf5908e Oct 30 18:36:39.052346 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:39.052220 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:39.059182 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:39.059151 4494 generic.go:356] "Generic (PLEG): container finished" podID="ae390216-90db-4e00-81b1-993a88e497ac" containerID="e0be980c51c96b9cefdcdd6bd5f3226e42de80b4ce3b32fef9cbcf66036ae7d4" exitCode=0 Oct 30 18:36:39.059343 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:39.059236 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerDied","Data":"e0be980c51c96b9cefdcdd6bd5f3226e42de80b4ce3b32fef9cbcf66036ae7d4"} Oct 30 18:36:39.061279 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:39.061255 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" event={"ID":"fc9cba1a-169c-453d-971f-9e1fa9f1da9f","Type":"ContainerStarted","Data":"8a1b2aa1a70ff4e39ed7938985195a37e0452fe6fe60c98b8a5ab088bcf5908e"} Oct 30 18:36:39.064292 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:39.064271 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cd8bq" event={"ID":"77ffd04a-7f05-499a-91af-0bb3b95f906f","Type":"ContainerStarted","Data":"144de8685591c903114ee0e1313edd30e8810219dd1b766a4d5f9cce5cc80ca5"} Oct 30 18:36:39.064394 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:39.064315 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cd8bq" event={"ID":"77ffd04a-7f05-499a-91af-0bb3b95f906f","Type":"ContainerStarted","Data":"a839d1418ea177c6605b8a19e87a68c1b8d682beb870ef3ca76625e7c46144b1"} Oct 30 18:36:39.167572 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:39.167515 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cd8bq" podStartSLOduration=3.062533706 podStartE2EDuration="4.167496435s" totalImagesPullingTime="1.01651226s" totalInitContainerRuntime="88.450469ms" isStatefulPod=true podCreationTimestamp="2026-10-30 18:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:39.166633726 +0000 UTC m=+24.395483286" watchObservedRunningTime="2026-10-30 18:36:39.167496435 +0000 UTC m=+24.396346014" Oct 30 18:36:39.223847 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:39.223798 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:39.395038 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:39.394958 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:40.912062 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:40.912032 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:41.077908 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:41.077519 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerStarted","Data":"3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209"} Oct 30 18:36:41.077908 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:41.077603 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerStarted","Data":"1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f"} Oct 30 18:36:41.077908 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:41.077642 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerStarted","Data":"17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17"} Oct 30 18:36:41.081219 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:41.081079 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" event={"ID":"fc9cba1a-169c-453d-971f-9e1fa9f1da9f","Type":"ContainerStarted","Data":"33682c8fb3d3470cdde3ab4162fb8fdd6e24986700eb82cea16116ac6f516051"} Oct 30 18:36:41.081219 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:41.081154 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" event={"ID":"fc9cba1a-169c-453d-971f-9e1fa9f1da9f","Type":"ContainerStarted","Data":"d82870b61af464cb85bed0329830fee820066a384e4f64b5631e4cb0e3570d69"} Oct 30 18:36:41.104227 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:41.104140 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:41.805218 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:41.804673 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:41.805218 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:41.805180 4494 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:41.810025 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:41.810000 4494 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:42.089438 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:42.089383 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerStarted","Data":"90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e"} Oct 30 18:36:42.089793 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:42.089504 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerStarted","Data":"76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928"} Oct 30 18:36:42.089793 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:42.089536 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerStarted","Data":"662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76"} Oct 30 18:36:42.093194 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:42.093168 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" event={"ID":"fc9cba1a-169c-453d-971f-9e1fa9f1da9f","Type":"ContainerStarted","Data":"ef88c1155ecfc6f15920a030f8731b2eaf0e620f5d67298d7b3775b8694e0cd5"} Oct 30 18:36:42.093297 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:42.093252 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" event={"ID":"fc9cba1a-169c-453d-971f-9e1fa9f1da9f","Type":"ContainerStarted","Data":"d88a124e89b57ffc6bed9ad27b7fd977106175fe1d699e01d55892a165ee1429"} Oct 30 18:36:42.097938 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:42.097918 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:36:42.149115 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:42.149062 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.593163914 podStartE2EDuration="5.1490491s" totalImagesPullingTime="3.540819962s" totalInitContainerRuntime="15.065224ms" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:42.147382139 +0000 UTC m=+27.376231686" watchObservedRunningTime="2026-10-30 18:36:42.1490491 +0000 UTC m=+27.377898636" Oct 30 18:36:42.772180 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:42.772128 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:43.028686 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.028616 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5tlrv" Oct 30 18:36:43.105384 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.105316 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" event={"ID":"fc9cba1a-169c-453d-971f-9e1fa9f1da9f","Type":"ContainerStarted","Data":"99f78c80aecd6b2a69370157ee2e1853362f9355675dcd6353aa0e1e69865448"} Oct 30 18:36:43.105880 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.105425 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" event={"ID":"fc9cba1a-169c-453d-971f-9e1fa9f1da9f","Type":"ContainerStarted","Data":"3b8da83c21911527359b50bf8a7f6f8e2bf6b0596047a58f30a3e57c44856737"} Oct 30 18:36:43.106020 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.106001 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:43.188345 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.188287 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" podStartSLOduration=3.01776405 podStartE2EDuration="6.188271628s" totalImagesPullingTime="3.170507578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:43.17360414 +0000 UTC m=+28.402453687" watchObservedRunningTime="2026-10-30 18:36:43.188271628 +0000 UTC m=+28.417121173" Oct 30 18:36:43.290953 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.290860 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-d7ff84498-55hl2"] Oct 30 18:36:43.298098 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.298068 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.315128 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.315099 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7ff84498-55hl2"] Oct 30 18:36:43.331952 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.331926 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 30 18:36:43.422853 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.422819 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-oauth-config\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.423022 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.422864 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-oauth-serving-cert\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.423022 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.422956 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-config\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.423022 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.422995 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-serving-cert\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.423022 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.423015 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/426fb135-e9c9-4953-a97c-6d3c7176d40c-tmp\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.423180 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.423114 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86m97\" (UniqueName: \"kubernetes.io/projected/426fb135-e9c9-4953-a97c-6d3c7176d40c-kube-api-access-86m97\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.423180 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.423141 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-trusted-ca-bundle\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.423180 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.423169 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-service-ca\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.524209 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.524171 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-config\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.524209 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.524220 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-serving-cert\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.524491 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.524244 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/426fb135-e9c9-4953-a97c-6d3c7176d40c-tmp\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.524491 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.524274 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86m97\" (UniqueName: \"kubernetes.io/projected/426fb135-e9c9-4953-a97c-6d3c7176d40c-kube-api-access-86m97\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.524491 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.524298 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-trusted-ca-bundle\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.524491 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.524325 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-service-ca\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.524491 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.524374 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-oauth-config\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.524491 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.524418 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-oauth-serving-cert\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.525099 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.525074 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-oauth-serving-cert\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.525752 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.525314 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-service-ca\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.525752 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.525599 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-config\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.525928 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.525857 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/426fb135-e9c9-4953-a97c-6d3c7176d40c-tmp\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.526328 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.526306 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-trusted-ca-bundle\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.530283 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.530260 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-oauth-config\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.531182 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.531159 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-serving-cert\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.551986 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.551931 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86m97\" (UniqueName: \"kubernetes.io/projected/426fb135-e9c9-4953-a97c-6d3c7176d40c-kube-api-access-86m97\") pod \"console-d7ff84498-55hl2\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.610824 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.610793 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:43.852711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.852640 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9dktd" Oct 30 18:36:43.932579 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:43.932546 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7ff84498-55hl2"] Oct 30 18:36:43.934191 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:36:43.934154 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426fb135_e9c9_4953_a97c_6d3c7176d40c.slice/crio-f76d2bb4497170026e8bb5cca0db0d4aa109f291a8d37068fa948da026ee90a6 WatchSource:0}: Error finding container f76d2bb4497170026e8bb5cca0db0d4aa109f291a8d37068fa948da026ee90a6: Status 404 returned error can't find the container with id f76d2bb4497170026e8bb5cca0db0d4aa109f291a8d37068fa948da026ee90a6 Oct 30 18:36:44.112306 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:44.112212 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7ff84498-55hl2" event={"ID":"426fb135-e9c9-4953-a97c-6d3c7176d40c","Type":"ContainerStarted","Data":"0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f"} Oct 30 18:36:44.112306 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:44.112284 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7ff84498-55hl2" event={"ID":"426fb135-e9c9-4953-a97c-6d3c7176d40c","Type":"ContainerStarted","Data":"f76d2bb4497170026e8bb5cca0db0d4aa109f291a8d37068fa948da026ee90a6"} Oct 30 18:36:44.126825 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:44.126776 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:44.320842 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:44.320806 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:44.517998 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:44.517949 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:45.706884 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:45.706852 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:45.882584 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:45.882514 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:46.122576 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:46.122532 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-cnp26" event={"ID":"a72d383b-6b31-4a23-91c5-fe2ad5904509","Type":"ContainerStarted","Data":"9c7f11630cc6397f69b3f50c91734aa8377aa1a49a0d800e7d2fae9cfc156aa5"} Oct 30 18:36:46.122873 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:46.122851 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-cnp26" Oct 30 18:36:46.134069 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:46.133997 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-cnp26" Oct 30 18:36:46.167689 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:46.167633 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-cnp26" podStartSLOduration=1.994939687 podStartE2EDuration="19.167618305s" totalImagesPullingTime="17.172678618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:46.166886078 +0000 UTC m=+31.395735626" watchObservedRunningTime="2026-10-30 18:36:46.167618305 +0000 UTC m=+31.396467852" Oct 30 18:36:46.168542 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:46.168505 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-d7ff84498-55hl2" podStartSLOduration=3.168493019 podStartE2EDuration="3.168493019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:36:44.161507429 +0000 UTC m=+29.390356976" watchObservedRunningTime="2026-10-30 18:36:46.168493019 +0000 UTC m=+31.397342566" Oct 30 18:36:47.238152 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:47.238117 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:47.464196 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:47.464156 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:48.133900 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:48.133818 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 18:36:48.133900 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:48.133859 4494 generic.go:356] "Generic (PLEG): container finished" podID="6c017ade-ad44-403b-9abb-fa8d0a4cfb62" containerID="cd1839fc49e4d094173e5faefd7ad3742475a48ce1c6c2446032db0f69d631d3" exitCode=1 Oct 30 18:36:48.134093 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:48.133937 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" event={"ID":"6c017ade-ad44-403b-9abb-fa8d0a4cfb62","Type":"ContainerDied","Data":"cd1839fc49e4d094173e5faefd7ad3742475a48ce1c6c2446032db0f69d631d3"} Oct 30 18:36:48.134367 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:48.134346 4494 scope.go:122] "RemoveContainer" containerID="cd1839fc49e4d094173e5faefd7ad3742475a48ce1c6c2446032db0f69d631d3" Oct 30 18:36:49.120979 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:49.120950 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c67c49dc9-vjbwg" Oct 30 18:36:49.141504 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:49.141479 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 18:36:49.141661 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:49.141569 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-562bf" event={"ID":"6c017ade-ad44-403b-9abb-fa8d0a4cfb62","Type":"ContainerStarted","Data":"1170e32a368b231a7095de9c4a98afc50924e9ad0f84c71522575350430eb6f3"} Oct 30 18:36:49.322153 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:49.322101 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:49.499087 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:49.499046 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:50.439362 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:50.439324 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:50.624556 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:50.624518 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:50.840001 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:50.839917 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:53.611592 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:53.611555 4494 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:53.612139 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:53.611614 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:53.616815 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:53.616790 4494 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:53.738070 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:36:53.738033 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:36:54.164766 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:54.164734 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:36:54.239698 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:54.239664 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4f9f7bcf-fptp9"] Oct 30 18:36:56.318439 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:56.318375 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:36:56.497114 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:36:56.497072 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:00.235621 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:00.235520 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:00.403310 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:00.403271 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:00.764087 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:00.764047 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:00.971304 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:00.971269 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:02.193203 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:02.193174 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:02.363155 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:02.363123 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:09.937271 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:09.937226 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:10.113823 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:10.113788 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:19.263569 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.263535 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6f4f9f7bcf-fptp9" podUID="02a7b956-25dd-45a1-8dcd-bae15d840eee" containerName="console" containerID="cri-o://c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377" gracePeriod=15 Oct 30 18:37:19.533937 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.533881 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:37:19.615165 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.615140 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-service-ca\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-service-ca\") pod \"02a7b956-25dd-45a1-8dcd-bae15d840eee\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " Oct 30 18:37:19.615321 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.615177 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-oauth-serving-cert\") pod \"02a7b956-25dd-45a1-8dcd-bae15d840eee\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " Oct 30 18:37:19.615321 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.615208 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-config\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-config\") pod \"02a7b956-25dd-45a1-8dcd-bae15d840eee\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " Oct 30 18:37:19.615321 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.615249 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/02a7b956-25dd-45a1-8dcd-bae15d840eee-tmp\" (UniqueName: \"kubernetes.io/empty-dir/02a7b956-25dd-45a1-8dcd-bae15d840eee-tmp\") pod \"02a7b956-25dd-45a1-8dcd-bae15d840eee\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " Oct 30 18:37:19.615321 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.615279 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/02a7b956-25dd-45a1-8dcd-bae15d840eee-kube-api-access-khrbn\" (UniqueName: \"kubernetes.io/projected/02a7b956-25dd-45a1-8dcd-bae15d840eee-kube-api-access-khrbn\") pod \"02a7b956-25dd-45a1-8dcd-bae15d840eee\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " Oct 30 18:37:19.615321 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.615309 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-oauth-config\") pod \"02a7b956-25dd-45a1-8dcd-bae15d840eee\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " Oct 30 18:37:19.615596 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.615342 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-serving-cert\") pod \"02a7b956-25dd-45a1-8dcd-bae15d840eee\" (UID: \"02a7b956-25dd-45a1-8dcd-bae15d840eee\") " Oct 30 18:37:19.615661 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.615637 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02a7b956-25dd-45a1-8dcd-bae15d840eee-tmp" pod "02a7b956-25dd-45a1-8dcd-bae15d840eee" (UID: "02a7b956-25dd-45a1-8dcd-bae15d840eee"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:37:19.615718 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.615707 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-service-ca" pod "02a7b956-25dd-45a1-8dcd-bae15d840eee" (UID: "02a7b956-25dd-45a1-8dcd-bae15d840eee"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:37:19.615765 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.615704 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-oauth-serving-cert" pod "02a7b956-25dd-45a1-8dcd-bae15d840eee" (UID: "02a7b956-25dd-45a1-8dcd-bae15d840eee"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:37:19.615765 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.615747 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-config" pod "02a7b956-25dd-45a1-8dcd-bae15d840eee" (UID: "02a7b956-25dd-45a1-8dcd-bae15d840eee"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:37:19.617581 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.617557 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-oauth-config" pod "02a7b956-25dd-45a1-8dcd-bae15d840eee" (UID: "02a7b956-25dd-45a1-8dcd-bae15d840eee"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:37:19.617668 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.617592 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02a7b956-25dd-45a1-8dcd-bae15d840eee-kube-api-access-khrbn" pod "02a7b956-25dd-45a1-8dcd-bae15d840eee" (UID: "02a7b956-25dd-45a1-8dcd-bae15d840eee"). InnerVolumeSpecName "kube-api-access-khrbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:37:19.617668 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.617651 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-serving-cert" pod "02a7b956-25dd-45a1-8dcd-bae15d840eee" (UID: "02a7b956-25dd-45a1-8dcd-bae15d840eee"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:37:19.716641 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.716618 4494 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:19.716641 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.716639 4494 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:19.716769 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.716648 4494 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-oauth-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:19.716769 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.716656 4494 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:19.716769 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.716664 4494 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02a7b956-25dd-45a1-8dcd-bae15d840eee-tmp\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:19.716769 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.716671 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khrbn\" (UniqueName: \"kubernetes.io/projected/02a7b956-25dd-45a1-8dcd-bae15d840eee-kube-api-access-khrbn\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:19.716769 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:19.716680 4494 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02a7b956-25dd-45a1-8dcd-bae15d840eee-console-oauth-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:20.256192 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:20.256160 4494 generic.go:356] "Generic (PLEG): container finished" podID="02a7b956-25dd-45a1-8dcd-bae15d840eee" containerID="c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377" exitCode=0 Oct 30 18:37:20.256334 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:20.256215 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4f9f7bcf-fptp9" Oct 30 18:37:20.256334 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:20.256218 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4f9f7bcf-fptp9" event={"ID":"02a7b956-25dd-45a1-8dcd-bae15d840eee","Type":"ContainerDied","Data":"c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377"} Oct 30 18:37:20.256334 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:20.256276 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4f9f7bcf-fptp9" event={"ID":"02a7b956-25dd-45a1-8dcd-bae15d840eee","Type":"ContainerDied","Data":"da005a124af83ceb3450e697b4293cdb34a7aa3cc19ed5d8d866fa5ed110e38d"} Oct 30 18:37:20.256334 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:20.256294 4494 scope.go:122] "RemoveContainer" containerID="c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377" Oct 30 18:37:20.264869 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:20.264753 4494 scope.go:122] "RemoveContainer" containerID="c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377" Oct 30 18:37:20.265069 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:37:20.264999 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377\": container with ID starting with c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377 not found: ID does not exist" containerID="c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377" Oct 30 18:37:20.265069 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:20.265024 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377"} err="failed to get container status \"c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377\": rpc error: code = NotFound desc = could not find container \"c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377\": container with ID starting with c7b76c5a60a814669be1dc362700820c5b6e7c070f6de56ae120e2f1acedb377 not found: ID does not exist" Oct 30 18:37:20.313471 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:20.313450 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4f9f7bcf-fptp9"] Oct 30 18:37:20.327781 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:20.327760 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f4f9f7bcf-fptp9"] Oct 30 18:37:20.884636 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:20.884604 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="02a7b956-25dd-45a1-8dcd-bae15d840eee" path="/var/lib/kubelet/pods/02a7b956-25dd-45a1-8dcd-bae15d840eee/volumes" Oct 30 18:37:23.731539 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:37:23.731506 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:37:27.812555 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:27.812524 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:27.992964 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:27.992930 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:32.205389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:32.205359 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:32.374190 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:32.374134 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:37.094967 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:37.094933 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:37.268824 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:37.268795 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:46.172730 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:46.172694 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:47.380248 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:47.380215 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:37:47.380681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:47.380504 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="alertmanager" containerID="cri-o://17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17" gracePeriod=120 Oct 30 18:37:47.380681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:47.380568 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="kube-rbac-proxy-metric" containerID="cri-o://76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928" gracePeriod=120 Oct 30 18:37:47.380681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:47.380596 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="kube-rbac-proxy-web" containerID="cri-o://3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209" gracePeriod=120 Oct 30 18:37:47.380681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:47.380641 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="config-reloader" containerID="cri-o://1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f" gracePeriod=120 Oct 30 18:37:47.380681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:47.380633 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="prom-label-proxy" containerID="cri-o://90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e" gracePeriod=120 Oct 30 18:37:47.380681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:47.380675 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="kube-rbac-proxy" containerID="cri-o://662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76" gracePeriod=120 Oct 30 18:37:47.978923 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:47.978890 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:48.353600 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.353528 4494 generic.go:356] "Generic (PLEG): container finished" podID="ae390216-90db-4e00-81b1-993a88e497ac" containerID="90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e" exitCode=0 Oct 30 18:37:48.353600 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.353557 4494 generic.go:356] "Generic (PLEG): container finished" podID="ae390216-90db-4e00-81b1-993a88e497ac" containerID="76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928" exitCode=0 Oct 30 18:37:48.353600 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.353567 4494 generic.go:356] "Generic (PLEG): container finished" podID="ae390216-90db-4e00-81b1-993a88e497ac" containerID="662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76" exitCode=0 Oct 30 18:37:48.353600 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.353572 4494 generic.go:356] "Generic (PLEG): container finished" podID="ae390216-90db-4e00-81b1-993a88e497ac" containerID="1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f" exitCode=0 Oct 30 18:37:48.353600 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.353579 4494 generic.go:356] "Generic (PLEG): container finished" podID="ae390216-90db-4e00-81b1-993a88e497ac" containerID="17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17" exitCode=0 Oct 30 18:37:48.353851 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.353596 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerDied","Data":"90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e"} Oct 30 18:37:48.353851 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.353664 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerDied","Data":"76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928"} Oct 30 18:37:48.353851 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.353691 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerDied","Data":"662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76"} Oct 30 18:37:48.353851 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.353713 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerDied","Data":"1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f"} Oct 30 18:37:48.353851 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.353737 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerDied","Data":"17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17"} Oct 30 18:37:48.710485 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.710450 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:48.814517 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814488 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-config-out\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.814654 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814542 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-metrics-client-ca\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.814654 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814577 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-main-tls\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.814654 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814607 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-web-config\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-web-config\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.814654 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814650 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.814875 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814677 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-kube-api-access-d66jt\" (UniqueName: \"kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-kube-api-access-d66jt\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.814875 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814706 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-trusted-ca-bundle\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.814875 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814739 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-cluster-tls-config\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.814875 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814768 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-config-volume\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-config-volume\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.814875 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814810 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.815114 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814836 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.815114 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814910 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-tls-assets\" (UniqueName: \"kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-tls-assets\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.815114 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814907 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-metrics-client-ca" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:37:48.815114 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.814942 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-main-db\") pod \"ae390216-90db-4e00-81b1-993a88e497ac\" (UID: \"ae390216-90db-4e00-81b1-993a88e497ac\") " Oct 30 18:37:48.815310 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.815138 4494 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-metrics-client-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:48.815388 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.815355 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-trusted-ca-bundle" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:37:48.815470 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.815395 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-main-db" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:37:48.820733 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.820704 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-kube-api-access-d66jt" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "kube-api-access-d66jt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:37:48.820733 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.820714 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-metric" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:37:48.820912 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.820751 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-main-tls" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:37:48.820912 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.820771 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-tls-assets" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:37:48.820912 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.820823 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-web" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:37:48.820912 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.820833 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-config-volume" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:37:48.820912 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.820848 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:37:48.822219 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.822195 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-config-out" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:37:48.824676 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.824652 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-cluster-tls-config" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:37:48.832129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.832104 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-web-config" pod "ae390216-90db-4e00-81b1-993a88e497ac" (UID: "ae390216-90db-4e00-81b1-993a88e497ac"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:37:48.916082 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.916064 4494 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-web-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:48.916179 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.916085 4494 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:48.916179 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.916095 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d66jt\" (UniqueName: \"kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-kube-api-access-d66jt\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:48.916179 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.916105 4494 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:48.916179 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.916114 4494 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-cluster-tls-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:48.916179 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.916121 4494 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-config-volume\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:48.916179 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.916130 4494 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:48.916179 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.916138 4494 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:48.916179 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.916146 4494 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae390216-90db-4e00-81b1-993a88e497ac-tls-assets\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:48.916179 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.916154 4494 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-alertmanager-main-db\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:48.916179 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.916162 4494 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae390216-90db-4e00-81b1-993a88e497ac-config-out\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:48.916179 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:48.916170 4494 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae390216-90db-4e00-81b1-993a88e497ac-secret-alertmanager-main-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:37:49.363435 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.363340 4494 generic.go:356] "Generic (PLEG): container finished" podID="ae390216-90db-4e00-81b1-993a88e497ac" containerID="3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209" exitCode=0 Oct 30 18:37:49.363556 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.363430 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerDied","Data":"3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209"} Oct 30 18:37:49.363556 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.363457 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.363556 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.363515 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae390216-90db-4e00-81b1-993a88e497ac","Type":"ContainerDied","Data":"e8e7e6efe3a0ce51064a0c9f9281f1db244ee4d30ab792afdb80f985c326b5f7"} Oct 30 18:37:49.363556 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.363548 4494 scope.go:122] "RemoveContainer" containerID="90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e" Oct 30 18:37:49.370601 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.370583 4494 scope.go:122] "RemoveContainer" containerID="76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928" Oct 30 18:37:49.377218 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.377202 4494 scope.go:122] "RemoveContainer" containerID="662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76" Oct 30 18:37:49.383309 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.383292 4494 scope.go:122] "RemoveContainer" containerID="3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209" Oct 30 18:37:49.389277 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.389261 4494 scope.go:122] "RemoveContainer" containerID="1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f" Oct 30 18:37:49.395261 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.395245 4494 scope.go:122] "RemoveContainer" containerID="17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17" Oct 30 18:37:49.401532 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.401516 4494 scope.go:122] "RemoveContainer" containerID="e0be980c51c96b9cefdcdd6bd5f3226e42de80b4ce3b32fef9cbcf66036ae7d4" Oct 30 18:37:49.407594 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.407580 4494 scope.go:122] "RemoveContainer" containerID="90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e" Oct 30 18:37:49.407826 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:37:49.407807 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e\": container with ID starting with 90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e not found: ID does not exist" containerID="90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e" Oct 30 18:37:49.407885 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.407835 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e"} err="failed to get container status \"90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e\": rpc error: code = NotFound desc = could not find container \"90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e\": container with ID starting with 90d82da0d885c13aa37cdfefb8ac9111aa8bc658d27bb25480951d2f60f20d2e not found: ID does not exist" Oct 30 18:37:49.407885 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.407853 4494 scope.go:122] "RemoveContainer" containerID="76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928" Oct 30 18:37:49.408085 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:37:49.408069 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928\": container with ID starting with 76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928 not found: ID does not exist" containerID="76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928" Oct 30 18:37:49.408129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.408090 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928"} err="failed to get container status \"76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928\": rpc error: code = NotFound desc = could not find container \"76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928\": container with ID starting with 76ed0149ff0d5efd9a537fe8b869e8405544143c2528ccf708d93ffd7dca5928 not found: ID does not exist" Oct 30 18:37:49.408129 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.408109 4494 scope.go:122] "RemoveContainer" containerID="662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76" Oct 30 18:37:49.408326 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:37:49.408310 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76\": container with ID starting with 662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76 not found: ID does not exist" containerID="662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76" Oct 30 18:37:49.408364 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.408330 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76"} err="failed to get container status \"662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76\": rpc error: code = NotFound desc = could not find container \"662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76\": container with ID starting with 662e032c2eaa45914af04ac635ad90ee24afc69f63590e4e096f790c5143fc76 not found: ID does not exist" Oct 30 18:37:49.408364 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.408342 4494 scope.go:122] "RemoveContainer" containerID="3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209" Oct 30 18:37:49.408597 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:37:49.408580 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209\": container with ID starting with 3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209 not found: ID does not exist" containerID="3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209" Oct 30 18:37:49.408645 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.408601 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209"} err="failed to get container status \"3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209\": rpc error: code = NotFound desc = could not find container \"3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209\": container with ID starting with 3f57f2d6515c62c9a6be23af0834cb00c425a5701628ec44941cafaf6baee209 not found: ID does not exist" Oct 30 18:37:49.408645 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.408618 4494 scope.go:122] "RemoveContainer" containerID="1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f" Oct 30 18:37:49.408839 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:37:49.408823 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f\": container with ID starting with 1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f not found: ID does not exist" containerID="1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f" Oct 30 18:37:49.408872 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.408845 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f"} err="failed to get container status \"1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f\": rpc error: code = NotFound desc = could not find container \"1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f\": container with ID starting with 1af22a1eab5bfefc5a3848d35c88e208d321e1c2759a3a6d8ed5ce84bbffe75f not found: ID does not exist" Oct 30 18:37:49.408872 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.408858 4494 scope.go:122] "RemoveContainer" containerID="17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17" Oct 30 18:37:49.409070 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:37:49.409054 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17\": container with ID starting with 17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17 not found: ID does not exist" containerID="17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17" Oct 30 18:37:49.409115 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.409075 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17"} err="failed to get container status \"17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17\": rpc error: code = NotFound desc = could not find container \"17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17\": container with ID starting with 17d9ce571774b8dfd79f236ecb016d3901e0d9e9e6fdc483a05d9710d48e8c17 not found: ID does not exist" Oct 30 18:37:49.409115 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.409088 4494 scope.go:122] "RemoveContainer" containerID="e0be980c51c96b9cefdcdd6bd5f3226e42de80b4ce3b32fef9cbcf66036ae7d4" Oct 30 18:37:49.409312 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:37:49.409298 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0be980c51c96b9cefdcdd6bd5f3226e42de80b4ce3b32fef9cbcf66036ae7d4\": container with ID starting with e0be980c51c96b9cefdcdd6bd5f3226e42de80b4ce3b32fef9cbcf66036ae7d4 not found: ID does not exist" containerID="e0be980c51c96b9cefdcdd6bd5f3226e42de80b4ce3b32fef9cbcf66036ae7d4" Oct 30 18:37:49.409345 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.409314 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0be980c51c96b9cefdcdd6bd5f3226e42de80b4ce3b32fef9cbcf66036ae7d4"} err="failed to get container status \"e0be980c51c96b9cefdcdd6bd5f3226e42de80b4ce3b32fef9cbcf66036ae7d4\": rpc error: code = NotFound desc = could not find container \"e0be980c51c96b9cefdcdd6bd5f3226e42de80b4ce3b32fef9cbcf66036ae7d4\": container with ID starting with e0be980c51c96b9cefdcdd6bd5f3226e42de80b4ce3b32fef9cbcf66036ae7d4 not found: ID does not exist" Oct 30 18:37:49.438002 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.437974 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:37:49.452398 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.452378 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:37:49.473487 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473466 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:37:49.473781 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473764 4494 cpu_manager.go:414] "containerMap: removing container" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="config-reloader" Oct 30 18:37:49.473841 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473785 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="config-reloader" Oct 30 18:37:49.473841 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473802 4494 cpu_manager.go:414] "containerMap: removing container" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="alertmanager" Oct 30 18:37:49.473841 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473810 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="alertmanager" Oct 30 18:37:49.473841 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473821 4494 cpu_manager.go:414] "containerMap: removing container" podUID="02a7b956-25dd-45a1-8dcd-bae15d840eee" containerName="console" Oct 30 18:37:49.473841 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473828 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02a7b956-25dd-45a1-8dcd-bae15d840eee" containerName="console" Oct 30 18:37:49.473841 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473840 4494 cpu_manager.go:414] "containerMap: removing container" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="kube-rbac-proxy" Oct 30 18:37:49.474023 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473847 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="kube-rbac-proxy" Oct 30 18:37:49.474023 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473861 4494 cpu_manager.go:414] "containerMap: removing container" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="kube-rbac-proxy-metric" Oct 30 18:37:49.474023 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473868 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="kube-rbac-proxy-metric" Oct 30 18:37:49.474023 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473884 4494 cpu_manager.go:414] "containerMap: removing container" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="prom-label-proxy" Oct 30 18:37:49.474023 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473891 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="prom-label-proxy" Oct 30 18:37:49.474023 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473906 4494 cpu_manager.go:414] "containerMap: removing container" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="init-config-reloader" Oct 30 18:37:49.474023 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473913 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="init-config-reloader" Oct 30 18:37:49.474023 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473932 4494 cpu_manager.go:414] "containerMap: removing container" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="kube-rbac-proxy-web" Oct 30 18:37:49.474023 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.473938 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="kube-rbac-proxy-web" Oct 30 18:37:49.474261 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.474033 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="prom-label-proxy" Oct 30 18:37:49.474261 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.474049 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="kube-rbac-proxy-web" Oct 30 18:37:49.474261 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.474061 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="config-reloader" Oct 30 18:37:49.474261 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.474069 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="alertmanager" Oct 30 18:37:49.474261 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.474078 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="02a7b956-25dd-45a1-8dcd-bae15d840eee" containerName="console" Oct 30 18:37:49.474261 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.474087 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="kube-rbac-proxy" Oct 30 18:37:49.474261 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.474096 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae390216-90db-4e00-81b1-993a88e497ac" containerName="kube-rbac-proxy-metric" Oct 30 18:37:49.477433 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.477417 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.494689 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.494666 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 18:37:49.494689 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.494667 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 18:37:49.494830 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.494666 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 18:37:49.494830 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.494672 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 18:37:49.494830 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.494750 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 18:37:49.494830 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.494777 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cn55f\"" Oct 30 18:37:49.494830 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.494803 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 18:37:49.494830 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.494810 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 18:37:49.495029 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.494859 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 18:37:49.509439 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.509418 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 18:37:49.510476 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.510430 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:37:49.619846 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.619797 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.619846 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.619830 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7be05cd6-14a1-4990-b156-d3b0240bf6fe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.620007 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.619848 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7be05cd6-14a1-4990-b156-d3b0240bf6fe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.620007 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.619865 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.620007 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.619926 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7be05cd6-14a1-4990-b156-d3b0240bf6fe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.620139 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.620000 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7be05cd6-14a1-4990-b156-d3b0240bf6fe-config-out\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.620139 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.620039 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-config-volume\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.620139 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.620064 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-web-config\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.620245 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.620140 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.620245 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.620217 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7be05cd6-14a1-4990-b156-d3b0240bf6fe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.620245 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.620243 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfvl4\" (UniqueName: \"kubernetes.io/projected/7be05cd6-14a1-4990-b156-d3b0240bf6fe-kube-api-access-wfvl4\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.620378 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.620266 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.620378 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.620320 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721162 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721140 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721166 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721186 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721209 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7be05cd6-14a1-4990-b156-d3b0240bf6fe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721225 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7be05cd6-14a1-4990-b156-d3b0240bf6fe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721247 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721271 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7be05cd6-14a1-4990-b156-d3b0240bf6fe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721301 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7be05cd6-14a1-4990-b156-d3b0240bf6fe-config-out\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721327 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-config-volume\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721348 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-web-config\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721379 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721419 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7be05cd6-14a1-4990-b156-d3b0240bf6fe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.721528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.721451 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfvl4\" (UniqueName: \"kubernetes.io/projected/7be05cd6-14a1-4990-b156-d3b0240bf6fe-kube-api-access-wfvl4\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.722152 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.722100 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7be05cd6-14a1-4990-b156-d3b0240bf6fe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.722496 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.722473 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7be05cd6-14a1-4990-b156-d3b0240bf6fe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.724335 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.724122 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.724335 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.724176 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.724335 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.724278 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.724335 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.724283 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.724598 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.724467 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7be05cd6-14a1-4990-b156-d3b0240bf6fe-config-out\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.724598 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.724497 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7be05cd6-14a1-4990-b156-d3b0240bf6fe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.724598 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.724541 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7be05cd6-14a1-4990-b156-d3b0240bf6fe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.725104 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.725084 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-config-volume\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.725139 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.725088 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-web-config\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.725949 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.725935 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7be05cd6-14a1-4990-b156-d3b0240bf6fe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.746199 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.746179 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfvl4\" (UniqueName: \"kubernetes.io/projected/7be05cd6-14a1-4990-b156-d3b0240bf6fe-kube-api-access-wfvl4\") pod \"alertmanager-main-0\" (UID: \"7be05cd6-14a1-4990-b156-d3b0240bf6fe\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:49.794166 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:49.794147 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 18:37:50.111712 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:50.111687 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 18:37:50.111834 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:37:50.111799 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be05cd6_14a1_4990_b156_d3b0240bf6fe.slice/crio-0923ecb3302ddbc877cf1be4bebbce8201c8af6023fa1b7e4e969cc9266d8cd3 WatchSource:0}: Error finding container 0923ecb3302ddbc877cf1be4bebbce8201c8af6023fa1b7e4e969cc9266d8cd3: Status 404 returned error can't find the container with id 0923ecb3302ddbc877cf1be4bebbce8201c8af6023fa1b7e4e969cc9266d8cd3 Oct 30 18:37:50.368465 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:50.368393 4494 generic.go:356] "Generic (PLEG): container finished" podID="7be05cd6-14a1-4990-b156-d3b0240bf6fe" containerID="cb3641f5fbd04fc737401e8e002ead1b486de13b98e27c76c8edb624b3424fff" exitCode=0 Oct 30 18:37:50.368556 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:50.368464 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7be05cd6-14a1-4990-b156-d3b0240bf6fe","Type":"ContainerDied","Data":"cb3641f5fbd04fc737401e8e002ead1b486de13b98e27c76c8edb624b3424fff"} Oct 30 18:37:50.368556 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:50.368511 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7be05cd6-14a1-4990-b156-d3b0240bf6fe","Type":"ContainerStarted","Data":"0923ecb3302ddbc877cf1be4bebbce8201c8af6023fa1b7e4e969cc9266d8cd3"} Oct 30 18:37:50.884903 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:50.884833 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae390216-90db-4e00-81b1-993a88e497ac" path="/var/lib/kubelet/pods/ae390216-90db-4e00-81b1-993a88e497ac/volumes" Oct 30 18:37:51.321318 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.321286 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67c7cd68d5-brrbn"] Oct 30 18:37:51.323789 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.323768 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.340802 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.340776 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Oct 30 18:37:51.340920 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.340806 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qnc6k\"" Oct 30 18:37:51.343865 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.343843 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Oct 30 18:37:51.366091 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.366067 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67c7cd68d5-brrbn"] Oct 30 18:37:51.379774 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.379747 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7be05cd6-14a1-4990-b156-d3b0240bf6fe","Type":"ContainerStarted","Data":"0cb4596c798605309d7d7054af941c0c8200e4dbcfa8ea831318c3fb51ff6792"} Oct 30 18:37:51.379875 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.379804 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7be05cd6-14a1-4990-b156-d3b0240bf6fe","Type":"ContainerStarted","Data":"438402de74596138bb50bc1b8c6c6b73e10b6b1371eab8634fb24c8d10979de8"} Oct 30 18:37:51.379875 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.379828 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7be05cd6-14a1-4990-b156-d3b0240bf6fe","Type":"ContainerStarted","Data":"8fac089cdb2af4387195256a87301e8592d8b486c1ff4567179de4731773227c"} Oct 30 18:37:51.379875 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.379851 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7be05cd6-14a1-4990-b156-d3b0240bf6fe","Type":"ContainerStarted","Data":"e8994d9f2c04414128eec4dcaffcbf8c361806430da3f334c043af26938e1d0f"} Oct 30 18:37:51.379875 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.379872 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7be05cd6-14a1-4990-b156-d3b0240bf6fe","Type":"ContainerStarted","Data":"d011d35359a0412611324d7637b48f75539f9985c851b3e3b36038632c37ba35"} Oct 30 18:37:51.379988 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.379897 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7be05cd6-14a1-4990-b156-d3b0240bf6fe","Type":"ContainerStarted","Data":"9334823f092482481635f95fa00048683729bc606caf27c639edcc7198bfb2dc"} Oct 30 18:37:51.427548 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.427528 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Oct 30 18:37:51.433645 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.433622 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-serving-certs-ca-bundle\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.433645 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.433647 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-metrics-client-ca\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.433772 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.433674 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.433772 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.433737 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.433844 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.433827 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-secret-telemeter-client\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.433890 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.433875 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlpf5\" (UniqueName: \"kubernetes.io/projected/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-kube-api-access-zlpf5\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.434018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.433987 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-federate-client-tls\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.434018 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.434022 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-telemeter-client-tls\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.442795 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.442776 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Oct 30 18:37:51.442891 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.442811 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Oct 30 18:37:51.442891 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.442843 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Oct 30 18:37:51.445394 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.445358 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.430514977 podStartE2EDuration="2.445347989s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.833012ms" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:51.444441851 +0000 UTC m=+96.673291391" watchObservedRunningTime="2026-10-30 18:37:51.445347989 +0000 UTC m=+96.674197530" Oct 30 18:37:51.535191 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.535163 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-secret-telemeter-client\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.535322 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.535263 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlpf5\" (UniqueName: \"kubernetes.io/projected/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-kube-api-access-zlpf5\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.535322 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.535295 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-federate-client-tls\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.535459 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.535324 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-telemeter-client-tls\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.535649 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.535617 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-serving-certs-ca-bundle\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.535741 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.535654 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-metrics-client-ca\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.536069 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.536043 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.536177 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.536089 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.536389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.536363 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-metrics-client-ca\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.536759 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.536739 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-serving-certs-ca-bundle\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.536855 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.536838 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.538241 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.538218 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-secret-telemeter-client\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.538241 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.538224 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-federate-client-tls\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.538397 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.538324 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-telemeter-client-tls\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.538631 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.538611 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.560946 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.560917 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlpf5\" (UniqueName: \"kubernetes.io/projected/0fdaebc6-dffe-47a8-b1b1-19140f58fb2d-kube-api-access-zlpf5\") pod \"telemeter-client-67c7cd68d5-brrbn\" (UID: \"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d\") " pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.637163 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.637101 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" Oct 30 18:37:51.956692 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:51.956661 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67c7cd68d5-brrbn"] Oct 30 18:37:51.958193 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:37:51.958171 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fdaebc6_dffe_47a8_b1b1_19140f58fb2d.slice/crio-fe90a2e775a88702eb7fd8b6c3abfcaa668a24456ad4e7893caa2e1b234ccc3f WatchSource:0}: Error finding container fe90a2e775a88702eb7fd8b6c3abfcaa668a24456ad4e7893caa2e1b234ccc3f: Status 404 returned error can't find the container with id fe90a2e775a88702eb7fd8b6c3abfcaa668a24456ad4e7893caa2e1b234ccc3f Oct 30 18:37:52.385010 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:52.384931 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" event={"ID":"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d","Type":"ContainerStarted","Data":"fe90a2e775a88702eb7fd8b6c3abfcaa668a24456ad4e7893caa2e1b234ccc3f"} Oct 30 18:37:53.732649 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:37:53.732621 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:37:54.395268 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.395238 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" event={"ID":"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d","Type":"ContainerStarted","Data":"a10667d9178983a91001ad042a6d36b33ea9a52e1dc959ff1e662ed412c9d071"} Oct 30 18:37:54.395671 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.395596 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" event={"ID":"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d","Type":"ContainerStarted","Data":"b97381d1e77409c34b63094957f8396759c97a14bde0731c16f67461bf0d44be"} Oct 30 18:37:54.395773 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.395752 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" event={"ID":"0fdaebc6-dffe-47a8-b1b1-19140f58fb2d","Type":"ContainerStarted","Data":"e8ffe009ff74cd7cc251adeff784d9bd3e967c5308b69492d7c6037311457899"} Oct 30 18:37:54.475773 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.475729 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67c7cd68d5-brrbn" podStartSLOduration=1.8486938579999999 podStartE2EDuration="3.475717806s" totalImagesPullingTime="1.627023948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:54.460799137 +0000 UTC m=+99.689648685" watchObservedRunningTime="2026-10-30 18:37:54.475717806 +0000 UTC m=+99.704567402" Oct 30 18:37:54.635564 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.635542 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c6dbf764f-tqtt9"] Oct 30 18:37:54.637765 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.637749 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.660794 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.660735 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6dbf764f-tqtt9"] Oct 30 18:37:54.765677 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.765653 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-service-ca\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.765981 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.765680 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-trusted-ca-bundle\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.765981 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.765698 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-tmp\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.765981 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.765717 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-config\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.765981 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.765797 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-oauth-config\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.765981 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.765845 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-oauth-serving-cert\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.765981 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.765877 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-serving-cert\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.765981 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.765945 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgc9j\" (UniqueName: \"kubernetes.io/projected/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-kube-api-access-rgc9j\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.866380 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.866348 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-oauth-serving-cert\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.866476 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.866394 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-serving-cert\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.866476 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.866449 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgc9j\" (UniqueName: \"kubernetes.io/projected/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-kube-api-access-rgc9j\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.866543 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.866483 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-service-ca\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.866543 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.866507 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-trusted-ca-bundle\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.866666 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.866540 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-tmp\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.866666 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.866569 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-config\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.866666 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.866597 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-oauth-config\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.866949 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.866915 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-tmp\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.867227 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.867200 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-service-ca\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.867320 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.867277 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-trusted-ca-bundle\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.867320 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.867310 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-oauth-serving-cert\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.867446 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.867309 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-config\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.868770 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.868753 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-oauth-config\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.868956 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.868940 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-serving-cert\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.884590 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.884561 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:54.891090 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.891072 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgc9j\" (UniqueName: \"kubernetes.io/projected/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-kube-api-access-rgc9j\") pod \"console-7c6dbf764f-tqtt9\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:54.947571 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:54.947550 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:37:55.078500 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:55.078472 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:55.240338 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:55.240311 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6dbf764f-tqtt9"] Oct 30 18:37:55.240707 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:37:55.240685 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03b627a_2f29_44e7_b3e1_b6c29ebd8fca.slice/crio-3486aef9e3391a29d7be9799bd5de2a9da8373a49bba3ba7aa57a5af01239541 WatchSource:0}: Error finding container 3486aef9e3391a29d7be9799bd5de2a9da8373a49bba3ba7aa57a5af01239541: Status 404 returned error can't find the container with id 3486aef9e3391a29d7be9799bd5de2a9da8373a49bba3ba7aa57a5af01239541 Oct 30 18:37:55.247207 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:55.247180 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:37:55.402473 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:55.402435 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6dbf764f-tqtt9" event={"ID":"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca","Type":"ContainerStarted","Data":"4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4"} Oct 30 18:37:55.402671 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:55.402488 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6dbf764f-tqtt9" event={"ID":"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca","Type":"ContainerStarted","Data":"3486aef9e3391a29d7be9799bd5de2a9da8373a49bba3ba7aa57a5af01239541"} Oct 30 18:37:55.450912 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:37:55.450847 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7c6dbf764f-tqtt9" podStartSLOduration=1.450826865 podStartE2EDuration="1.450826865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:37:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:37:55.450044347 +0000 UTC m=+100.678893914" watchObservedRunningTime="2026-10-30 18:37:55.450826865 +0000 UTC m=+100.679676410" Oct 30 18:38:00.897531 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:00.897501 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:38:04.947740 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:04.947694 4494 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:38:04.948167 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:04.947763 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:38:04.952452 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:04.952425 4494 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:38:05.459011 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:05.458979 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:38:05.535758 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:05.535718 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d7ff84498-55hl2"] Oct 30 18:38:16.454344 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:16.454307 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:38:17.460789 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:17.460749 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:38:23.731250 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:38:23.731215 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:38:30.555213 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.555098 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-d7ff84498-55hl2" podUID="426fb135-e9c9-4953-a97c-6d3c7176d40c" containerName="console" containerID="cri-o://0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f" gracePeriod=15 Oct 30 18:38:30.797122 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.797095 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:38:30.865695 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.865612 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/426fb135-e9c9-4953-a97c-6d3c7176d40c-kube-api-access-86m97\" (UniqueName: \"kubernetes.io/projected/426fb135-e9c9-4953-a97c-6d3c7176d40c-kube-api-access-86m97\") pod \"426fb135-e9c9-4953-a97c-6d3c7176d40c\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " Oct 30 18:38:30.865695 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.865669 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-serving-cert\") pod \"426fb135-e9c9-4953-a97c-6d3c7176d40c\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " Oct 30 18:38:30.865917 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.865704 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-oauth-config\") pod \"426fb135-e9c9-4953-a97c-6d3c7176d40c\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " Oct 30 18:38:30.865917 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.865728 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/426fb135-e9c9-4953-a97c-6d3c7176d40c-tmp\" (UniqueName: \"kubernetes.io/empty-dir/426fb135-e9c9-4953-a97c-6d3c7176d40c-tmp\") pod \"426fb135-e9c9-4953-a97c-6d3c7176d40c\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " Oct 30 18:38:30.865917 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.865752 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-service-ca\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-service-ca\") pod \"426fb135-e9c9-4953-a97c-6d3c7176d40c\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " Oct 30 18:38:30.865917 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.865779 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-config\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-config\") pod \"426fb135-e9c9-4953-a97c-6d3c7176d40c\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " Oct 30 18:38:30.866125 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.865913 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-trusted-ca-bundle\") pod \"426fb135-e9c9-4953-a97c-6d3c7176d40c\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " Oct 30 18:38:30.866125 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.865979 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-oauth-serving-cert\") pod \"426fb135-e9c9-4953-a97c-6d3c7176d40c\" (UID: \"426fb135-e9c9-4953-a97c-6d3c7176d40c\") " Oct 30 18:38:30.866125 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.866056 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/426fb135-e9c9-4953-a97c-6d3c7176d40c-tmp" pod "426fb135-e9c9-4953-a97c-6d3c7176d40c" (UID: "426fb135-e9c9-4953-a97c-6d3c7176d40c"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:38:30.866278 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.866173 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-config" pod "426fb135-e9c9-4953-a97c-6d3c7176d40c" (UID: "426fb135-e9c9-4953-a97c-6d3c7176d40c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:38:30.866278 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.866170 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-service-ca" pod "426fb135-e9c9-4953-a97c-6d3c7176d40c" (UID: "426fb135-e9c9-4953-a97c-6d3c7176d40c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:38:30.866429 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.866388 4494 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/426fb135-e9c9-4953-a97c-6d3c7176d40c-tmp\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:38:30.866519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.866432 4494 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:38:30.866519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.866432 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-trusted-ca-bundle" pod "426fb135-e9c9-4953-a97c-6d3c7176d40c" (UID: "426fb135-e9c9-4953-a97c-6d3c7176d40c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:38:30.866519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.866448 4494 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:38:30.866757 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.866731 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-oauth-serving-cert" pod "426fb135-e9c9-4953-a97c-6d3c7176d40c" (UID: "426fb135-e9c9-4953-a97c-6d3c7176d40c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:38:30.868067 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.868048 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-serving-cert" pod "426fb135-e9c9-4953-a97c-6d3c7176d40c" (UID: "426fb135-e9c9-4953-a97c-6d3c7176d40c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:38:30.868145 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.868072 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-oauth-config" pod "426fb135-e9c9-4953-a97c-6d3c7176d40c" (UID: "426fb135-e9c9-4953-a97c-6d3c7176d40c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:38:30.868145 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.868078 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/426fb135-e9c9-4953-a97c-6d3c7176d40c-kube-api-access-86m97" pod "426fb135-e9c9-4953-a97c-6d3c7176d40c" (UID: "426fb135-e9c9-4953-a97c-6d3c7176d40c"). InnerVolumeSpecName "kube-api-access-86m97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:38:30.967465 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.967429 4494 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:38:30.967465 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.967459 4494 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/426fb135-e9c9-4953-a97c-6d3c7176d40c-console-oauth-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:38:30.967465 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.967470 4494 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-trusted-ca-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:38:30.967701 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.967479 4494 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/426fb135-e9c9-4953-a97c-6d3c7176d40c-oauth-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:38:30.967701 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:30.967489 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86m97\" (UniqueName: \"kubernetes.io/projected/426fb135-e9c9-4953-a97c-6d3c7176d40c-kube-api-access-86m97\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:38:31.547801 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:31.547770 4494 generic.go:356] "Generic (PLEG): container finished" podID="426fb135-e9c9-4953-a97c-6d3c7176d40c" containerID="0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f" exitCode=0 Oct 30 18:38:31.547979 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:31.547809 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7ff84498-55hl2" event={"ID":"426fb135-e9c9-4953-a97c-6d3c7176d40c","Type":"ContainerDied","Data":"0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f"} Oct 30 18:38:31.547979 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:31.547818 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7ff84498-55hl2" Oct 30 18:38:31.547979 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:31.547847 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7ff84498-55hl2" event={"ID":"426fb135-e9c9-4953-a97c-6d3c7176d40c","Type":"ContainerDied","Data":"f76d2bb4497170026e8bb5cca0db0d4aa109f291a8d37068fa948da026ee90a6"} Oct 30 18:38:31.547979 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:31.547865 4494 scope.go:122] "RemoveContainer" containerID="0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f" Oct 30 18:38:31.556035 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:31.555840 4494 scope.go:122] "RemoveContainer" containerID="0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f" Oct 30 18:38:31.556278 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:38:31.556118 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f\": container with ID starting with 0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f not found: ID does not exist" containerID="0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f" Oct 30 18:38:31.556278 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:31.556149 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f"} err="failed to get container status \"0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f\": rpc error: code = NotFound desc = could not find container \"0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f\": container with ID starting with 0f45ee91958b6b0a4f04a3f7ecfff51e1080cf01be02cd98f198a3148335920f not found: ID does not exist" Oct 30 18:38:31.607226 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:31.607195 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d7ff84498-55hl2"] Oct 30 18:38:31.621566 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:31.621531 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d7ff84498-55hl2"] Oct 30 18:38:32.885211 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:32.885179 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="426fb135-e9c9-4953-a97c-6d3c7176d40c" path="/var/lib/kubelet/pods/426fb135-e9c9-4953-a97c-6d3c7176d40c/volumes" Oct 30 18:38:35.819194 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:35.819157 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:38:48.206840 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:38:48.206785 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:38:53.733369 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:38:53.733325 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:39:01.020282 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:01.020250 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:39:01.921706 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:01.921665 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:39:05.158833 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.158797 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bc87676c5-q2l2m"] Oct 30 18:39:05.159225 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.159135 4494 cpu_manager.go:414] "containerMap: removing container" podUID="426fb135-e9c9-4953-a97c-6d3c7176d40c" containerName="console" Oct 30 18:39:05.159225 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.159148 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="426fb135-e9c9-4953-a97c-6d3c7176d40c" containerName="console" Oct 30 18:39:05.159225 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.159218 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="426fb135-e9c9-4953-a97c-6d3c7176d40c" containerName="console" Oct 30 18:39:05.161822 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.161801 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.196838 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.196810 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc87676c5-q2l2m"] Oct 30 18:39:05.235619 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.235587 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae0451d1-d226-4a1c-8f0b-1409eef76a09-service-ca\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.235764 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.235662 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm2lm\" (UniqueName: \"kubernetes.io/projected/ae0451d1-d226-4a1c-8f0b-1409eef76a09-kube-api-access-tm2lm\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.235764 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.235719 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae0451d1-d226-4a1c-8f0b-1409eef76a09-console-oauth-config\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.235764 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.235740 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae0451d1-d226-4a1c-8f0b-1409eef76a09-oauth-serving-cert\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.235764 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.235756 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae0451d1-d226-4a1c-8f0b-1409eef76a09-tmp\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.235925 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.235821 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae0451d1-d226-4a1c-8f0b-1409eef76a09-console-config\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.235925 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.235854 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0451d1-d226-4a1c-8f0b-1409eef76a09-trusted-ca-bundle\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.235925 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.235910 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae0451d1-d226-4a1c-8f0b-1409eef76a09-console-serving-cert\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.336959 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.336924 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae0451d1-d226-4a1c-8f0b-1409eef76a09-service-ca\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.336959 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.336961 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm2lm\" (UniqueName: \"kubernetes.io/projected/ae0451d1-d226-4a1c-8f0b-1409eef76a09-kube-api-access-tm2lm\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.337187 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.336981 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae0451d1-d226-4a1c-8f0b-1409eef76a09-console-oauth-config\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.337187 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.337102 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae0451d1-d226-4a1c-8f0b-1409eef76a09-oauth-serving-cert\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.337187 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.337134 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae0451d1-d226-4a1c-8f0b-1409eef76a09-tmp\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.337187 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.337177 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae0451d1-d226-4a1c-8f0b-1409eef76a09-console-config\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.337389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.337206 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0451d1-d226-4a1c-8f0b-1409eef76a09-trusted-ca-bundle\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.337389 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.337260 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae0451d1-d226-4a1c-8f0b-1409eef76a09-console-serving-cert\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.337659 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.337634 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae0451d1-d226-4a1c-8f0b-1409eef76a09-tmp\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.337880 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.337854 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae0451d1-d226-4a1c-8f0b-1409eef76a09-service-ca\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.337966 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.337863 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae0451d1-d226-4a1c-8f0b-1409eef76a09-oauth-serving-cert\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.337966 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.337909 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae0451d1-d226-4a1c-8f0b-1409eef76a09-console-config\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.338077 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.338044 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0451d1-d226-4a1c-8f0b-1409eef76a09-trusted-ca-bundle\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.339537 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.339512 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae0451d1-d226-4a1c-8f0b-1409eef76a09-console-serving-cert\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.339537 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.339531 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae0451d1-d226-4a1c-8f0b-1409eef76a09-console-oauth-config\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.363144 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.363117 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm2lm\" (UniqueName: \"kubernetes.io/projected/ae0451d1-d226-4a1c-8f0b-1409eef76a09-kube-api-access-tm2lm\") pod \"console-6bc87676c5-q2l2m\" (UID: \"ae0451d1-d226-4a1c-8f0b-1409eef76a09\") " pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.373254 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.373218 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:39:05.473039 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.473007 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:05.660648 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.660608 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:39:05.766711 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.766683 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc87676c5-q2l2m"] Oct 30 18:39:05.767858 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:39:05.767831 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0451d1_d226_4a1c_8f0b_1409eef76a09.slice/crio-a11883a6cd87a11aa8a6e711678092cc6077ae16a6cc02740dfa22c14f11bfdd WatchSource:0}: Error finding container a11883a6cd87a11aa8a6e711678092cc6077ae16a6cc02740dfa22c14f11bfdd: Status 404 returned error can't find the container with id a11883a6cd87a11aa8a6e711678092cc6077ae16a6cc02740dfa22c14f11bfdd Oct 30 18:39:05.835116 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:05.835088 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:39:06.672741 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:06.672705 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc87676c5-q2l2m" event={"ID":"ae0451d1-d226-4a1c-8f0b-1409eef76a09","Type":"ContainerStarted","Data":"87b59b8aeeaa35fe31086acdb23ab1cbda5d3d6a118d7da063abf2a1f0256bef"} Oct 30 18:39:06.673117 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:06.672755 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc87676c5-q2l2m" event={"ID":"ae0451d1-d226-4a1c-8f0b-1409eef76a09","Type":"ContainerStarted","Data":"a11883a6cd87a11aa8a6e711678092cc6077ae16a6cc02740dfa22c14f11bfdd"} Oct 30 18:39:06.718886 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:06.718837 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6bc87676c5-q2l2m" podStartSLOduration=1.718826355 podStartE2EDuration="1.718826355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:39:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:39:06.718617741 +0000 UTC m=+171.947467287" watchObservedRunningTime="2026-10-30 18:39:06.718826355 +0000 UTC m=+171.947675901" Oct 30 18:39:14.601065 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:14.601029 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:39:14.781298 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:14.781267 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:39:15.473965 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:15.473927 4494 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:15.474181 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:15.473980 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:15.478620 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:15.478597 4494 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:15.706239 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:15.706211 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bc87676c5-q2l2m" Oct 30 18:39:15.783633 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:15.783543 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6dbf764f-tqtt9"] Oct 30 18:39:17.209967 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:17.209930 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:39:17.384545 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:17.384509 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:39:23.732541 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:39:23.732501 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:39:38.677140 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:38.677098 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:39:39.661832 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:39.661797 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:39:40.803582 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:40.803544 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-7c6dbf764f-tqtt9" podUID="b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" containerName="console" containerID="cri-o://4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4" gracePeriod=15 Oct 30 18:39:41.039390 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.039358 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:39:41.129112 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129020 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-serving-cert\") pod \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " Oct 30 18:39:41.129112 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129079 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-oauth-config\") pod \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " Oct 30 18:39:41.129112 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129106 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-service-ca\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-service-ca\") pod \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " Oct 30 18:39:41.129364 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129135 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-trusted-ca-bundle\") pod \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " Oct 30 18:39:41.129364 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129152 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-config\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-config\") pod \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " Oct 30 18:39:41.129364 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129217 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-tmp\") pod \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " Oct 30 18:39:41.129364 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129252 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-kube-api-access-rgc9j\" (UniqueName: \"kubernetes.io/projected/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-kube-api-access-rgc9j\") pod \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " Oct 30 18:39:41.129364 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129294 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-oauth-serving-cert\") pod \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\" (UID: \"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca\") " Oct 30 18:39:41.129651 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129592 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-tmp" pod "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" (UID: "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:39:41.129651 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129617 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-config" pod "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" (UID: "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:41.129651 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129625 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-service-ca" pod "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" (UID: "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:41.129788 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129642 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-trusted-ca-bundle" pod "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" (UID: "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:41.129867 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.129849 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-oauth-serving-cert" pod "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" (UID: "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:39:41.131254 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.131232 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-serving-cert" pod "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" (UID: "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:41.131590 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.131562 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-oauth-config" pod "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" (UID: "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:39:41.131691 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.131604 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-kube-api-access-rgc9j" pod "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" (UID: "b03b627a-2f29-44e7-b3e1-b6c29ebd8fca"). InnerVolumeSpecName "kube-api-access-rgc9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:39:41.230204 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.230161 4494 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:39:41.230204 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.230198 4494 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-oauth-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:39:41.230204 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.230211 4494 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:39:41.230491 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.230225 4494 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-trusted-ca-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:39:41.230491 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.230236 4494 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-console-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:39:41.230491 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.230248 4494 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-tmp\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:39:41.230491 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.230260 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgc9j\" (UniqueName: \"kubernetes.io/projected/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-kube-api-access-rgc9j\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:39:41.230491 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.230271 4494 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca-oauth-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:39:41.798667 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.798629 4494 generic.go:356] "Generic (PLEG): container finished" podID="b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" containerID="4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4" exitCode=0 Oct 30 18:39:41.798839 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.798686 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6dbf764f-tqtt9" Oct 30 18:39:41.798839 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.798700 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6dbf764f-tqtt9" event={"ID":"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca","Type":"ContainerDied","Data":"4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4"} Oct 30 18:39:41.798839 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.798748 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6dbf764f-tqtt9" event={"ID":"b03b627a-2f29-44e7-b3e1-b6c29ebd8fca","Type":"ContainerDied","Data":"3486aef9e3391a29d7be9799bd5de2a9da8373a49bba3ba7aa57a5af01239541"} Oct 30 18:39:41.798839 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.798774 4494 scope.go:122] "RemoveContainer" containerID="4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4" Oct 30 18:39:41.807058 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.806954 4494 scope.go:122] "RemoveContainer" containerID="4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4" Oct 30 18:39:41.807269 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:39:41.807245 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4\": container with ID starting with 4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4 not found: ID does not exist" containerID="4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4" Oct 30 18:39:41.807305 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.807271 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4"} err="failed to get container status \"4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4\": rpc error: code = NotFound desc = could not find container \"4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4\": container with ID starting with 4c6613c6c1d43b49ee7739f9a184c9fce7f50d77555aae36ef76a070a1dddab4 not found: ID does not exist" Oct 30 18:39:41.855594 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.855556 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6dbf764f-tqtt9"] Oct 30 18:39:41.870497 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:41.870462 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c6dbf764f-tqtt9"] Oct 30 18:39:42.052310 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:42.052230 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:39:42.884591 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:39:42.884558 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" path="/var/lib/kubelet/pods/b03b627a-2f29-44e7-b3e1-b6c29ebd8fca/volumes" Oct 30 18:39:53.733014 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:39:53.732981 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:40:01.127813 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:40:01.127734 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:40:23.733150 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:40:23.733110 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:40:26.721657 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:40:26.721609 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:40:26.897475 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:40:26.897438 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:40:31.650347 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:40:31.650293 4494 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" podUID="0a1141f188cb159776b4a1af048cbc31" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded" Oct 30 18:40:53.122109 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:40:53.122070 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:40:53.733702 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:40:53.733652 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:40:55.169971 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:40:55.169932 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:41:01.246823 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:41:01.246784 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:41:14.882624 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:41:14.882594 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 18:41:14.883105 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:41:14.883086 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 18:41:14.893499 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:41:14.893482 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:41:14.893993 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:41:14.893973 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:41:23.732015 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:41:23.731975 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:41:53.731990 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:41:53.731907 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:41:57.995803 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:41:57.995761 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:41:58.178372 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:41:58.178340 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:42:01.391926 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:01.391891 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:42:23.733673 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:42:23.733626 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:42:27.125050 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:27.125017 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:42:27.305489 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:27.305456 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:42:27.491534 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:27.491507 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:42:38.288774 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.288739 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6"] Oct 30 18:42:38.289190 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.289045 4494 cpu_manager.go:414] "containerMap: removing container" podUID="b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" containerName="console" Oct 30 18:42:38.289190 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.289055 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" containerName="console" Oct 30 18:42:38.289190 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.289114 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="b03b627a-2f29-44e7-b3e1-b6c29ebd8fca" containerName="console" Oct 30 18:42:38.292131 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.292113 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:38.312114 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.312080 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"98a21a31f7a8ae0212b9c22cc643f9202bfa37-6b211c7f-dockercfg-mnjlp\"" Oct 30 18:42:38.312342 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.312308 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 30 18:42:38.312496 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.312372 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 30 18:42:38.337792 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.333472 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6"] Oct 30 18:42:38.397811 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.397760 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6\" (UID: \"b706d1bf-9f5c-43b1-b460-bade99293d38\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:38.397811 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.397823 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6\" (UID: \"b706d1bf-9f5c-43b1-b460-bade99293d38\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:38.398041 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.397910 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh6g4\" (UniqueName: \"kubernetes.io/projected/b706d1bf-9f5c-43b1-b460-bade99293d38-kube-api-access-mh6g4\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6\" (UID: \"b706d1bf-9f5c-43b1-b460-bade99293d38\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:38.498321 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.498282 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6\" (UID: \"b706d1bf-9f5c-43b1-b460-bade99293d38\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:38.498536 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.498329 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh6g4\" (UniqueName: \"kubernetes.io/projected/b706d1bf-9f5c-43b1-b460-bade99293d38-kube-api-access-mh6g4\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6\" (UID: \"b706d1bf-9f5c-43b1-b460-bade99293d38\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:38.498536 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.498388 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6\" (UID: \"b706d1bf-9f5c-43b1-b460-bade99293d38\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:38.498782 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.498763 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-util\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6\" (UID: \"b706d1bf-9f5c-43b1-b460-bade99293d38\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:38.498846 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.498770 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-bundle\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6\" (UID: \"b706d1bf-9f5c-43b1-b460-bade99293d38\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:38.524794 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.524758 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh6g4\" (UniqueName: \"kubernetes.io/projected/b706d1bf-9f5c-43b1-b460-bade99293d38-kube-api-access-mh6g4\") pod \"98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6\" (UID: \"b706d1bf-9f5c-43b1-b460-bade99293d38\") " pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:38.607997 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.607915 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:38.900740 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.900714 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6"] Oct 30 18:42:38.901497 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:42:38.901465 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb706d1bf_9f5c_43b1_b460_bade99293d38.slice/crio-a1b5cdfe709a85f91582c4f0518b5dde2c649e37b6f28a3516b0ae50a475f32c WatchSource:0}: Error finding container a1b5cdfe709a85f91582c4f0518b5dde2c649e37b6f28a3516b0ae50a475f32c: Status 404 returned error can't find the container with id a1b5cdfe709a85f91582c4f0518b5dde2c649e37b6f28a3516b0ae50a475f32c Oct 30 18:42:38.903505 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:38.903489 4494 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 18:42:39.412796 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:39.412750 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" event={"ID":"b706d1bf-9f5c-43b1-b460-bade99293d38","Type":"ContainerStarted","Data":"a1b5cdfe709a85f91582c4f0518b5dde2c649e37b6f28a3516b0ae50a475f32c"} Oct 30 18:42:45.437279 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:45.437245 4494 generic.go:356] "Generic (PLEG): container finished" podID="b706d1bf-9f5c-43b1-b460-bade99293d38" containerID="eeea2ec8f816cbee3d4cecfc7c7fd91b37eec963a43ee96019327101aa02958b" exitCode=0 Oct 30 18:42:45.437703 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:45.437333 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" event={"ID":"b706d1bf-9f5c-43b1-b460-bade99293d38","Type":"ContainerDied","Data":"eeea2ec8f816cbee3d4cecfc7c7fd91b37eec963a43ee96019327101aa02958b"} Oct 30 18:42:47.446398 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:47.446311 4494 generic.go:356] "Generic (PLEG): container finished" podID="b706d1bf-9f5c-43b1-b460-bade99293d38" containerID="05aa881950b6904d76b0ddf0425421c796306d137b113682e6e1faf45eaa2da4" exitCode=0 Oct 30 18:42:47.446890 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:47.446398 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" event={"ID":"b706d1bf-9f5c-43b1-b460-bade99293d38","Type":"ContainerDied","Data":"05aa881950b6904d76b0ddf0425421c796306d137b113682e6e1faf45eaa2da4"} Oct 30 18:42:53.473303 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:53.473266 4494 generic.go:356] "Generic (PLEG): container finished" podID="b706d1bf-9f5c-43b1-b460-bade99293d38" containerID="267f6a4de812e8bb5e74449388cde26bed0e5aef10cd6b667cbfd66bc60443a1" exitCode=0 Oct 30 18:42:53.473686 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:53.473353 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" event={"ID":"b706d1bf-9f5c-43b1-b460-bade99293d38","Type":"ContainerDied","Data":"267f6a4de812e8bb5e74449388cde26bed0e5aef10cd6b667cbfd66bc60443a1"} Oct 30 18:42:53.732759 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:42:53.732725 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:42:54.597115 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:54.597086 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:54.737741 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:54.737648 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b706d1bf-9f5c-43b1-b460-bade99293d38-kube-api-access-mh6g4\" (UniqueName: \"kubernetes.io/projected/b706d1bf-9f5c-43b1-b460-bade99293d38-kube-api-access-mh6g4\") pod \"b706d1bf-9f5c-43b1-b460-bade99293d38\" (UID: \"b706d1bf-9f5c-43b1-b460-bade99293d38\") " Oct 30 18:42:54.737741 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:54.737713 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-util\" (UniqueName: \"kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-util\") pod \"b706d1bf-9f5c-43b1-b460-bade99293d38\" (UID: \"b706d1bf-9f5c-43b1-b460-bade99293d38\") " Oct 30 18:42:54.737986 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:54.737758 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-bundle\" (UniqueName: \"kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-bundle\") pod \"b706d1bf-9f5c-43b1-b460-bade99293d38\" (UID: \"b706d1bf-9f5c-43b1-b460-bade99293d38\") " Oct 30 18:42:54.738521 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:54.738494 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-bundle" pod "b706d1bf-9f5c-43b1-b460-bade99293d38" (UID: "b706d1bf-9f5c-43b1-b460-bade99293d38"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:42:54.739907 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:54.739875 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b706d1bf-9f5c-43b1-b460-bade99293d38-kube-api-access-mh6g4" pod "b706d1bf-9f5c-43b1-b460-bade99293d38" (UID: "b706d1bf-9f5c-43b1-b460-bade99293d38"). InnerVolumeSpecName "kube-api-access-mh6g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:42:54.742779 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:54.742757 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-util" pod "b706d1bf-9f5c-43b1-b460-bade99293d38" (UID: "b706d1bf-9f5c-43b1-b460-bade99293d38"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:42:54.838787 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:54.838747 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh6g4\" (UniqueName: \"kubernetes.io/projected/b706d1bf-9f5c-43b1-b460-bade99293d38-kube-api-access-mh6g4\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:42:54.838787 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:54.838779 4494 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-util\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:42:54.838787 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:54.838792 4494 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b706d1bf-9f5c-43b1-b460-bade99293d38-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:42:55.482848 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:55.482819 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" Oct 30 18:42:55.483020 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:55.482820 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98a21a31f7a8ae0212b9c22cc643f9202bfa37cdda9b658bc303ea820cqxvr6" event={"ID":"b706d1bf-9f5c-43b1-b460-bade99293d38","Type":"ContainerDied","Data":"a1b5cdfe709a85f91582c4f0518b5dde2c649e37b6f28a3516b0ae50a475f32c"} Oct 30 18:42:55.483020 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:42:55.482937 4494 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1b5cdfe709a85f91582c4f0518b5dde2c649e37b6f28a3516b0ae50a475f32c" Oct 30 18:43:00.127706 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:00.127596 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:01.694779 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.694743 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb"] Oct 30 18:43:01.695180 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.695045 4494 cpu_manager.go:414] "containerMap: removing container" podUID="b706d1bf-9f5c-43b1-b460-bade99293d38" containerName="pull" Oct 30 18:43:01.695180 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.695055 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b706d1bf-9f5c-43b1-b460-bade99293d38" containerName="pull" Oct 30 18:43:01.695180 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.695070 4494 cpu_manager.go:414] "containerMap: removing container" podUID="b706d1bf-9f5c-43b1-b460-bade99293d38" containerName="util" Oct 30 18:43:01.695180 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.695076 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b706d1bf-9f5c-43b1-b460-bade99293d38" containerName="util" Oct 30 18:43:01.695180 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.695090 4494 cpu_manager.go:414] "containerMap: removing container" podUID="b706d1bf-9f5c-43b1-b460-bade99293d38" containerName="extract" Oct 30 18:43:01.695180 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.695095 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b706d1bf-9f5c-43b1-b460-bade99293d38" containerName="extract" Oct 30 18:43:01.695180 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.695143 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="b706d1bf-9f5c-43b1-b460-bade99293d38" containerName="extract" Oct 30 18:43:01.706972 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.706946 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" Oct 30 18:43:01.727069 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.727031 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Oct 30 18:43:01.727423 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.727389 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Oct 30 18:43:01.740383 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.740350 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Oct 30 18:43:01.740822 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.740805 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-czbjx\"" Oct 30 18:43:01.742067 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.742052 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb"] Oct 30 18:43:01.797118 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.797075 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bg6q\" (UniqueName: \"kubernetes.io/projected/9f8f227a-3202-47ff-b2fb-2bdab42fa0e1-kube-api-access-7bg6q\") pod \"custom-metrics-autoscaler-operator-c667576c8-x2kvb\" (UID: \"9f8f227a-3202-47ff-b2fb-2bdab42fa0e1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" Oct 30 18:43:01.797295 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.797217 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9f8f227a-3202-47ff-b2fb-2bdab42fa0e1-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-x2kvb\" (UID: \"9f8f227a-3202-47ff-b2fb-2bdab42fa0e1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" Oct 30 18:43:01.897801 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.897760 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9f8f227a-3202-47ff-b2fb-2bdab42fa0e1-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-x2kvb\" (UID: \"9f8f227a-3202-47ff-b2fb-2bdab42fa0e1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" Oct 30 18:43:01.897949 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.897827 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bg6q\" (UniqueName: \"kubernetes.io/projected/9f8f227a-3202-47ff-b2fb-2bdab42fa0e1-kube-api-access-7bg6q\") pod \"custom-metrics-autoscaler-operator-c667576c8-x2kvb\" (UID: \"9f8f227a-3202-47ff-b2fb-2bdab42fa0e1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" Oct 30 18:43:01.900144 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.900115 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9f8f227a-3202-47ff-b2fb-2bdab42fa0e1-certificates\") pod \"custom-metrics-autoscaler-operator-c667576c8-x2kvb\" (UID: \"9f8f227a-3202-47ff-b2fb-2bdab42fa0e1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" Oct 30 18:43:01.924761 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:01.924729 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bg6q\" (UniqueName: \"kubernetes.io/projected/9f8f227a-3202-47ff-b2fb-2bdab42fa0e1-kube-api-access-7bg6q\") pod \"custom-metrics-autoscaler-operator-c667576c8-x2kvb\" (UID: \"9f8f227a-3202-47ff-b2fb-2bdab42fa0e1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" Oct 30 18:43:02.033772 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:02.033680 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" Oct 30 18:43:02.380887 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:02.380858 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb"] Oct 30 18:43:02.381047 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:43:02.381025 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8f227a_3202_47ff_b2fb_2bdab42fa0e1.slice/crio-2251a2a28607bada227bdeb9d9b9ba8381e8912685998d545266f5a02b97a58d WatchSource:0}: Error finding container 2251a2a28607bada227bdeb9d9b9ba8381e8912685998d545266f5a02b97a58d: Status 404 returned error can't find the container with id 2251a2a28607bada227bdeb9d9b9ba8381e8912685998d545266f5a02b97a58d Oct 30 18:43:02.508475 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:02.508435 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" event={"ID":"9f8f227a-3202-47ff-b2fb-2bdab42fa0e1","Type":"ContainerStarted","Data":"2251a2a28607bada227bdeb9d9b9ba8381e8912685998d545266f5a02b97a58d"} Oct 30 18:43:02.799849 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:02.799813 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:06.527277 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:06.527238 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" event={"ID":"9f8f227a-3202-47ff-b2fb-2bdab42fa0e1","Type":"ContainerStarted","Data":"5894b2b3d369bed63e94d12a1a6ced944476567628b58abb05a655d8174cbe52"} Oct 30 18:43:06.527710 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:06.527437 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" Oct 30 18:43:06.604824 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:06.604755 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" podStartSLOduration=2.216017462 podStartE2EDuration="5.604734905s" totalImagesPullingTime="3.388717443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:43:06.589840919 +0000 UTC m=+411.818690467" watchObservedRunningTime="2026-10-30 18:43:06.604734905 +0000 UTC m=+411.833584453" Oct 30 18:43:16.442099 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:16.442049 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:17.092702 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.092659 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-7dc85965f-jf4rh"] Oct 30 18:43:17.095158 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.095134 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:17.115296 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.115266 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Oct 30 18:43:17.129698 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.129668 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Oct 30 18:43:17.129872 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.129760 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-t58fm\"" Oct 30 18:43:17.131388 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.131362 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-jf4rh"] Oct 30 18:43:17.202470 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.202430 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:17.219006 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.218976 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/f8b96a3a-5a80-491a-b04c-810cccd9afb0-cabundle0\") pod \"keda-operator-7dc85965f-jf4rh\" (UID: \"f8b96a3a-5a80-491a-b04c-810cccd9afb0\") " pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:17.219131 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.219019 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f8b96a3a-5a80-491a-b04c-810cccd9afb0-certificates\") pod \"keda-operator-7dc85965f-jf4rh\" (UID: \"f8b96a3a-5a80-491a-b04c-810cccd9afb0\") " pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:17.219185 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.219119 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsfzn\" (UniqueName: \"kubernetes.io/projected/f8b96a3a-5a80-491a-b04c-810cccd9afb0-kube-api-access-fsfzn\") pod \"keda-operator-7dc85965f-jf4rh\" (UID: \"f8b96a3a-5a80-491a-b04c-810cccd9afb0\") " pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:17.320246 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.320207 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/f8b96a3a-5a80-491a-b04c-810cccd9afb0-cabundle0\") pod \"keda-operator-7dc85965f-jf4rh\" (UID: \"f8b96a3a-5a80-491a-b04c-810cccd9afb0\") " pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:17.320427 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.320256 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f8b96a3a-5a80-491a-b04c-810cccd9afb0-certificates\") pod \"keda-operator-7dc85965f-jf4rh\" (UID: \"f8b96a3a-5a80-491a-b04c-810cccd9afb0\") " pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:17.320427 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.320288 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsfzn\" (UniqueName: \"kubernetes.io/projected/f8b96a3a-5a80-491a-b04c-810cccd9afb0-kube-api-access-fsfzn\") pod \"keda-operator-7dc85965f-jf4rh\" (UID: \"f8b96a3a-5a80-491a-b04c-810cccd9afb0\") " pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:17.320505 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:43:17.320449 4494 secret.go:281] references non-existent secret key: ca.crt Oct 30 18:43:17.320505 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:43:17.320468 4494 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Oct 30 18:43:17.320505 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:43:17.320478 4494 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-7dc85965f-jf4rh: references non-existent secret key: ca.crt Oct 30 18:43:17.320616 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:43:17.320546 4494 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8b96a3a-5a80-491a-b04c-810cccd9afb0-certificates podName:f8b96a3a-5a80-491a-b04c-810cccd9afb0 nodeName:}" failed. No retries permitted until 2026-10-30 18:43:17.820525982 +0000 UTC m=+423.049375520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/f8b96a3a-5a80-491a-b04c-810cccd9afb0-certificates") pod "keda-operator-7dc85965f-jf4rh" (UID: "f8b96a3a-5a80-491a-b04c-810cccd9afb0") : references non-existent secret key: ca.crt Oct 30 18:43:17.320999 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.320977 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/f8b96a3a-5a80-491a-b04c-810cccd9afb0-cabundle0\") pod \"keda-operator-7dc85965f-jf4rh\" (UID: \"f8b96a3a-5a80-491a-b04c-810cccd9afb0\") " pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:17.346090 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.346021 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsfzn\" (UniqueName: \"kubernetes.io/projected/f8b96a3a-5a80-491a-b04c-810cccd9afb0-kube-api-access-fsfzn\") pod \"keda-operator-7dc85965f-jf4rh\" (UID: \"f8b96a3a-5a80-491a-b04c-810cccd9afb0\") " pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:17.383481 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.383447 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:17.824201 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.824164 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f8b96a3a-5a80-491a-b04c-810cccd9afb0-certificates\") pod \"keda-operator-7dc85965f-jf4rh\" (UID: \"f8b96a3a-5a80-491a-b04c-810cccd9afb0\") " pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:17.826623 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.826603 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f8b96a3a-5a80-491a-b04c-810cccd9afb0-certificates\") pod \"keda-operator-7dc85965f-jf4rh\" (UID: \"f8b96a3a-5a80-491a-b04c-810cccd9afb0\") " pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:17.973653 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:17.973586 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:18.007148 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:18.007113 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:18.150222 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:18.150122 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:18.301695 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:43:18.301664 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b96a3a_5a80_491a_b04c_810cccd9afb0.slice/crio-53eaf30d8931941945f158a9a8917dd8498732ede81be64b82e853b16e998e34 WatchSource:0}: Error finding container 53eaf30d8931941945f158a9a8917dd8498732ede81be64b82e853b16e998e34: Status 404 returned error can't find the container with id 53eaf30d8931941945f158a9a8917dd8498732ede81be64b82e853b16e998e34 Oct 30 18:43:18.301800 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:18.301749 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-7dc85965f-jf4rh"] Oct 30 18:43:18.326372 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:18.326335 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:18.562344 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:18.562309 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:18.574459 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:18.574429 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-jf4rh" event={"ID":"f8b96a3a-5a80-491a-b04c-810cccd9afb0","Type":"ContainerStarted","Data":"53eaf30d8931941945f158a9a8917dd8498732ede81be64b82e853b16e998e34"} Oct 30 18:43:19.159970 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:19.159902 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:19.511336 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:19.511301 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:19.694989 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:19.694934 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:19.884427 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:19.884314 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:21.593054 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:21.592963 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-7dc85965f-jf4rh" event={"ID":"f8b96a3a-5a80-491a-b04c-810cccd9afb0","Type":"ContainerStarted","Data":"771338f8494ba5615587a063aa3dabe6046b7299c216d266d1f13fab647346a9"} Oct 30 18:43:21.593448 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:21.593094 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:21.638383 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:21.638331 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-operator-7dc85965f-jf4rh" podStartSLOduration=1.725943096 podStartE2EDuration="4.638319236s" totalImagesPullingTime="2.91237614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:43:21.638265464 +0000 UTC m=+426.867115021" watchObservedRunningTime="2026-10-30 18:43:21.638319236 +0000 UTC m=+426.867168781" Oct 30 18:43:22.600275 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:22.600240 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:22.774090 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:22.774057 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:23.733296 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:43:23.733260 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:43:27.533765 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:27.533736 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-c667576c8-x2kvb" Oct 30 18:43:38.796507 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:38.796467 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:38.988987 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:38.988956 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:42.599753 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:42.599723 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-7dc85965f-jf4rh" Oct 30 18:43:48.930792 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:48.930757 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:49.962982 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:43:49.962949 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:43:53.732799 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:43:53.732760 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:44:00.149429 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:00.149375 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:44:00.346005 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:00.345967 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:44:01.620866 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:01.620833 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:44:09.222534 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:09.222483 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:44:23.732802 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:44:23.732764 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:44:33.161592 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.161508 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:44:33.309944 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.309905 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl"] Oct 30 18:44:33.312385 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.312366 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" Oct 30 18:44:33.331723 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.331683 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw6fk\" (UniqueName: \"kubernetes.io/projected/5e0fa73e-0055-4a82-947b-db88149cfac0-kube-api-access-qw6fk\") pod \"llmisvc-controller-manager-67f87c4bbb-gcmjl\" (UID: \"5e0fa73e-0055-4a82-947b-db88149cfac0\") " pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" Oct 30 18:44:33.331918 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.331822 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e0fa73e-0055-4a82-947b-db88149cfac0-cert\") pod \"llmisvc-controller-manager-67f87c4bbb-gcmjl\" (UID: \"5e0fa73e-0055-4a82-947b-db88149cfac0\") " pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" Oct 30 18:44:33.335030 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.335007 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl"] Oct 30 18:44:33.349065 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.349022 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-lrg8t"] Oct 30 18:44:33.351529 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.351501 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" Oct 30 18:44:33.371221 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.371183 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-lrg8t"] Oct 30 18:44:33.382218 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.382184 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Oct 30 18:44:33.382218 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.382206 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Oct 30 18:44:33.382435 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.382189 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Oct 30 18:44:33.382435 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.382266 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Oct 30 18:44:33.382435 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.382330 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-wctg5\"" Oct 30 18:44:33.382435 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.382358 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-55pfm\"" Oct 30 18:44:33.418306 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.418275 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:44:33.432565 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.432530 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e0fa73e-0055-4a82-947b-db88149cfac0-cert\") pod \"llmisvc-controller-manager-67f87c4bbb-gcmjl\" (UID: \"5e0fa73e-0055-4a82-947b-db88149cfac0\") " pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" Oct 30 18:44:33.432721 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.432592 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ktg5\" (UniqueName: \"kubernetes.io/projected/667dcc2d-fbe0-4e5c-8018-4afd3fdbb044-kube-api-access-6ktg5\") pod \"seaweedfs-78bb9c6ff8-lrg8t\" (UID: \"667dcc2d-fbe0-4e5c-8018-4afd3fdbb044\") " pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" Oct 30 18:44:33.432721 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.432627 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw6fk\" (UniqueName: \"kubernetes.io/projected/5e0fa73e-0055-4a82-947b-db88149cfac0-kube-api-access-qw6fk\") pod \"llmisvc-controller-manager-67f87c4bbb-gcmjl\" (UID: \"5e0fa73e-0055-4a82-947b-db88149cfac0\") " pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" Oct 30 18:44:33.432721 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.432671 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/667dcc2d-fbe0-4e5c-8018-4afd3fdbb044-data\") pod \"seaweedfs-78bb9c6ff8-lrg8t\" (UID: \"667dcc2d-fbe0-4e5c-8018-4afd3fdbb044\") " pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" Oct 30 18:44:33.435136 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.435107 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e0fa73e-0055-4a82-947b-db88149cfac0-cert\") pod \"llmisvc-controller-manager-67f87c4bbb-gcmjl\" (UID: \"5e0fa73e-0055-4a82-947b-db88149cfac0\") " pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" Oct 30 18:44:33.458525 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.458489 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw6fk\" (UniqueName: \"kubernetes.io/projected/5e0fa73e-0055-4a82-947b-db88149cfac0-kube-api-access-qw6fk\") pod \"llmisvc-controller-manager-67f87c4bbb-gcmjl\" (UID: \"5e0fa73e-0055-4a82-947b-db88149cfac0\") " pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" Oct 30 18:44:33.533600 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.533556 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/667dcc2d-fbe0-4e5c-8018-4afd3fdbb044-data\") pod \"seaweedfs-78bb9c6ff8-lrg8t\" (UID: \"667dcc2d-fbe0-4e5c-8018-4afd3fdbb044\") " pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" Oct 30 18:44:33.533766 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.533623 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ktg5\" (UniqueName: \"kubernetes.io/projected/667dcc2d-fbe0-4e5c-8018-4afd3fdbb044-kube-api-access-6ktg5\") pod \"seaweedfs-78bb9c6ff8-lrg8t\" (UID: \"667dcc2d-fbe0-4e5c-8018-4afd3fdbb044\") " pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" Oct 30 18:44:33.533931 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.533913 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/667dcc2d-fbe0-4e5c-8018-4afd3fdbb044-data\") pod \"seaweedfs-78bb9c6ff8-lrg8t\" (UID: \"667dcc2d-fbe0-4e5c-8018-4afd3fdbb044\") " pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" Oct 30 18:44:33.559308 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.559280 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ktg5\" (UniqueName: \"kubernetes.io/projected/667dcc2d-fbe0-4e5c-8018-4afd3fdbb044-kube-api-access-6ktg5\") pod \"seaweedfs-78bb9c6ff8-lrg8t\" (UID: \"667dcc2d-fbe0-4e5c-8018-4afd3fdbb044\") " pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" Oct 30 18:44:33.591564 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.591517 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:44:33.624481 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.624447 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" Oct 30 18:44:33.663024 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.662992 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" Oct 30 18:44:33.916464 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.916435 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl"] Oct 30 18:44:33.916739 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:44:33.916708 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0fa73e_0055_4a82_947b_db88149cfac0.slice/crio-8e629f11a71802ee49426b4be5238b1f22d117d4ef09095ae5309aaf6f22eda7 WatchSource:0}: Error finding container 8e629f11a71802ee49426b4be5238b1f22d117d4ef09095ae5309aaf6f22eda7: Status 404 returned error can't find the container with id 8e629f11a71802ee49426b4be5238b1f22d117d4ef09095ae5309aaf6f22eda7 Oct 30 18:44:33.958962 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:33.958934 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-lrg8t"] Oct 30 18:44:33.959759 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:44:33.959733 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667dcc2d_fbe0_4e5c_8018_4afd3fdbb044.slice/crio-b7825cab35b7c90cde8cafcaba25c021218b004232cfc9b61fbb4c6239e3aa61 WatchSource:0}: Error finding container b7825cab35b7c90cde8cafcaba25c021218b004232cfc9b61fbb4c6239e3aa61: Status 404 returned error can't find the container with id b7825cab35b7c90cde8cafcaba25c021218b004232cfc9b61fbb4c6239e3aa61 Oct 30 18:44:34.774631 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:34.773664 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:44:34.891456 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:34.891361 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" event={"ID":"667dcc2d-fbe0-4e5c-8018-4afd3fdbb044","Type":"ContainerStarted","Data":"b7825cab35b7c90cde8cafcaba25c021218b004232cfc9b61fbb4c6239e3aa61"} Oct 30 18:44:34.891456 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:34.891426 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" event={"ID":"5e0fa73e-0055-4a82-947b-db88149cfac0","Type":"ContainerStarted","Data":"8e629f11a71802ee49426b4be5238b1f22d117d4ef09095ae5309aaf6f22eda7"} Oct 30 18:44:34.958309 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:34.958268 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:44:36.901071 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:36.900975 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" event={"ID":"5e0fa73e-0055-4a82-947b-db88149cfac0","Type":"ContainerStarted","Data":"6421a22f91e3ff07d022625d896b5df83ee4fbd2c375b10643b9e286dab9069e"} Oct 30 18:44:36.901514 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:36.901068 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" Oct 30 18:44:36.947624 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:36.947572 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" podStartSLOduration=1.3426092490000001 podStartE2EDuration="3.947558647s" totalImagesPullingTime="2.604949398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:44:36.946289449 +0000 UTC m=+502.175138996" watchObservedRunningTime="2026-10-30 18:44:36.947558647 +0000 UTC m=+502.176408192" Oct 30 18:44:37.906745 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:37.906709 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" event={"ID":"667dcc2d-fbe0-4e5c-8018-4afd3fdbb044","Type":"ContainerStarted","Data":"954323e2964d001c38f85c9d3cc12ac739bea48b2dccb36935c320a08b5042e1"} Oct 30 18:44:37.952725 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:37.952669 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" podStartSLOduration=1.905255454 podStartE2EDuration="4.952654882s" totalImagesPullingTime="3.047399428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:44:37.95155872 +0000 UTC m=+503.180408283" watchObservedRunningTime="2026-10-30 18:44:37.952654882 +0000 UTC m=+503.181504473" Oct 30 18:44:38.910666 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:38.910627 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" Oct 30 18:44:44.916520 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:44:44.916485 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-78bb9c6ff8-lrg8t" Oct 30 18:44:53.732226 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:44:53.732188 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:45:01.770643 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:45:01.770604 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:45:07.909142 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:45:07.909110 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67f87c4bbb-gcmjl" Oct 30 18:45:10.665551 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:45:10.665507 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:45:11.706760 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:45:11.706725 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:45:23.733733 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:45:23.733696 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:45:53.732800 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:45:53.732759 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:45:56.206457 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:45:56.206422 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:45:56.389871 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:45:56.389835 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:45:56.568808 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:45:56.568728 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:46:00.398969 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:46:00.398870 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:46:00.571593 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:46:00.571548 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:46:01.878450 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:46:01.878397 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:46:14.912666 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:46:14.912638 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 18:46:14.913892 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:46:14.913872 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 18:46:14.922270 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:46:14.922248 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:46:14.923777 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:46:14.923757 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:46:23.732635 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:46:23.732583 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:46:53.733333 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:46:53.733297 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:47:02.019089 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:02.019042 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:47:23.733497 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:47:23.733461 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:47:24.060815 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:24.060734 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:47:31.128764 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:31.128687 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:47:31.307529 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:31.307491 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:47:37.910545 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:37.910500 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:47:46.929990 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:46.929953 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:47:47.110740 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:47.110702 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:47:48.585615 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:48.585586 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:47:48.774918 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:48.774863 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:47:49.059821 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.059783 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7"] Oct 30 18:47:49.062280 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.062255 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:47:49.069134 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.069105 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:47:49.095703 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.095638 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"error-404-isvc-3e736-kube-rbac-proxy-sar-config\"" Oct 30 18:47:49.095904 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.095770 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"openshift-service-ca.crt\"" Oct 30 18:47:49.095904 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.095816 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"kube-root-ca.crt\"" Oct 30 18:47:49.095904 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.095856 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-89b2ccc844\"/\"error-404-isvc-3e736-predictor-serving-cert\"" Oct 30 18:47:49.097050 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.097030 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7"] Oct 30 18:47:49.098210 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.098195 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-89b2ccc844\"/\"default-dockercfg-x45gr\"" Oct 30 18:47:49.163605 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.163568 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/05410a5b-1b3c-4e6a-9302-4b34300609a8-proxy-tls\") pod \"error-404-isvc-3e736-predictor-f5d4574fb-g2wr7\" (UID: \"05410a5b-1b3c-4e6a-9302-4b34300609a8\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:47:49.163792 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.163622 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-3e736-predictor-f5d4574fb-g2wr7\" (UID: \"05410a5b-1b3c-4e6a-9302-4b34300609a8\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:47:49.163792 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.163753 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7jp9\" (UniqueName: \"kubernetes.io/projected/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-api-access-k7jp9\") pod \"error-404-isvc-3e736-predictor-f5d4574fb-g2wr7\" (UID: \"05410a5b-1b3c-4e6a-9302-4b34300609a8\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:47:49.243602 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.243574 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:47:49.265040 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.265009 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7jp9\" (UniqueName: \"kubernetes.io/projected/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-api-access-k7jp9\") pod \"error-404-isvc-3e736-predictor-f5d4574fb-g2wr7\" (UID: \"05410a5b-1b3c-4e6a-9302-4b34300609a8\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:47:49.265141 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.265064 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/05410a5b-1b3c-4e6a-9302-4b34300609a8-proxy-tls\") pod \"error-404-isvc-3e736-predictor-f5d4574fb-g2wr7\" (UID: \"05410a5b-1b3c-4e6a-9302-4b34300609a8\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:47:49.265141 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.265113 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-3e736-predictor-f5d4574fb-g2wr7\" (UID: \"05410a5b-1b3c-4e6a-9302-4b34300609a8\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:47:49.265754 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.265728 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-3e736-predictor-f5d4574fb-g2wr7\" (UID: \"05410a5b-1b3c-4e6a-9302-4b34300609a8\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:47:49.267663 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.267641 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/05410a5b-1b3c-4e6a-9302-4b34300609a8-proxy-tls\") pod \"error-404-isvc-3e736-predictor-f5d4574fb-g2wr7\" (UID: \"05410a5b-1b3c-4e6a-9302-4b34300609a8\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:47:49.291011 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.290979 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7jp9\" (UniqueName: \"kubernetes.io/projected/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-api-access-k7jp9\") pod \"error-404-isvc-3e736-predictor-f5d4574fb-g2wr7\" (UID: \"05410a5b-1b3c-4e6a-9302-4b34300609a8\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:47:49.375591 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.375491 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:47:49.667541 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.667513 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7"] Oct 30 18:47:49.668032 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:47:49.668009 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05410a5b_1b3c_4e6a_9302_4b34300609a8.slice/crio-90861f2886dd3e3fffc642577ea0f86146ccb719b8b5895641cb033ecb6a183d WatchSource:0}: Error finding container 90861f2886dd3e3fffc642577ea0f86146ccb719b8b5895641cb033ecb6a183d: Status 404 returned error can't find the container with id 90861f2886dd3e3fffc642577ea0f86146ccb719b8b5895641cb033ecb6a183d Oct 30 18:47:49.669768 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:49.669752 4494 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 18:47:50.670430 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:47:50.670375 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" event={"ID":"05410a5b-1b3c-4e6a-9302-4b34300609a8","Type":"ContainerStarted","Data":"90861f2886dd3e3fffc642577ea0f86146ccb719b8b5895641cb033ecb6a183d"} Oct 30 18:47:53.740663 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:47:53.740581 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:48:01.725356 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:01.725323 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" event={"ID":"05410a5b-1b3c-4e6a-9302-4b34300609a8","Type":"ContainerStarted","Data":"2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0"} Oct 30 18:48:02.119798 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:02.119709 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:48:03.735224 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:03.735191 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" event={"ID":"05410a5b-1b3c-4e6a-9302-4b34300609a8","Type":"ContainerStarted","Data":"3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d"} Oct 30 18:48:03.735681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:03.735341 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:48:03.735681 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:03.735395 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:48:03.736869 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:03.736842 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Oct 30 18:48:03.782796 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:03.782743 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" podStartSLOduration=0.882725358 podStartE2EDuration="14.782731072s" totalImagesPullingTime="13.900005714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:47:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:48:03.781862326 +0000 UTC m=+709.010711872" watchObservedRunningTime="2026-10-30 18:48:03.782731072 +0000 UTC m=+709.011580694" Oct 30 18:48:04.739467 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:04.739425 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Oct 30 18:48:06.673319 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:06.673250 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:48:08.866979 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:08.866947 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:48:09.743775 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:09.743741 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:48:09.744351 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:09.744326 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Oct 30 18:48:19.744804 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:19.744759 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Oct 30 18:48:23.733424 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:48:23.733371 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:48:29.744612 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:29.744561 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Oct 30 18:48:31.650354 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:31.650297 4494 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" podUID="0a1141f188cb159776b4a1af048cbc31" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 18:48:39.744519 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:39.744475 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Oct 30 18:48:49.744460 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:49.744398 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Oct 30 18:48:53.731881 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:48:53.731836 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:48:59.744614 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:48:59.744526 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:49:02.261753 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:02.261723 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:49:18.835670 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:18.835632 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh"] Oct 30 18:49:18.840020 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:18.839994 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 18:49:18.856989 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:18.856959 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh"] Oct 30 18:49:18.870228 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:18.870199 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-89b2ccc844\"/\"switch-graph-3e736-serving-cert\"" Oct 30 18:49:18.870366 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:18.870235 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"switch-graph-3e736-kube-rbac-proxy-sar-config\"" Oct 30 18:49:18.904183 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:18.904142 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3c5cf8-8c59-4059-8595-de29a650a44f-openshift-service-ca-bundle\") pod \"switch-graph-3e736-6d55944d8b-nf5kh\" (UID: \"de3c5cf8-8c59-4059-8595-de29a650a44f\") " pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 18:49:18.904400 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:18.904231 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de3c5cf8-8c59-4059-8595-de29a650a44f-proxy-tls\") pod \"switch-graph-3e736-6d55944d8b-nf5kh\" (UID: \"de3c5cf8-8c59-4059-8595-de29a650a44f\") " pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 18:49:18.907359 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:18.907334 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:49:19.005091 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:19.005049 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de3c5cf8-8c59-4059-8595-de29a650a44f-proxy-tls\") pod \"switch-graph-3e736-6d55944d8b-nf5kh\" (UID: \"de3c5cf8-8c59-4059-8595-de29a650a44f\") " pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 18:49:19.005297 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:19.005119 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3c5cf8-8c59-4059-8595-de29a650a44f-openshift-service-ca-bundle\") pod \"switch-graph-3e736-6d55944d8b-nf5kh\" (UID: \"de3c5cf8-8c59-4059-8595-de29a650a44f\") " pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 18:49:19.005795 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:19.005769 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3c5cf8-8c59-4059-8595-de29a650a44f-openshift-service-ca-bundle\") pod \"switch-graph-3e736-6d55944d8b-nf5kh\" (UID: \"de3c5cf8-8c59-4059-8595-de29a650a44f\") " pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 18:49:19.007563 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:19.007538 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de3c5cf8-8c59-4059-8595-de29a650a44f-proxy-tls\") pod \"switch-graph-3e736-6d55944d8b-nf5kh\" (UID: \"de3c5cf8-8c59-4059-8595-de29a650a44f\") " pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 18:49:19.100245 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:19.100149 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:49:19.153074 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:19.153037 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 18:49:19.447047 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:19.447020 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh"] Oct 30 18:49:19.447997 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:49:19.447970 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3c5cf8_8c59_4059_8595_de29a650a44f.slice/crio-4d7df37bfcdeefea7dfd5aa9331c9645239cb860bee8060c3788e714ec4071bc WatchSource:0}: Error finding container 4d7df37bfcdeefea7dfd5aa9331c9645239cb860bee8060c3788e714ec4071bc: Status 404 returned error can't find the container with id 4d7df37bfcdeefea7dfd5aa9331c9645239cb860bee8060c3788e714ec4071bc Oct 30 18:49:20.048854 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:20.048816 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" event={"ID":"de3c5cf8-8c59-4059-8595-de29a650a44f","Type":"ContainerStarted","Data":"4d7df37bfcdeefea7dfd5aa9331c9645239cb860bee8060c3788e714ec4071bc"} Oct 30 18:49:22.058915 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:22.058880 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" event={"ID":"de3c5cf8-8c59-4059-8595-de29a650a44f","Type":"ContainerStarted","Data":"79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458"} Oct 30 18:49:22.059322 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:22.058981 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 18:49:22.104363 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:22.104313 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" podStartSLOduration=2.065335617 podStartE2EDuration="4.104300133s" totalImagesPullingTime="2.038964516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:49:22.103550473 +0000 UTC m=+787.332400019" watchObservedRunningTime="2026-10-30 18:49:22.104300133 +0000 UTC m=+787.333149678" Oct 30 18:49:23.733620 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:49:23.733585 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:49:28.069230 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:28.069157 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 18:49:30.523907 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:30.523872 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7"] Oct 30 18:49:30.524335 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:30.524098 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kserve-container" containerID="cri-o://2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0" gracePeriod=30 Oct 30 18:49:30.524335 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:30.524134 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kube-rbac-proxy" containerID="cri-o://3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d" gracePeriod=30 Oct 30 18:49:30.631887 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:30.631854 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:49:30.821629 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:30.821530 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:49:31.099104 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:31.099023 4494 generic.go:356] "Generic (PLEG): container finished" podID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerID="3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d" exitCode=0 Oct 30 18:49:31.099104 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:31.099090 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" event={"ID":"05410a5b-1b3c-4e6a-9302-4b34300609a8","Type":"ContainerDied","Data":"3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d"} Oct 30 18:49:33.973630 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:33.973604 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:49:34.039002 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.038959 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-rbac-proxy-sar-config\") pod \"05410a5b-1b3c-4e6a-9302-4b34300609a8\" (UID: \"05410a5b-1b3c-4e6a-9302-4b34300609a8\") " Oct 30 18:49:34.039153 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.039027 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-api-access-k7jp9\" (UniqueName: \"kubernetes.io/projected/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-api-access-k7jp9\") pod \"05410a5b-1b3c-4e6a-9302-4b34300609a8\" (UID: \"05410a5b-1b3c-4e6a-9302-4b34300609a8\") " Oct 30 18:49:34.039153 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.039075 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/05410a5b-1b3c-4e6a-9302-4b34300609a8-proxy-tls\" (UniqueName: \"kubernetes.io/secret/05410a5b-1b3c-4e6a-9302-4b34300609a8-proxy-tls\") pod \"05410a5b-1b3c-4e6a-9302-4b34300609a8\" (UID: \"05410a5b-1b3c-4e6a-9302-4b34300609a8\") " Oct 30 18:49:34.039333 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.039313 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-rbac-proxy-sar-config" pod "05410a5b-1b3c-4e6a-9302-4b34300609a8" (UID: "05410a5b-1b3c-4e6a-9302-4b34300609a8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:49:34.041186 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.041154 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-api-access-k7jp9" pod "05410a5b-1b3c-4e6a-9302-4b34300609a8" (UID: "05410a5b-1b3c-4e6a-9302-4b34300609a8"). InnerVolumeSpecName "kube-api-access-k7jp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:49:34.041292 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.041192 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05410a5b-1b3c-4e6a-9302-4b34300609a8-proxy-tls" pod "05410a5b-1b3c-4e6a-9302-4b34300609a8" (UID: "05410a5b-1b3c-4e6a-9302-4b34300609a8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:49:34.113555 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.113476 4494 generic.go:356] "Generic (PLEG): container finished" podID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerID="2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0" exitCode=0 Oct 30 18:49:34.113555 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.113523 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" Oct 30 18:49:34.113555 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.113529 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" event={"ID":"05410a5b-1b3c-4e6a-9302-4b34300609a8","Type":"ContainerDied","Data":"2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0"} Oct 30 18:49:34.113796 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.113598 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7" event={"ID":"05410a5b-1b3c-4e6a-9302-4b34300609a8","Type":"ContainerDied","Data":"90861f2886dd3e3fffc642577ea0f86146ccb719b8b5895641cb033ecb6a183d"} Oct 30 18:49:34.113796 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.113623 4494 scope.go:122] "RemoveContainer" containerID="3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d" Oct 30 18:49:34.121938 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.121923 4494 scope.go:122] "RemoveContainer" containerID="2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0" Oct 30 18:49:34.128784 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.128767 4494 scope.go:122] "RemoveContainer" containerID="3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d" Oct 30 18:49:34.129040 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:49:34.129019 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d\": container with ID starting with 3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d not found: ID does not exist" containerID="3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d" Oct 30 18:49:34.129109 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.129054 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d"} err="failed to get container status \"3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d\": rpc error: code = NotFound desc = could not find container \"3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d\": container with ID starting with 3ebe743c94f07384069e785e8eaf7a694e7ec32f25b38e568304a295aaf9117d not found: ID does not exist" Oct 30 18:49:34.129109 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.129079 4494 scope.go:122] "RemoveContainer" containerID="2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0" Oct 30 18:49:34.129324 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:49:34.129303 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0\": container with ID starting with 2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0 not found: ID does not exist" containerID="2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0" Oct 30 18:49:34.129370 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.129334 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0"} err="failed to get container status \"2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0\": rpc error: code = NotFound desc = could not find container \"2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0\": container with ID starting with 2d34be228188063f57427858785e1975d7d55b86ae72a67507441ca08a5daad0 not found: ID does not exist" Oct 30 18:49:34.140192 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.140168 4494 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:49:34.140192 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.140191 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7jp9\" (UniqueName: \"kubernetes.io/projected/05410a5b-1b3c-4e6a-9302-4b34300609a8-kube-api-access-k7jp9\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:49:34.140322 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.140201 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/05410a5b-1b3c-4e6a-9302-4b34300609a8-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:49:34.172345 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.172317 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7"] Oct 30 18:49:34.176671 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.176648 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-3e736-predictor-f5d4574fb-g2wr7"] Oct 30 18:49:34.885611 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:34.885573 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" path="/var/lib/kubelet/pods/05410a5b-1b3c-4e6a-9302-4b34300609a8/volumes" Oct 30 18:49:37.776446 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:37.776391 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:49:37.952233 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:37.952203 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:49:38.185839 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.185803 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh"] Oct 30 18:49:38.186174 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.186161 4494 cpu_manager.go:414] "containerMap: removing container" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kserve-container" Oct 30 18:49:38.186221 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.186175 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kserve-container" Oct 30 18:49:38.186221 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.186186 4494 cpu_manager.go:414] "containerMap: removing container" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kube-rbac-proxy" Oct 30 18:49:38.186221 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.186191 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kube-rbac-proxy" Oct 30 18:49:38.186307 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.186264 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kserve-container" Oct 30 18:49:38.186307 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.186272 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="05410a5b-1b3c-4e6a-9302-4b34300609a8" containerName="kube-rbac-proxy" Oct 30 18:49:38.190544 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.190524 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:38.197722 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.197699 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:49:38.223522 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.223489 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"error-404-isvc-d7605-kube-rbac-proxy-sar-config\"" Oct 30 18:49:38.223522 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.223494 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"kube-root-ca.crt\"" Oct 30 18:49:38.223703 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.223588 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-89b2ccc844\"/\"error-404-isvc-d7605-predictor-serving-cert\"" Oct 30 18:49:38.226026 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.225999 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh"] Oct 30 18:49:38.275645 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.275600 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9srdl\" (UniqueName: \"kubernetes.io/projected/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-api-access-9srdl\") pod \"error-404-isvc-d7605-predictor-6d6c4f6864-b52xh\" (UID: \"77a3a878-7b0a-43f4-9204-58d56c6c560b\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:38.275842 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.275657 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-d7605-predictor-6d6c4f6864-b52xh\" (UID: \"77a3a878-7b0a-43f4-9204-58d56c6c560b\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:38.275842 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.275685 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77a3a878-7b0a-43f4-9204-58d56c6c560b-proxy-tls\") pod \"error-404-isvc-d7605-predictor-6d6c4f6864-b52xh\" (UID: \"77a3a878-7b0a-43f4-9204-58d56c6c560b\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:38.375418 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.375369 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:49:38.376415 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.376379 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77a3a878-7b0a-43f4-9204-58d56c6c560b-proxy-tls\") pod \"error-404-isvc-d7605-predictor-6d6c4f6864-b52xh\" (UID: \"77a3a878-7b0a-43f4-9204-58d56c6c560b\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:38.376548 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.376494 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9srdl\" (UniqueName: \"kubernetes.io/projected/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-api-access-9srdl\") pod \"error-404-isvc-d7605-predictor-6d6c4f6864-b52xh\" (UID: \"77a3a878-7b0a-43f4-9204-58d56c6c560b\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:38.376610 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.376548 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-d7605-predictor-6d6c4f6864-b52xh\" (UID: \"77a3a878-7b0a-43f4-9204-58d56c6c560b\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:38.377099 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.377077 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-d7605-predictor-6d6c4f6864-b52xh\" (UID: \"77a3a878-7b0a-43f4-9204-58d56c6c560b\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:38.378680 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.378658 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77a3a878-7b0a-43f4-9204-58d56c6c560b-proxy-tls\") pod \"error-404-isvc-d7605-predictor-6d6c4f6864-b52xh\" (UID: \"77a3a878-7b0a-43f4-9204-58d56c6c560b\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:38.401902 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.401875 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9srdl\" (UniqueName: \"kubernetes.io/projected/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-api-access-9srdl\") pod \"error-404-isvc-d7605-predictor-6d6c4f6864-b52xh\" (UID: \"77a3a878-7b0a-43f4-9204-58d56c6c560b\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:38.505236 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.505137 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:38.643152 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.643120 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:49:38.800009 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:49:38.799974 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a3a878_7b0a_43f4_9204_58d56c6c560b.slice/crio-0bba2fc10eb08f9c91c94fc5c1ded968d9d7db5ed3873bc686bd14d5a1e90f8a WatchSource:0}: Error finding container 0bba2fc10eb08f9c91c94fc5c1ded968d9d7db5ed3873bc686bd14d5a1e90f8a: Status 404 returned error can't find the container with id 0bba2fc10eb08f9c91c94fc5c1ded968d9d7db5ed3873bc686bd14d5a1e90f8a Oct 30 18:49:38.800422 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:38.800093 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh"] Oct 30 18:49:39.137183 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:39.137090 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" event={"ID":"77a3a878-7b0a-43f4-9204-58d56c6c560b","Type":"ContainerStarted","Data":"06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c"} Oct 30 18:49:39.137183 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:39.137157 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" event={"ID":"77a3a878-7b0a-43f4-9204-58d56c6c560b","Type":"ContainerStarted","Data":"08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b"} Oct 30 18:49:39.137443 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:39.137187 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" event={"ID":"77a3a878-7b0a-43f4-9204-58d56c6c560b","Type":"ContainerStarted","Data":"0bba2fc10eb08f9c91c94fc5c1ded968d9d7db5ed3873bc686bd14d5a1e90f8a"} Oct 30 18:49:39.137443 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:39.137218 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:39.137443 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:39.137322 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:39.138475 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:39.138451 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Oct 30 18:49:39.184513 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:39.184462 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" podStartSLOduration=1.184450005 podStartE2EDuration="1.184450005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:49:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:49:39.183309042 +0000 UTC m=+804.412158587" watchObservedRunningTime="2026-10-30 18:49:39.184450005 +0000 UTC m=+804.413299551" Oct 30 18:49:39.649719 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:39.649687 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:49:40.141208 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:40.141165 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Oct 30 18:49:45.145964 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:45.145934 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:49:45.146609 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:45.146568 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Oct 30 18:49:53.733151 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:49:53.733110 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:49:55.146916 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:55.146881 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Oct 30 18:49:59.631765 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:59.631727 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:49:59.939224 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:49:59.939197 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:50:00.303016 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.302926 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:50:00.371707 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.371670 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb"] Oct 30 18:50:00.377036 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.377016 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.395498 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.395454 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-f31293434f\"/\"seaweedfs-s3-creds\"" Oct 30 18:50:00.395498 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.395478 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Oct 30 18:50:00.409846 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.409799 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-f31293434f\"/\"default-dockercfg-6knpr\"" Oct 30 18:50:00.409846 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.409829 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"openshift-service-ca.crt\"" Oct 30 18:50:00.410050 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.409851 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"kube-root-ca.crt\"" Oct 30 18:50:00.410050 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.409820 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 18:50:00.410050 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.409985 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-f31293434f\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Oct 30 18:50:00.411435 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.411416 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb"] Oct 30 18:50:00.462485 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.462443 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.462683 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.462494 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77cns\" (UniqueName: \"kubernetes.io/projected/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-api-access-77cns\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.462683 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.462595 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.462683 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.462624 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f87c7d43-27ad-4844-abc4-230a5cd3f081-proxy-tls\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.462823 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.462709 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f87c7d43-27ad-4844-abc4-230a5cd3f081-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.525292 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.525259 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:50:00.563546 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.563456 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.563546 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.563501 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77cns\" (UniqueName: \"kubernetes.io/projected/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-api-access-77cns\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.563546 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.563531 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.563852 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.563557 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f87c7d43-27ad-4844-abc4-230a5cd3f081-proxy-tls\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.563852 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.563582 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f87c7d43-27ad-4844-abc4-230a5cd3f081-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.563992 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.563969 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f87c7d43-27ad-4844-abc4-230a5cd3f081-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.564149 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.564131 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.564195 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.564153 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.565914 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.565898 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f87c7d43-27ad-4844-abc4-230a5cd3f081-proxy-tls\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.591735 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.591699 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77cns\" (UniqueName: \"kubernetes.io/projected/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-api-access-77cns\") pod \"isvc-xgboost-graph-predictor-6b85f44c48-p5jfb\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.694562 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.694523 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:00.713276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.713250 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:50:00.890216 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:00.890124 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:50:01.001065 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:01.001039 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb"] Oct 30 18:50:01.001578 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:50:01.001551 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87c7d43_27ad_4844_abc4_230a5cd3f081.slice/crio-049c981a45a5b1bda45dfa81f87b3588b155b7bcb7f41abd398c752439b3626e WatchSource:0}: Error finding container 049c981a45a5b1bda45dfa81f87b3588b155b7bcb7f41abd398c752439b3626e: Status 404 returned error can't find the container with id 049c981a45a5b1bda45dfa81f87b3588b155b7bcb7f41abd398c752439b3626e Oct 30 18:50:01.228966 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:01.228929 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" event={"ID":"f87c7d43-27ad-4844-abc4-230a5cd3f081","Type":"ContainerStarted","Data":"049c981a45a5b1bda45dfa81f87b3588b155b7bcb7f41abd398c752439b3626e"} Oct 30 18:50:02.364239 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:02.364204 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:50:04.245262 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:04.245230 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" event={"ID":"f87c7d43-27ad-4844-abc4-230a5cd3f081","Type":"ContainerStarted","Data":"50e26985242e6ace0ec0521334066e24f2cea946707e651335902d1ea085be3f"} Oct 30 18:50:05.146693 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:05.146652 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Oct 30 18:50:08.263128 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:08.263095 4494 generic.go:356] "Generic (PLEG): container finished" podID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerID="50e26985242e6ace0ec0521334066e24f2cea946707e651335902d1ea085be3f" exitCode=0 Oct 30 18:50:08.263498 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:08.263164 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" event={"ID":"f87c7d43-27ad-4844-abc4-230a5cd3f081","Type":"ContainerDied","Data":"50e26985242e6ace0ec0521334066e24f2cea946707e651335902d1ea085be3f"} Oct 30 18:50:15.147535 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:15.147492 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Oct 30 18:50:16.034592 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:16.034557 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:50:23.737050 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:50:23.736985 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:50:25.146873 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:25.146833 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Oct 30 18:50:27.364360 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:27.364320 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" event={"ID":"f87c7d43-27ad-4844-abc4-230a5cd3f081","Type":"ContainerStarted","Data":"e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3"} Oct 30 18:50:27.364826 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:27.364452 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" event={"ID":"f87c7d43-27ad-4844-abc4-230a5cd3f081","Type":"ContainerStarted","Data":"6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502"} Oct 30 18:50:27.364826 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:27.364672 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:27.428839 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:27.428778 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podStartSLOduration=2.581384046 podStartE2EDuration="27.428760744s" totalImagesPullingTime="21.228387405s" totalInitContainerRuntime="3.618989293s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:50:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:50:27.428645748 +0000 UTC m=+852.657495294" watchObservedRunningTime="2026-10-30 18:50:27.428760744 +0000 UTC m=+852.657610316" Oct 30 18:50:28.368725 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:28.368696 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:28.370070 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:28.370042 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Oct 30 18:50:29.372857 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:29.372770 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Oct 30 18:50:33.889108 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:33.889073 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:50:34.376890 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:34.376861 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:50:34.377438 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:34.377400 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Oct 30 18:50:34.898821 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:34.898768 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:50:35.147107 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:35.147081 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:50:35.937291 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:35.937255 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:50:44.378316 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:44.378280 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Oct 30 18:50:47.904595 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:47.904558 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s"] Oct 30 18:50:47.969128 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:47.969083 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:50:48.146173 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.146132 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:50:48.358706 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.358662 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s"] Oct 30 18:50:48.358921 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.358822 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 18:50:48.391014 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.390983 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"switch-graph-d7605-kube-rbac-proxy-sar-config\"" Oct 30 18:50:48.391014 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.390992 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-89b2ccc844\"/\"switch-graph-d7605-serving-cert\"" Oct 30 18:50:48.485315 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.485279 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5151264-c383-46cc-ab7a-9e38823ef86f-openshift-service-ca-bundle\") pod \"switch-graph-d7605-8dd78bcbc-2dl8s\" (UID: \"e5151264-c383-46cc-ab7a-9e38823ef86f\") " pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 18:50:48.485315 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.485327 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e5151264-c383-46cc-ab7a-9e38823ef86f-proxy-tls\") pod \"switch-graph-d7605-8dd78bcbc-2dl8s\" (UID: \"e5151264-c383-46cc-ab7a-9e38823ef86f\") " pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 18:50:48.586476 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.586437 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5151264-c383-46cc-ab7a-9e38823ef86f-openshift-service-ca-bundle\") pod \"switch-graph-d7605-8dd78bcbc-2dl8s\" (UID: \"e5151264-c383-46cc-ab7a-9e38823ef86f\") " pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 18:50:48.586649 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.586496 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e5151264-c383-46cc-ab7a-9e38823ef86f-proxy-tls\") pod \"switch-graph-d7605-8dd78bcbc-2dl8s\" (UID: \"e5151264-c383-46cc-ab7a-9e38823ef86f\") " pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 18:50:48.587185 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.587165 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5151264-c383-46cc-ab7a-9e38823ef86f-openshift-service-ca-bundle\") pod \"switch-graph-d7605-8dd78bcbc-2dl8s\" (UID: \"e5151264-c383-46cc-ab7a-9e38823ef86f\") " pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 18:50:48.588968 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.588946 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e5151264-c383-46cc-ab7a-9e38823ef86f-proxy-tls\") pod \"switch-graph-d7605-8dd78bcbc-2dl8s\" (UID: \"e5151264-c383-46cc-ab7a-9e38823ef86f\") " pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 18:50:48.686984 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.686933 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 18:50:48.976106 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:50:48.976074 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5151264_c383_46cc_ab7a_9e38823ef86f.slice/crio-1c132da9e2eb4d077a7bbde55f5b0fad87477777ceb701c54b90441df00d092e WatchSource:0}: Error finding container 1c132da9e2eb4d077a7bbde55f5b0fad87477777ceb701c54b90441df00d092e: Status 404 returned error can't find the container with id 1c132da9e2eb4d077a7bbde55f5b0fad87477777ceb701c54b90441df00d092e Oct 30 18:50:48.976825 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:48.976801 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s"] Oct 30 18:50:49.465510 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:49.465465 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" event={"ID":"e5151264-c383-46cc-ab7a-9e38823ef86f","Type":"ContainerStarted","Data":"d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea"} Oct 30 18:50:49.465688 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:49.465522 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" event={"ID":"e5151264-c383-46cc-ab7a-9e38823ef86f","Type":"ContainerStarted","Data":"1c132da9e2eb4d077a7bbde55f5b0fad87477777ceb701c54b90441df00d092e"} Oct 30 18:50:49.465688 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:49.465544 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 18:50:49.510262 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:49.510213 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" podStartSLOduration=2.510200569 podStartE2EDuration="2.510200569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:50:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:50:49.509715457 +0000 UTC m=+874.738565013" watchObservedRunningTime="2026-10-30 18:50:49.510200569 +0000 UTC m=+874.739050114" Oct 30 18:50:53.733330 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:50:53.733232 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:50:54.377624 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:54.377581 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Oct 30 18:50:55.475622 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:50:55.475593 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 18:51:02.497580 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:51:02.497549 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:51:04.378187 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:51:04.378147 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Oct 30 18:51:14.377609 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:51:14.377565 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Oct 30 18:51:14.947617 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:51:14.947584 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 18:51:14.949222 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:51:14.949197 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 18:51:14.958109 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:51:14.958081 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:51:14.959551 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:51:14.959529 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:51:23.734015 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:51:23.733971 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:51:24.378138 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:51:24.378089 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Oct 30 18:51:34.378143 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:51:34.378106 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:51:53.732247 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:51:53.732208 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:52:02.628709 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:02.628632 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:09.730192 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.730157 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl"] Oct 30 18:52:09.732538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.732522 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 18:52:09.747020 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.746994 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23281269-2b00-446c-851c-aceff20ac39d-openshift-service-ca-bundle\") pod \"model-chainer-767788db4d-m27nl\" (UID: \"23281269-2b00-446c-851c-aceff20ac39d\") " pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 18:52:09.747136 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.747034 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23281269-2b00-446c-851c-aceff20ac39d-proxy-tls\") pod \"model-chainer-767788db4d-m27nl\" (UID: \"23281269-2b00-446c-851c-aceff20ac39d\") " pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 18:52:09.753731 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.753707 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl"] Oct 30 18:52:09.766958 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.766935 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"model-chainer-kube-rbac-proxy-sar-config\"" Oct 30 18:52:09.766958 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.766945 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-f31293434f\"/\"model-chainer-serving-cert\"" Oct 30 18:52:09.793121 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.793089 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:09.848272 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.848214 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23281269-2b00-446c-851c-aceff20ac39d-openshift-service-ca-bundle\") pod \"model-chainer-767788db4d-m27nl\" (UID: \"23281269-2b00-446c-851c-aceff20ac39d\") " pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 18:52:09.848272 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.848279 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23281269-2b00-446c-851c-aceff20ac39d-proxy-tls\") pod \"model-chainer-767788db4d-m27nl\" (UID: \"23281269-2b00-446c-851c-aceff20ac39d\") " pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 18:52:09.848914 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.848885 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23281269-2b00-446c-851c-aceff20ac39d-openshift-service-ca-bundle\") pod \"model-chainer-767788db4d-m27nl\" (UID: \"23281269-2b00-446c-851c-aceff20ac39d\") " pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 18:52:09.850687 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.850666 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23281269-2b00-446c-851c-aceff20ac39d-proxy-tls\") pod \"model-chainer-767788db4d-m27nl\" (UID: \"23281269-2b00-446c-851c-aceff20ac39d\") " pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 18:52:09.971439 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:09.971366 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:10.043686 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:10.043604 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 18:52:10.337687 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:10.335545 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl"] Oct 30 18:52:10.339489 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:52:10.339459 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23281269_2b00_446c_851c_aceff20ac39d.slice/crio-09813e48e1de38f464014c9532689cc9b72f25d4dc402e32bfa10bdfb5f6ef25 WatchSource:0}: Error finding container 09813e48e1de38f464014c9532689cc9b72f25d4dc402e32bfa10bdfb5f6ef25: Status 404 returned error can't find the container with id 09813e48e1de38f464014c9532689cc9b72f25d4dc402e32bfa10bdfb5f6ef25 Oct 30 18:52:10.813035 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:10.812996 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" event={"ID":"23281269-2b00-446c-851c-aceff20ac39d","Type":"ContainerStarted","Data":"6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc"} Oct 30 18:52:10.813536 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:10.813049 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" event={"ID":"23281269-2b00-446c-851c-aceff20ac39d","Type":"ContainerStarted","Data":"09813e48e1de38f464014c9532689cc9b72f25d4dc402e32bfa10bdfb5f6ef25"} Oct 30 18:52:10.813536 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:10.813079 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 18:52:10.861899 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:10.861845 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" podStartSLOduration=1.8618314649999999 podStartE2EDuration="1.861831465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:52:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:52:10.860383906 +0000 UTC m=+956.089233453" watchObservedRunningTime="2026-10-30 18:52:10.861831465 +0000 UTC m=+956.090681044" Oct 30 18:52:16.823447 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:16.823399 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 18:52:22.152499 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:22.152465 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb"] Oct 30 18:52:22.152904 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:22.152759 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kube-rbac-proxy" containerID="cri-o://e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3" gracePeriod=30 Oct 30 18:52:22.152904 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:22.152771 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" containerID="cri-o://6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502" gracePeriod=30 Oct 30 18:52:22.299001 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:22.298967 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:22.481276 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:22.481215 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:22.866910 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:22.866830 4494 generic.go:356] "Generic (PLEG): container finished" podID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerID="e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3" exitCode=0 Oct 30 18:52:22.866910 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:22.866877 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" event={"ID":"f87c7d43-27ad-4844-abc4-230a5cd3f081","Type":"ContainerDied","Data":"e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3"} Oct 30 18:52:23.733988 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:52:23.733950 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:52:24.373912 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:24.373868 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused" Oct 30 18:52:24.378305 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:24.378275 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused" Oct 30 18:52:26.397091 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.397064 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:52:26.494052 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.493972 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f87c7d43-27ad-4844-abc4-230a5cd3f081-proxy-tls\" (UniqueName: \"kubernetes.io/secret/f87c7d43-27ad-4844-abc4-230a5cd3f081-proxy-tls\") pod \"f87c7d43-27ad-4844-abc4-230a5cd3f081\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " Oct 30 18:52:26.494052 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.494031 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-api-access-77cns\" (UniqueName: \"kubernetes.io/projected/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-api-access-77cns\") pod \"f87c7d43-27ad-4844-abc4-230a5cd3f081\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " Oct 30 18:52:26.494249 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.494081 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f87c7d43-27ad-4844-abc4-230a5cd3f081-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f87c7d43-27ad-4844-abc4-230a5cd3f081-kserve-provision-location\") pod \"f87c7d43-27ad-4844-abc4-230a5cd3f081\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " Oct 30 18:52:26.494249 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.494157 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-cabundle-cert\") pod \"f87c7d43-27ad-4844-abc4-230a5cd3f081\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " Oct 30 18:52:26.494249 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.494184 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-rbac-proxy-sar-config\") pod \"f87c7d43-27ad-4844-abc4-230a5cd3f081\" (UID: \"f87c7d43-27ad-4844-abc4-230a5cd3f081\") " Oct 30 18:52:26.494538 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.494507 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87c7d43-27ad-4844-abc4-230a5cd3f081-kserve-provision-location" pod "f87c7d43-27ad-4844-abc4-230a5cd3f081" (UID: "f87c7d43-27ad-4844-abc4-230a5cd3f081"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 18:52:26.494635 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.494535 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-cabundle-cert" pod "f87c7d43-27ad-4844-abc4-230a5cd3f081" (UID: "f87c7d43-27ad-4844-abc4-230a5cd3f081"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:52:26.494676 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.494625 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-rbac-proxy-sar-config" pod "f87c7d43-27ad-4844-abc4-230a5cd3f081" (UID: "f87c7d43-27ad-4844-abc4-230a5cd3f081"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:52:26.496269 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.496242 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f87c7d43-27ad-4844-abc4-230a5cd3f081-proxy-tls" pod "f87c7d43-27ad-4844-abc4-230a5cd3f081" (UID: "f87c7d43-27ad-4844-abc4-230a5cd3f081"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:52:26.496347 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.496247 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-api-access-77cns" pod "f87c7d43-27ad-4844-abc4-230a5cd3f081" (UID: "f87c7d43-27ad-4844-abc4-230a5cd3f081"). InnerVolumeSpecName "kube-api-access-77cns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:52:26.595534 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.595487 4494 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-cabundle-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:52:26.595534 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.595529 4494 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:52:26.595534 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.595539 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f87c7d43-27ad-4844-abc4-230a5cd3f081-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:52:26.595534 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.595548 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77cns\" (UniqueName: \"kubernetes.io/projected/f87c7d43-27ad-4844-abc4-230a5cd3f081-kube-api-access-77cns\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:52:26.595799 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.595557 4494 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f87c7d43-27ad-4844-abc4-230a5cd3f081-kserve-provision-location\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:52:26.886156 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.886068 4494 generic.go:356] "Generic (PLEG): container finished" podID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerID="6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502" exitCode=0 Oct 30 18:52:26.886156 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.886134 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" Oct 30 18:52:26.886329 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.886143 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" event={"ID":"f87c7d43-27ad-4844-abc4-230a5cd3f081","Type":"ContainerDied","Data":"6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502"} Oct 30 18:52:26.886329 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.886211 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb" event={"ID":"f87c7d43-27ad-4844-abc4-230a5cd3f081","Type":"ContainerDied","Data":"049c981a45a5b1bda45dfa81f87b3588b155b7bcb7f41abd398c752439b3626e"} Oct 30 18:52:26.886329 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.886240 4494 scope.go:122] "RemoveContainer" containerID="e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3" Oct 30 18:52:26.895705 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.895681 4494 scope.go:122] "RemoveContainer" containerID="6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502" Oct 30 18:52:26.903152 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.903132 4494 scope.go:122] "RemoveContainer" containerID="50e26985242e6ace0ec0521334066e24f2cea946707e651335902d1ea085be3f" Oct 30 18:52:26.910676 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.910651 4494 scope.go:122] "RemoveContainer" containerID="e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3" Oct 30 18:52:26.910947 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:52:26.910928 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3\": container with ID starting with e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3 not found: ID does not exist" containerID="e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3" Oct 30 18:52:26.910993 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.910958 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3"} err="failed to get container status \"e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3\": rpc error: code = NotFound desc = could not find container \"e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3\": container with ID starting with e011e9338e570ee055bd3d4d510b80c431f71ca86c7b3971765583ccaf9a98e3 not found: ID does not exist" Oct 30 18:52:26.910993 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.910976 4494 scope.go:122] "RemoveContainer" containerID="6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502" Oct 30 18:52:26.911211 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:52:26.911194 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502\": container with ID starting with 6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502 not found: ID does not exist" containerID="6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502" Oct 30 18:52:26.911245 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.911218 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502"} err="failed to get container status \"6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502\": rpc error: code = NotFound desc = could not find container \"6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502\": container with ID starting with 6b6e3989bcdfe745e7ab41c8200af85aae82d09544461c4fcf73d1ffb2e38502 not found: ID does not exist" Oct 30 18:52:26.911245 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.911233 4494 scope.go:122] "RemoveContainer" containerID="50e26985242e6ace0ec0521334066e24f2cea946707e651335902d1ea085be3f" Oct 30 18:52:26.911471 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:52:26.911446 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50e26985242e6ace0ec0521334066e24f2cea946707e651335902d1ea085be3f\": container with ID starting with 50e26985242e6ace0ec0521334066e24f2cea946707e651335902d1ea085be3f not found: ID does not exist" containerID="50e26985242e6ace0ec0521334066e24f2cea946707e651335902d1ea085be3f" Oct 30 18:52:26.911511 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.911467 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e26985242e6ace0ec0521334066e24f2cea946707e651335902d1ea085be3f"} err="failed to get container status \"50e26985242e6ace0ec0521334066e24f2cea946707e651335902d1ea085be3f\": rpc error: code = NotFound desc = could not find container \"50e26985242e6ace0ec0521334066e24f2cea946707e651335902d1ea085be3f\": container with ID starting with 50e26985242e6ace0ec0521334066e24f2cea946707e651335902d1ea085be3f not found: ID does not exist" Oct 30 18:52:26.961281 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.961249 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb"] Oct 30 18:52:26.965507 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:26.965481 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-f31293434f/isvc-xgboost-graph-predictor-6b85f44c48-p5jfb"] Oct 30 18:52:28.885528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:28.885496 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" path="/var/lib/kubelet/pods/f87c7d43-27ad-4844-abc4-230a5cd3f081/volumes" Oct 30 18:52:29.209269 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.209233 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:29.379859 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.379824 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:29.898487 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.898452 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg"] Oct 30 18:52:29.898880 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.898821 4494 cpu_manager.go:414] "containerMap: removing container" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kube-rbac-proxy" Oct 30 18:52:29.898880 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.898833 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kube-rbac-proxy" Oct 30 18:52:29.898880 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.898855 4494 cpu_manager.go:414] "containerMap: removing container" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="storage-initializer" Oct 30 18:52:29.898880 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.898860 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="storage-initializer" Oct 30 18:52:29.898880 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.898880 4494 cpu_manager.go:414] "containerMap: removing container" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" Oct 30 18:52:29.899024 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.898885 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" Oct 30 18:52:29.899024 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.898939 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kserve-container" Oct 30 18:52:29.899024 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.898946 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="f87c7d43-27ad-4844-abc4-230a5cd3f081" containerName="kube-rbac-proxy" Oct 30 18:52:29.902041 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.902024 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:29.908390 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.908360 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:29.921742 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.921714 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"error-404-isvc-90935-kube-rbac-proxy-sar-config\"" Oct 30 18:52:29.921742 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.921715 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"kube-root-ca.crt\"" Oct 30 18:52:29.935232 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.935205 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-f31293434f\"/\"error-404-isvc-90935-predictor-serving-cert\"" Oct 30 18:52:29.936699 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:29.936677 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg"] Oct 30 18:52:30.023955 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.023900 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-90935-predictor-6796f8c7b4-7dvvg\" (UID: \"a77b89c6-321e-4133-8d02-8e9ae3f69184\") " pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:30.024144 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.024034 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a77b89c6-321e-4133-8d02-8e9ae3f69184-proxy-tls\") pod \"error-404-isvc-90935-predictor-6796f8c7b4-7dvvg\" (UID: \"a77b89c6-321e-4133-8d02-8e9ae3f69184\") " pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:30.024144 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.024099 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjvn5\" (UniqueName: \"kubernetes.io/projected/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-api-access-rjvn5\") pod \"error-404-isvc-90935-predictor-6796f8c7b4-7dvvg\" (UID: \"a77b89c6-321e-4133-8d02-8e9ae3f69184\") " pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:30.085827 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.085796 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:30.125163 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.125126 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjvn5\" (UniqueName: \"kubernetes.io/projected/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-api-access-rjvn5\") pod \"error-404-isvc-90935-predictor-6796f8c7b4-7dvvg\" (UID: \"a77b89c6-321e-4133-8d02-8e9ae3f69184\") " pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:30.125349 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.125183 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-90935-predictor-6796f8c7b4-7dvvg\" (UID: \"a77b89c6-321e-4133-8d02-8e9ae3f69184\") " pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:30.125349 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.125227 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a77b89c6-321e-4133-8d02-8e9ae3f69184-proxy-tls\") pod \"error-404-isvc-90935-predictor-6796f8c7b4-7dvvg\" (UID: \"a77b89c6-321e-4133-8d02-8e9ae3f69184\") " pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:30.125985 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.125960 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-90935-predictor-6796f8c7b4-7dvvg\" (UID: \"a77b89c6-321e-4133-8d02-8e9ae3f69184\") " pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:30.127625 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.127599 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a77b89c6-321e-4133-8d02-8e9ae3f69184-proxy-tls\") pod \"error-404-isvc-90935-predictor-6796f8c7b4-7dvvg\" (UID: \"a77b89c6-321e-4133-8d02-8e9ae3f69184\") " pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:30.151211 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.151144 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjvn5\" (UniqueName: \"kubernetes.io/projected/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-api-access-rjvn5\") pod \"error-404-isvc-90935-predictor-6796f8c7b4-7dvvg\" (UID: \"a77b89c6-321e-4133-8d02-8e9ae3f69184\") " pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:30.215202 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.215164 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:30.511237 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.511206 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg"] Oct 30 18:52:30.512578 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:52:30.512552 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77b89c6_321e_4133_8d02_8e9ae3f69184.slice/crio-0d143f3a61fcf8bd49b5278bfdd91bb416eada7ec726a985dee30a67168152c2 WatchSource:0}: Error finding container 0d143f3a61fcf8bd49b5278bfdd91bb416eada7ec726a985dee30a67168152c2: Status 404 returned error can't find the container with id 0d143f3a61fcf8bd49b5278bfdd91bb416eada7ec726a985dee30a67168152c2 Oct 30 18:52:30.907659 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.907576 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" event={"ID":"a77b89c6-321e-4133-8d02-8e9ae3f69184","Type":"ContainerStarted","Data":"5706a96d2aa807ff5841f32604c0b58da027504904055299ae33d2302e149ca6"} Oct 30 18:52:30.907659 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.907633 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" event={"ID":"a77b89c6-321e-4133-8d02-8e9ae3f69184","Type":"ContainerStarted","Data":"d6b68da7e4a85f1eefee1eb7d5d598a2e4a7cbefe06868ce1e66a0b4cf9f0c32"} Oct 30 18:52:30.907659 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.907654 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" event={"ID":"a77b89c6-321e-4133-8d02-8e9ae3f69184","Type":"ContainerStarted","Data":"0d143f3a61fcf8bd49b5278bfdd91bb416eada7ec726a985dee30a67168152c2"} Oct 30 18:52:30.908098 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.907732 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:30.955561 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:30.955502 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" podStartSLOduration=1.955488753 podStartE2EDuration="1.955488753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:52:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:52:30.95421241 +0000 UTC m=+976.183061955" watchObservedRunningTime="2026-10-30 18:52:30.955488753 +0000 UTC m=+976.184338298" Oct 30 18:52:31.912210 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:31.912178 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:31.913576 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:31.913541 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused" Oct 30 18:52:32.916384 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:32.916346 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused" Oct 30 18:52:35.137304 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:35.137268 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:35.317169 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:35.317119 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:37.921051 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:37.921023 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:52:37.921506 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:37.921482 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused" Oct 30 18:52:38.655931 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:38.655891 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:39.652198 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:39.652155 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:52:47.922091 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:47.922050 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused" Oct 30 18:52:53.732040 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:52:53.732005 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:52:57.921456 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:52:57.921399 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused" Oct 30 18:53:02.743465 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:02.743431 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:53:07.921991 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:07.921942 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused" Oct 30 18:53:17.922284 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:17.922237 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused" Oct 30 18:53:23.731985 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:53:23.731946 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:53:27.922215 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:27.922186 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 18:53:39.271474 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.271365 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx"] Oct 30 18:53:39.275034 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.275010 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 18:53:39.293021 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.292993 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-f31293434f\"/\"sequence-graph-90935-serving-cert\"" Oct 30 18:53:39.293021 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.293021 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"sequence-graph-90935-kube-rbac-proxy-sar-config\"" Oct 30 18:53:39.309131 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.309097 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx"] Oct 30 18:53:39.340540 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.340511 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:53:39.417013 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.416970 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8602043f-b522-4116-bbc0-6ba397f2d54c-openshift-service-ca-bundle\") pod \"sequence-graph-90935-695ff6c7f6-q2vnx\" (UID: \"8602043f-b522-4116-bbc0-6ba397f2d54c\") " pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 18:53:39.417185 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.417043 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8602043f-b522-4116-bbc0-6ba397f2d54c-proxy-tls\") pod \"sequence-graph-90935-695ff6c7f6-q2vnx\" (UID: \"8602043f-b522-4116-bbc0-6ba397f2d54c\") " pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 18:53:39.518051 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.518014 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8602043f-b522-4116-bbc0-6ba397f2d54c-proxy-tls\") pod \"sequence-graph-90935-695ff6c7f6-q2vnx\" (UID: \"8602043f-b522-4116-bbc0-6ba397f2d54c\") " pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 18:53:39.518242 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.518074 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8602043f-b522-4116-bbc0-6ba397f2d54c-openshift-service-ca-bundle\") pod \"sequence-graph-90935-695ff6c7f6-q2vnx\" (UID: \"8602043f-b522-4116-bbc0-6ba397f2d54c\") " pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 18:53:39.518702 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.518685 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8602043f-b522-4116-bbc0-6ba397f2d54c-openshift-service-ca-bundle\") pod \"sequence-graph-90935-695ff6c7f6-q2vnx\" (UID: \"8602043f-b522-4116-bbc0-6ba397f2d54c\") " pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 18:53:39.520463 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.520445 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8602043f-b522-4116-bbc0-6ba397f2d54c-proxy-tls\") pod \"sequence-graph-90935-695ff6c7f6-q2vnx\" (UID: \"8602043f-b522-4116-bbc0-6ba397f2d54c\") " pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 18:53:39.587323 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.587235 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 18:53:39.884370 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:39.884339 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx"] Oct 30 18:53:39.885857 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:53:39.885829 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8602043f_b522_4116_bbc0_6ba397f2d54c.slice/crio-49c9bd9896cf659de733a14ea2d019119f58a99b708d360fd070a53f26a8f475 WatchSource:0}: Error finding container 49c9bd9896cf659de733a14ea2d019119f58a99b708d360fd070a53f26a8f475: Status 404 returned error can't find the container with id 49c9bd9896cf659de733a14ea2d019119f58a99b708d360fd070a53f26a8f475 Oct 30 18:53:40.203919 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:40.203881 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" event={"ID":"8602043f-b522-4116-bbc0-6ba397f2d54c","Type":"ContainerStarted","Data":"820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab"} Oct 30 18:53:40.204104 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:40.203938 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" event={"ID":"8602043f-b522-4116-bbc0-6ba397f2d54c","Type":"ContainerStarted","Data":"49c9bd9896cf659de733a14ea2d019119f58a99b708d360fd070a53f26a8f475"} Oct 30 18:53:40.204104 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:40.204015 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 18:53:40.249333 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:40.249280 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" podStartSLOduration=1.249266851 podStartE2EDuration="1.249266851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:53:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:53:40.248452937 +0000 UTC m=+1045.477302482" watchObservedRunningTime="2026-10-30 18:53:40.249266851 +0000 UTC m=+1045.478116438" Oct 30 18:53:41.772036 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:41.772004 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:53:46.214155 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:46.214120 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 18:53:53.731840 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:53:53.731804 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:53:54.547664 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:53:54.547624 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:54:02.876319 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:54:02.876279 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:54:23.734146 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:54:23.734106 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:54:53.733372 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:54:53.733324 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:55:02.980110 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:55:02.980021 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:55:04.097419 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:55:04.097369 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:55:05.154568 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:55:05.154530 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:55:09.642127 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:55:09.642091 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:55:16.170858 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:55:16.170814 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:55:17.154894 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:55:17.154836 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:55:23.732624 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:55:23.732588 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:55:42.594130 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:55:42.594095 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:55:43.562381 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:55:43.562337 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:55:53.732123 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:55:53.732082 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:56:03.105354 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:56:03.105324 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:56:14.979160 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:56:14.979133 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 18:56:14.979641 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:56:14.979190 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 18:56:14.989545 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:56:14.989519 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:56:14.989769 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:56:14.989755 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 18:56:23.735528 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:56:23.735488 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:56:31.651255 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:56:31.651152 4494 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" podUID="0a1141f188cb159776b4a1af048cbc31" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 18:56:53.732168 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:56:53.732133 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:57:03.258174 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:57:03.258129 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:57:23.733241 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:57:23.733198 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:57:53.733248 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:57:53.733202 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:58:03.357528 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:58:03.357444 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:58:23.732371 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:58:23.732335 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:58:53.733238 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:58:53.733190 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:59:03.533967 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:03.533932 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:59:03.584883 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:03.584844 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh"] Oct 30 18:59:03.585142 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:03.585101 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kserve-container" containerID="cri-o://08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b" gracePeriod=30 Oct 30 18:59:03.585237 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:03.585121 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kube-rbac-proxy" containerID="cri-o://06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c" gracePeriod=30 Oct 30 18:59:04.592777 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:04.592744 4494 generic.go:356] "Generic (PLEG): container finished" podID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerID="06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c" exitCode=0 Oct 30 18:59:04.593160 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:04.592815 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" event={"ID":"77a3a878-7b0a-43f4-9204-58d56c6c560b","Type":"ContainerDied","Data":"06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c"} Oct 30 18:59:05.142385 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:05.142333 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused" Oct 30 18:59:05.146643 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:05.146614 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused" Oct 30 18:59:05.277013 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:05.276961 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:59:07.524425 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.524391 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:59:07.558232 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.558200 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-rbac-proxy-sar-config\") pod \"77a3a878-7b0a-43f4-9204-58d56c6c560b\" (UID: \"77a3a878-7b0a-43f4-9204-58d56c6c560b\") " Oct 30 18:59:07.558375 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.558238 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/77a3a878-7b0a-43f4-9204-58d56c6c560b-proxy-tls\" (UniqueName: \"kubernetes.io/secret/77a3a878-7b0a-43f4-9204-58d56c6c560b-proxy-tls\") pod \"77a3a878-7b0a-43f4-9204-58d56c6c560b\" (UID: \"77a3a878-7b0a-43f4-9204-58d56c6c560b\") " Oct 30 18:59:07.558464 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.558391 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-api-access-9srdl\" (UniqueName: \"kubernetes.io/projected/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-api-access-9srdl\") pod \"77a3a878-7b0a-43f4-9204-58d56c6c560b\" (UID: \"77a3a878-7b0a-43f4-9204-58d56c6c560b\") " Oct 30 18:59:07.558678 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.558649 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-rbac-proxy-sar-config" pod "77a3a878-7b0a-43f4-9204-58d56c6c560b" (UID: "77a3a878-7b0a-43f4-9204-58d56c6c560b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 18:59:07.560350 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.560325 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-api-access-9srdl" pod "77a3a878-7b0a-43f4-9204-58d56c6c560b" (UID: "77a3a878-7b0a-43f4-9204-58d56c6c560b"). InnerVolumeSpecName "kube-api-access-9srdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 18:59:07.560350 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.560335 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a3a878-7b0a-43f4-9204-58d56c6c560b-proxy-tls" pod "77a3a878-7b0a-43f4-9204-58d56c6c560b" (UID: "77a3a878-7b0a-43f4-9204-58d56c6c560b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 18:59:07.607554 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.607519 4494 generic.go:356] "Generic (PLEG): container finished" podID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerID="08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b" exitCode=0 Oct 30 18:59:07.607692 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.607567 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" Oct 30 18:59:07.607692 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.607585 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" event={"ID":"77a3a878-7b0a-43f4-9204-58d56c6c560b","Type":"ContainerDied","Data":"08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b"} Oct 30 18:59:07.607692 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.607637 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh" event={"ID":"77a3a878-7b0a-43f4-9204-58d56c6c560b","Type":"ContainerDied","Data":"0bba2fc10eb08f9c91c94fc5c1ded968d9d7db5ed3873bc686bd14d5a1e90f8a"} Oct 30 18:59:07.607692 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.607662 4494 scope.go:122] "RemoveContainer" containerID="06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c" Oct 30 18:59:07.618682 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.618659 4494 scope.go:122] "RemoveContainer" containerID="08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b" Oct 30 18:59:07.627017 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.626996 4494 scope.go:122] "RemoveContainer" containerID="06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c" Oct 30 18:59:07.627312 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:59:07.627292 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c\": container with ID starting with 06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c not found: ID does not exist" containerID="06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c" Oct 30 18:59:07.627365 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.627322 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c"} err="failed to get container status \"06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c\": rpc error: code = NotFound desc = could not find container \"06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c\": container with ID starting with 06433f31ca278db70420543d760345090a221922004c2f715a7b8454a06ec31c not found: ID does not exist" Oct 30 18:59:07.627365 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.627340 4494 scope.go:122] "RemoveContainer" containerID="08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b" Oct 30 18:59:07.627600 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:59:07.627579 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b\": container with ID starting with 08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b not found: ID does not exist" containerID="08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b" Oct 30 18:59:07.627708 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.627603 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b"} err="failed to get container status \"08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b\": rpc error: code = NotFound desc = could not find container \"08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b\": container with ID starting with 08fc988af8c3a258fb566099e24ea1de9eeaf963126598ec57d164f452cfe08b not found: ID does not exist" Oct 30 18:59:07.659278 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.659194 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9srdl\" (UniqueName: \"kubernetes.io/projected/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-api-access-9srdl\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:59:07.659278 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.659222 4494 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77a3a878-7b0a-43f4-9204-58d56c6c560b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:59:07.659278 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.659234 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77a3a878-7b0a-43f4-9204-58d56c6c560b-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 18:59:07.668121 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.668091 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh"] Oct 30 18:59:07.674143 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:07.674109 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-d7605-predictor-6d6c4f6864-b52xh"] Oct 30 18:59:08.885228 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:08.885197 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" path="/var/lib/kubelet/pods/77a3a878-7b0a-43f4-9204-58d56c6c560b/volumes" Oct 30 18:59:08.925479 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:08.925451 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:59:09.120637 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.120605 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:59:09.291319 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.291286 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln"] Oct 30 18:59:09.291767 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.291750 4494 cpu_manager.go:414] "containerMap: removing container" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kube-rbac-proxy" Oct 30 18:59:09.291767 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.291768 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kube-rbac-proxy" Oct 30 18:59:09.291898 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.291782 4494 cpu_manager.go:414] "containerMap: removing container" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kserve-container" Oct 30 18:59:09.291898 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.291787 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kserve-container" Oct 30 18:59:09.291898 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.291853 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kube-rbac-proxy" Oct 30 18:59:09.291898 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.291862 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="77a3a878-7b0a-43f4-9204-58d56c6c560b" containerName="kserve-container" Oct 30 18:59:09.296153 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.296135 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:09.318312 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.318287 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"error-404-isvc-15982-kube-rbac-proxy-sar-config\"" Oct 30 18:59:09.318473 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.318454 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"kube-root-ca.crt\"" Oct 30 18:59:09.339440 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.339394 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-89b2ccc844\"/\"error-404-isvc-15982-predictor-serving-cert\"" Oct 30 18:59:09.340760 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.340740 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln"] Oct 30 18:59:09.343719 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.343686 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:59:09.374657 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.374624 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-15982-predictor-5976db8dbb-ff7ln\" (UID: \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:09.374802 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.374685 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-proxy-tls\") pod \"error-404-isvc-15982-predictor-5976db8dbb-ff7ln\" (UID: \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:09.374848 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.374820 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhx4k\" (UniqueName: \"kubernetes.io/projected/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-api-access-nhx4k\") pod \"error-404-isvc-15982-predictor-5976db8dbb-ff7ln\" (UID: \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:09.475463 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.475397 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhx4k\" (UniqueName: \"kubernetes.io/projected/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-api-access-nhx4k\") pod \"error-404-isvc-15982-predictor-5976db8dbb-ff7ln\" (UID: \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:09.475631 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.475480 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-15982-predictor-5976db8dbb-ff7ln\" (UID: \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:09.475631 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.475554 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-proxy-tls\") pod \"error-404-isvc-15982-predictor-5976db8dbb-ff7ln\" (UID: \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:09.476141 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.476116 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-15982-predictor-5976db8dbb-ff7ln\" (UID: \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:09.478042 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.478017 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-proxy-tls\") pod \"error-404-isvc-15982-predictor-5976db8dbb-ff7ln\" (UID: \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:09.502561 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.502527 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhx4k\" (UniqueName: \"kubernetes.io/projected/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-api-access-nhx4k\") pod \"error-404-isvc-15982-predictor-5976db8dbb-ff7ln\" (UID: \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:09.518014 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.517985 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 18:59:09.610131 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.610049 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:09.905321 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:09.905292 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln"] Oct 30 18:59:09.906931 ip-10-0-135-218 kubenswrapper[4494]: W1030 18:59:09.906900 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e9b733_5f7e_4aff_90bd_7a8d17a8ceaf.slice/crio-04e104c9c91916fe38341234b760f25f5e64c3bf63cd184f7929458493941b03 WatchSource:0}: Error finding container 04e104c9c91916fe38341234b760f25f5e64c3bf63cd184f7929458493941b03: Status 404 returned error can't find the container with id 04e104c9c91916fe38341234b760f25f5e64c3bf63cd184f7929458493941b03 Oct 30 18:59:10.623617 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:10.623577 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" event={"ID":"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf","Type":"ContainerStarted","Data":"f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a"} Oct 30 18:59:10.623790 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:10.623660 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" event={"ID":"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf","Type":"ContainerStarted","Data":"0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6"} Oct 30 18:59:10.623790 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:10.623684 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:10.623790 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:10.623703 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" event={"ID":"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf","Type":"ContainerStarted","Data":"04e104c9c91916fe38341234b760f25f5e64c3bf63cd184f7929458493941b03"} Oct 30 18:59:10.623790 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:10.623730 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:10.624843 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:10.624823 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused" Oct 30 18:59:10.674281 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:10.674223 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" podStartSLOduration=1.674208753 podStartE2EDuration="1.674208753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 18:59:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 18:59:10.673662984 +0000 UTC m=+1375.902512532" watchObservedRunningTime="2026-10-30 18:59:10.674208753 +0000 UTC m=+1375.903058298" Oct 30 18:59:11.627670 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:11.627624 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused" Oct 30 18:59:16.631779 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:16.631743 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 18:59:16.632378 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:16.632350 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused" Oct 30 18:59:23.733749 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:59:23.733709 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:59:26.633139 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:26.633098 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused" Oct 30 18:59:36.633149 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:36.633051 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused" Oct 30 18:59:46.632940 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:46.632900 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused" Oct 30 18:59:53.732996 ip-10-0-135-218 kubenswrapper[4494]: E1030 18:59:53.732958 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 18:59:56.632995 ip-10-0-135-218 kubenswrapper[4494]: I1030 18:59:56.632949 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused" Oct 30 19:00:03.763100 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:03.763056 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:00:06.632549 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:06.632519 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 19:00:19.173301 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:19.173255 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:00:19.365804 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:19.365765 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:00:23.733981 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:00:23.733944 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:00:30.047688 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:30.047653 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln"] Oct 30 19:00:30.048143 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:30.047903 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kserve-container" containerID="cri-o://0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6" gracePeriod=30 Oct 30 19:00:30.048143 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:30.047942 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kube-rbac-proxy" containerID="cri-o://f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a" gracePeriod=30 Oct 30 19:00:30.175013 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:30.174984 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:00:30.365252 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:30.365169 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:00:30.969640 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:30.969605 4494 generic.go:356] "Generic (PLEG): container finished" podID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerID="f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a" exitCode=0 Oct 30 19:00:30.969820 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:30.969676 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" event={"ID":"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf","Type":"ContainerDied","Data":"f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a"} Oct 30 19:00:31.628836 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:31.628794 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.35:8643/healthz\": dial tcp 10.134.0.35:8643: connect: connection refused" Oct 30 19:00:33.690099 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.690070 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 19:00:33.716692 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.716656 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-api-access-nhx4k\" (UniqueName: \"kubernetes.io/projected/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-api-access-nhx4k\") pod \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\" (UID: \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\") " Oct 30 19:00:33.716692 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.716700 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-proxy-tls\" (UniqueName: \"kubernetes.io/secret/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-proxy-tls\") pod \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\" (UID: \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\") " Oct 30 19:00:33.716914 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.716754 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-rbac-proxy-sar-config\") pod \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\" (UID: \"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf\") " Oct 30 19:00:33.717188 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.717162 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-rbac-proxy-sar-config" pod "f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" (UID: "f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:00:33.718839 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.718811 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-proxy-tls" pod "f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" (UID: "f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:00:33.718949 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.718932 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-api-access-nhx4k" pod "f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" (UID: "f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf"). InnerVolumeSpecName "kube-api-access-nhx4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 19:00:33.818000 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.817915 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhx4k\" (UniqueName: \"kubernetes.io/projected/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-api-access-nhx4k\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:00:33.818000 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.817943 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:00:33.818000 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.817953 4494 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:00:33.984089 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.984056 4494 generic.go:356] "Generic (PLEG): container finished" podID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerID="0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6" exitCode=0 Oct 30 19:00:33.984288 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.984114 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" event={"ID":"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf","Type":"ContainerDied","Data":"0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6"} Oct 30 19:00:33.984288 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.984157 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" event={"ID":"f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf","Type":"ContainerDied","Data":"04e104c9c91916fe38341234b760f25f5e64c3bf63cd184f7929458493941b03"} Oct 30 19:00:33.984288 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.984181 4494 scope.go:122] "RemoveContainer" containerID="f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a" Oct 30 19:00:33.984288 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.984114 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln" Oct 30 19:00:33.993200 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:33.993175 4494 scope.go:122] "RemoveContainer" containerID="0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6" Oct 30 19:00:34.001086 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:34.001057 4494 scope.go:122] "RemoveContainer" containerID="f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a" Oct 30 19:00:34.001452 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:00:34.001423 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a\": container with ID starting with f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a not found: ID does not exist" containerID="f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a" Oct 30 19:00:34.001558 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:34.001456 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a"} err="failed to get container status \"f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a\": rpc error: code = NotFound desc = could not find container \"f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a\": container with ID starting with f49c5abd5c3bf0d50d3e0b93e6c8b6b13cc30265aa2588d535c86e1c831edf0a not found: ID does not exist" Oct 30 19:00:34.001558 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:34.001475 4494 scope.go:122] "RemoveContainer" containerID="0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6" Oct 30 19:00:34.001774 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:00:34.001749 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6\": container with ID starting with 0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6 not found: ID does not exist" containerID="0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6" Oct 30 19:00:34.001842 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:34.001785 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6"} err="failed to get container status \"0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6\": rpc error: code = NotFound desc = could not find container \"0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6\": container with ID starting with 0bf1a374e3c37940fc4629357429f096079436c20a50cdf0471a2ca6cbd244d6 not found: ID does not exist" Oct 30 19:00:34.043219 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:34.043180 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln"] Oct 30 19:00:34.057996 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:34.057954 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-15982-predictor-5976db8dbb-ff7ln"] Oct 30 19:00:34.885895 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:34.885860 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" path="/var/lib/kubelet/pods/f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf/volumes" Oct 30 19:00:37.550683 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.550637 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:00:37.733298 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.733259 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:00:37.953961 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.953929 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf"] Oct 30 19:00:37.954308 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.954295 4494 cpu_manager.go:414] "containerMap: removing container" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kube-rbac-proxy" Oct 30 19:00:37.954368 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.954310 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kube-rbac-proxy" Oct 30 19:00:37.954368 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.954362 4494 cpu_manager.go:414] "containerMap: removing container" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kserve-container" Oct 30 19:00:37.954468 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.954370 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kserve-container" Oct 30 19:00:37.954503 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.954473 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kserve-container" Oct 30 19:00:37.954503 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.954487 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9e9b733-5f7e-4aff-90bd-7a8d17a8ceaf" containerName="kube-rbac-proxy" Oct 30 19:00:37.957975 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.957958 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:37.965659 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.965634 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:00:37.994119 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.994081 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"kube-root-ca.crt\"" Oct 30 19:00:37.994119 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.994103 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-89b2ccc844\"/\"error-404-isvc-08863-predictor-serving-cert\"" Oct 30 19:00:37.994119 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.994093 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"error-404-isvc-08863-kube-rbac-proxy-sar-config\"" Oct 30 19:00:37.995595 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:37.995572 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf"] Oct 30 19:00:38.053003 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:38.052968 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjszd\" (UniqueName: \"kubernetes.io/projected/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-api-access-gjszd\") pod \"error-404-isvc-08863-predictor-d696dcf74-q7pkf\" (UID: \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:38.053182 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:38.053013 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-08863-predictor-d696dcf74-q7pkf\" (UID: \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:38.053182 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:38.053110 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-proxy-tls\") pod \"error-404-isvc-08863-predictor-d696dcf74-q7pkf\" (UID: \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:38.142312 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:38.142277 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:00:38.154520 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:38.154491 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjszd\" (UniqueName: \"kubernetes.io/projected/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-api-access-gjszd\") pod \"error-404-isvc-08863-predictor-d696dcf74-q7pkf\" (UID: \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:38.154613 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:38.154533 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-08863-predictor-d696dcf74-q7pkf\" (UID: \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:38.154613 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:38.154584 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-proxy-tls\") pod \"error-404-isvc-08863-predictor-d696dcf74-q7pkf\" (UID: \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:38.155191 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:38.155172 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-08863-predictor-d696dcf74-q7pkf\" (UID: \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:38.157142 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:38.157117 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-proxy-tls\") pod \"error-404-isvc-08863-predictor-d696dcf74-q7pkf\" (UID: \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:38.183421 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:38.183383 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjszd\" (UniqueName: \"kubernetes.io/projected/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-api-access-gjszd\") pod \"error-404-isvc-08863-predictor-d696dcf74-q7pkf\" (UID: \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:38.273735 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:38.273639 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:38.570255 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:38.570226 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf"] Oct 30 19:00:38.572137 ip-10-0-135-218 kubenswrapper[4494]: W1030 19:00:38.572109 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ce5680_a3f6_49f1_bd91_596f00c1fe56.slice/crio-ac0227d063339852f521b0892d7a69a29a82aeb4e2a6c482783def026018f915 WatchSource:0}: Error finding container ac0227d063339852f521b0892d7a69a29a82aeb4e2a6c482783def026018f915: Status 404 returned error can't find the container with id ac0227d063339852f521b0892d7a69a29a82aeb4e2a6c482783def026018f915 Oct 30 19:00:39.007169 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:39.007128 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" event={"ID":"f4ce5680-a3f6-49f1-bd91-596f00c1fe56","Type":"ContainerStarted","Data":"8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c"} Oct 30 19:00:39.007363 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:39.007185 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" event={"ID":"f4ce5680-a3f6-49f1-bd91-596f00c1fe56","Type":"ContainerStarted","Data":"75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77"} Oct 30 19:00:39.007363 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:39.007210 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:39.007363 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:39.007228 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" event={"ID":"f4ce5680-a3f6-49f1-bd91-596f00c1fe56","Type":"ContainerStarted","Data":"ac0227d063339852f521b0892d7a69a29a82aeb4e2a6c482783def026018f915"} Oct 30 19:00:39.007363 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:39.007265 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:39.008669 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:39.008643 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused" Oct 30 19:00:39.056674 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:39.056622 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" podStartSLOduration=2.056608709 podStartE2EDuration="2.056608709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:00:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:00:39.055361791 +0000 UTC m=+1464.284211337" watchObservedRunningTime="2026-10-30 19:00:39.056608709 +0000 UTC m=+1464.285458255" Oct 30 19:00:40.011397 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:40.011354 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused" Oct 30 19:00:45.016135 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:45.016103 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:00:45.016603 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:45.016504 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused" Oct 30 19:00:47.451335 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:47.451299 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:00:53.732949 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:00:53.732909 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:00:55.016785 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:00:55.016739 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused" Oct 30 19:01:03.733488 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:03.733448 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:01:05.017543 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:05.017505 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused" Oct 30 19:01:15.006812 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:15.006781 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:01:15.008375 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:15.008350 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:01:15.016486 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:15.016459 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused" Oct 30 19:01:15.017015 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:15.016995 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:01:15.018534 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:15.018516 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:01:23.733079 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:01:23.733040 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:01:25.017384 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:25.017341 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused" Oct 30 19:01:35.017064 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:35.017037 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:01:47.760819 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:47.760781 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:01:47.939841 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:47.939805 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:01:53.732698 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:01:53.732655 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:01:55.434294 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:55.434263 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg"] Oct 30 19:01:55.434689 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:55.434515 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kube-rbac-proxy" containerID="cri-o://5706a96d2aa807ff5841f32604c0b58da027504904055299ae33d2302e149ca6" gracePeriod=30 Oct 30 19:01:55.434689 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:55.434513 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kserve-container" containerID="cri-o://d6b68da7e4a85f1eefee1eb7d5d598a2e4a7cbefe06868ce1e66a0b4cf9f0c32" gracePeriod=30 Oct 30 19:01:55.584207 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:55.584175 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:01:55.824869 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:55.824792 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:01:56.350194 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:56.350163 4494 generic.go:356] "Generic (PLEG): container finished" podID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerID="5706a96d2aa807ff5841f32604c0b58da027504904055299ae33d2302e149ca6" exitCode=0 Oct 30 19:01:56.350364 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:56.350216 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" event={"ID":"a77b89c6-321e-4133-8d02-8e9ae3f69184","Type":"ContainerDied","Data":"5706a96d2aa807ff5841f32604c0b58da027504904055299ae33d2302e149ca6"} Oct 30 19:01:57.917526 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:57.917492 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.33:8643/healthz\": dial tcp 10.134.0.33:8643: connect: connection refused" Oct 30 19:01:57.921742 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:57.921720 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused" Oct 30 19:01:58.361798 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:58.361769 4494 generic.go:356] "Generic (PLEG): container finished" podID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerID="d6b68da7e4a85f1eefee1eb7d5d598a2e4a7cbefe06868ce1e66a0b4cf9f0c32" exitCode=0 Oct 30 19:01:58.361934 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:58.361838 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" event={"ID":"a77b89c6-321e-4133-8d02-8e9ae3f69184","Type":"ContainerDied","Data":"d6b68da7e4a85f1eefee1eb7d5d598a2e4a7cbefe06868ce1e66a0b4cf9f0c32"} Oct 30 19:01:58.482083 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:58.482057 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 19:01:58.651364 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:58.651273 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-rbac-proxy-sar-config\") pod \"a77b89c6-321e-4133-8d02-8e9ae3f69184\" (UID: \"a77b89c6-321e-4133-8d02-8e9ae3f69184\") " Oct 30 19:01:58.651364 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:58.651316 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a77b89c6-321e-4133-8d02-8e9ae3f69184-proxy-tls\" (UniqueName: \"kubernetes.io/secret/a77b89c6-321e-4133-8d02-8e9ae3f69184-proxy-tls\") pod \"a77b89c6-321e-4133-8d02-8e9ae3f69184\" (UID: \"a77b89c6-321e-4133-8d02-8e9ae3f69184\") " Oct 30 19:01:58.651616 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:58.651389 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-api-access-rjvn5\" (UniqueName: \"kubernetes.io/projected/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-api-access-rjvn5\") pod \"a77b89c6-321e-4133-8d02-8e9ae3f69184\" (UID: \"a77b89c6-321e-4133-8d02-8e9ae3f69184\") " Oct 30 19:01:58.651761 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:58.651734 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-rbac-proxy-sar-config" pod "a77b89c6-321e-4133-8d02-8e9ae3f69184" (UID: "a77b89c6-321e-4133-8d02-8e9ae3f69184"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:01:58.653456 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:58.653429 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a77b89c6-321e-4133-8d02-8e9ae3f69184-proxy-tls" pod "a77b89c6-321e-4133-8d02-8e9ae3f69184" (UID: "a77b89c6-321e-4133-8d02-8e9ae3f69184"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:01:58.653456 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:58.653450 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-api-access-rjvn5" pod "a77b89c6-321e-4133-8d02-8e9ae3f69184" (UID: "a77b89c6-321e-4133-8d02-8e9ae3f69184"). InnerVolumeSpecName "kube-api-access-rjvn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 19:01:58.752624 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:58.752580 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjvn5\" (UniqueName: \"kubernetes.io/projected/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-api-access-rjvn5\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:01:58.752624 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:58.752616 4494 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a77b89c6-321e-4133-8d02-8e9ae3f69184-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:01:58.752624 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:58.752629 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a77b89c6-321e-4133-8d02-8e9ae3f69184-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:01:59.367672 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:59.367643 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" Oct 30 19:01:59.367672 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:59.367659 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg" event={"ID":"a77b89c6-321e-4133-8d02-8e9ae3f69184","Type":"ContainerDied","Data":"0d143f3a61fcf8bd49b5278bfdd91bb416eada7ec726a985dee30a67168152c2"} Oct 30 19:01:59.368189 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:59.367749 4494 scope.go:122] "RemoveContainer" containerID="5706a96d2aa807ff5841f32604c0b58da027504904055299ae33d2302e149ca6" Oct 30 19:01:59.376024 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:59.376006 4494 scope.go:122] "RemoveContainer" containerID="d6b68da7e4a85f1eefee1eb7d5d598a2e4a7cbefe06868ce1e66a0b4cf9f0c32" Oct 30 19:01:59.430318 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:59.430292 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg"] Oct 30 19:01:59.444948 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:01:59.444921 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-90935-predictor-6796f8c7b4-7dvvg"] Oct 30 19:02:00.882814 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:00.882770 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:02:00.885870 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:00.885840 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" path="/var/lib/kubelet/pods/a77b89c6-321e-4133-8d02-8e9ae3f69184/volumes" Oct 30 19:02:01.060780 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.060749 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:02:01.269935 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.269904 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb"] Oct 30 19:02:01.270276 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.270263 4494 cpu_manager.go:414] "containerMap: removing container" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kserve-container" Oct 30 19:02:01.270321 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.270277 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kserve-container" Oct 30 19:02:01.270321 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.270286 4494 cpu_manager.go:414] "containerMap: removing container" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kube-rbac-proxy" Oct 30 19:02:01.270321 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.270291 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kube-rbac-proxy" Oct 30 19:02:01.270440 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.270365 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kserve-container" Oct 30 19:02:01.270440 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.270372 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="a77b89c6-321e-4133-8d02-8e9ae3f69184" containerName="kube-rbac-proxy" Oct 30 19:02:01.274834 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.274811 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:01.275044 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.275019 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:02:01.293698 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.293680 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"error-404-isvc-16b13-kube-rbac-proxy-sar-config\"" Oct 30 19:02:01.308928 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.308906 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-f31293434f\"/\"error-404-isvc-16b13-predictor-serving-cert\"" Oct 30 19:02:01.309009 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.308962 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"kube-root-ca.crt\"" Oct 30 19:02:01.310847 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.310828 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb"] Oct 30 19:02:01.374644 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.374621 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-16b13-predictor-69fc8cd474-jrkjb\" (UID: \"6f6b16c0-708b-4362-8bf0-156a9c785378\") " pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:01.374725 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.374669 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvh4w\" (UniqueName: \"kubernetes.io/projected/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-api-access-qvh4w\") pod \"error-404-isvc-16b13-predictor-69fc8cd474-jrkjb\" (UID: \"6f6b16c0-708b-4362-8bf0-156a9c785378\") " pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:01.374854 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.374837 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f6b16c0-708b-4362-8bf0-156a9c785378-proxy-tls\") pod \"error-404-isvc-16b13-predictor-69fc8cd474-jrkjb\" (UID: \"6f6b16c0-708b-4362-8bf0-156a9c785378\") " pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:01.475891 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.475869 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f6b16c0-708b-4362-8bf0-156a9c785378-proxy-tls\") pod \"error-404-isvc-16b13-predictor-69fc8cd474-jrkjb\" (UID: \"6f6b16c0-708b-4362-8bf0-156a9c785378\") " pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:01.475992 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.475900 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-16b13-predictor-69fc8cd474-jrkjb\" (UID: \"6f6b16c0-708b-4362-8bf0-156a9c785378\") " pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:01.475992 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.475920 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvh4w\" (UniqueName: \"kubernetes.io/projected/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-api-access-qvh4w\") pod \"error-404-isvc-16b13-predictor-69fc8cd474-jrkjb\" (UID: \"6f6b16c0-708b-4362-8bf0-156a9c785378\") " pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:01.476508 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.476487 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-16b13-predictor-69fc8cd474-jrkjb\" (UID: \"6f6b16c0-708b-4362-8bf0-156a9c785378\") " pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:01.478314 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.478292 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f6b16c0-708b-4362-8bf0-156a9c785378-proxy-tls\") pod \"error-404-isvc-16b13-predictor-69fc8cd474-jrkjb\" (UID: \"6f6b16c0-708b-4362-8bf0-156a9c785378\") " pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:01.503581 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.503559 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvh4w\" (UniqueName: \"kubernetes.io/projected/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-api-access-qvh4w\") pod \"error-404-isvc-16b13-predictor-69fc8cd474-jrkjb\" (UID: \"6f6b16c0-708b-4362-8bf0-156a9c785378\") " pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:01.588613 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.588558 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:01.595592 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.595566 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:02:01.882102 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:01.882078 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb"] Oct 30 19:02:01.883277 ip-10-0-135-218 kubenswrapper[4494]: W1030 19:02:01.883249 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6b16c0_708b_4362_8bf0_156a9c785378.slice/crio-ea5e2c9a842c10150303f584865b2844739b24d3864634f2ed878cc9511f287b WatchSource:0}: Error finding container ea5e2c9a842c10150303f584865b2844739b24d3864634f2ed878cc9511f287b: Status 404 returned error can't find the container with id ea5e2c9a842c10150303f584865b2844739b24d3864634f2ed878cc9511f287b Oct 30 19:02:02.382941 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:02.382910 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" event={"ID":"6f6b16c0-708b-4362-8bf0-156a9c785378","Type":"ContainerStarted","Data":"e579a7b94aaa8ada646ba68dc041dae39ec592acc5a20352642dc0d9f2e93146"} Oct 30 19:02:02.383125 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:02.382967 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" event={"ID":"6f6b16c0-708b-4362-8bf0-156a9c785378","Type":"ContainerStarted","Data":"30536b02f376b46fdde37a0aaf3046f3d6374d44dca8fec429eda79db04b1324"} Oct 30 19:02:02.383125 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:02.382992 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:02.383125 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:02.383012 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" event={"ID":"6f6b16c0-708b-4362-8bf0-156a9c785378","Type":"ContainerStarted","Data":"ea5e2c9a842c10150303f584865b2844739b24d3864634f2ed878cc9511f287b"} Oct 30 19:02:02.430166 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:02.430116 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" podStartSLOduration=1.430105119 podStartE2EDuration="1.430105119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:02:02.429844403 +0000 UTC m=+1547.658693948" watchObservedRunningTime="2026-10-30 19:02:02.430105119 +0000 UTC m=+1547.658954664" Oct 30 19:02:03.387104 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:03.387069 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:03.388670 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:03.388643 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused" Oct 30 19:02:03.874798 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:03.874764 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:02:04.392378 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:04.392341 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused" Oct 30 19:02:09.397103 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:09.397073 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:02:09.397580 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:09.397515 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused" Oct 30 19:02:19.398474 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:19.398434 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused" Oct 30 19:02:23.734326 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:02:23.734282 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:02:29.398636 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:29.398542 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused" Oct 30 19:02:39.397498 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:39.397460 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused" Oct 30 19:02:49.398512 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:49.398476 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused" Oct 30 19:02:53.732709 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:02:53.732674 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:02:59.398035 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:02:59.398004 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:03:05.740961 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:05.740924 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:09.855302 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:09.855263 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:10.955290 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:10.955257 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:11.131545 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:11.131510 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:22.197776 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:22.197730 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb"] Oct 30 19:03:22.198264 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:22.198020 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kserve-container" containerID="cri-o://30536b02f376b46fdde37a0aaf3046f3d6374d44dca8fec429eda79db04b1324" gracePeriod=30 Oct 30 19:03:22.198264 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:22.198101 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kube-rbac-proxy" containerID="cri-o://e579a7b94aaa8ada646ba68dc041dae39ec592acc5a20352642dc0d9f2e93146" gracePeriod=30 Oct 30 19:03:22.319066 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:22.319015 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:22.519377 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:22.519275 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:22.731028 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:22.730993 4494 generic.go:356] "Generic (PLEG): container finished" podID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerID="e579a7b94aaa8ada646ba68dc041dae39ec592acc5a20352642dc0d9f2e93146" exitCode=0 Oct 30 19:03:22.731198 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:22.731070 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" event={"ID":"6f6b16c0-708b-4362-8bf0-156a9c785378","Type":"ContainerDied","Data":"e579a7b94aaa8ada646ba68dc041dae39ec592acc5a20352642dc0d9f2e93146"} Oct 30 19:03:23.733230 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:03:23.733194 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:03:24.393031 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:24.392983 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.37:8643/healthz\": dial tcp 10.134.0.37:8643: connect: connection refused" Oct 30 19:03:25.747840 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:25.747807 4494 generic.go:356] "Generic (PLEG): container finished" podID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerID="30536b02f376b46fdde37a0aaf3046f3d6374d44dca8fec429eda79db04b1324" exitCode=0 Oct 30 19:03:25.748241 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:25.747880 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" event={"ID":"6f6b16c0-708b-4362-8bf0-156a9c785378","Type":"ContainerDied","Data":"30536b02f376b46fdde37a0aaf3046f3d6374d44dca8fec429eda79db04b1324"} Oct 30 19:03:25.853464 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:25.853436 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:03:25.982797 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:25.982705 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-api-access-qvh4w\" (UniqueName: \"kubernetes.io/projected/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-api-access-qvh4w\") pod \"6f6b16c0-708b-4362-8bf0-156a9c785378\" (UID: \"6f6b16c0-708b-4362-8bf0-156a9c785378\") " Oct 30 19:03:25.982797 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:25.982781 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-rbac-proxy-sar-config\") pod \"6f6b16c0-708b-4362-8bf0-156a9c785378\" (UID: \"6f6b16c0-708b-4362-8bf0-156a9c785378\") " Oct 30 19:03:25.982995 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:25.982896 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f6b16c0-708b-4362-8bf0-156a9c785378-proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f6b16c0-708b-4362-8bf0-156a9c785378-proxy-tls\") pod \"6f6b16c0-708b-4362-8bf0-156a9c785378\" (UID: \"6f6b16c0-708b-4362-8bf0-156a9c785378\") " Oct 30 19:03:25.983153 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:25.983130 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-rbac-proxy-sar-config" pod "6f6b16c0-708b-4362-8bf0-156a9c785378" (UID: "6f6b16c0-708b-4362-8bf0-156a9c785378"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:03:25.985018 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:25.984994 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6b16c0-708b-4362-8bf0-156a9c785378-proxy-tls" pod "6f6b16c0-708b-4362-8bf0-156a9c785378" (UID: "6f6b16c0-708b-4362-8bf0-156a9c785378"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:03:25.985018 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:25.985010 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-api-access-qvh4w" pod "6f6b16c0-708b-4362-8bf0-156a9c785378" (UID: "6f6b16c0-708b-4362-8bf0-156a9c785378"). InnerVolumeSpecName "kube-api-access-qvh4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 19:03:26.083641 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:26.083599 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvh4w\" (UniqueName: \"kubernetes.io/projected/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-api-access-qvh4w\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:03:26.083641 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:26.083635 4494 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6f6b16c0-708b-4362-8bf0-156a9c785378-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:03:26.083641 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:26.083648 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6f6b16c0-708b-4362-8bf0-156a9c785378-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:03:26.754528 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:26.754496 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" Oct 30 19:03:26.754528 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:26.754513 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb" event={"ID":"6f6b16c0-708b-4362-8bf0-156a9c785378","Type":"ContainerDied","Data":"ea5e2c9a842c10150303f584865b2844739b24d3864634f2ed878cc9511f287b"} Oct 30 19:03:26.755014 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:26.754573 4494 scope.go:122] "RemoveContainer" containerID="e579a7b94aaa8ada646ba68dc041dae39ec592acc5a20352642dc0d9f2e93146" Oct 30 19:03:26.763867 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:26.763848 4494 scope.go:122] "RemoveContainer" containerID="30536b02f376b46fdde37a0aaf3046f3d6374d44dca8fec429eda79db04b1324" Oct 30 19:03:26.813905 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:26.813874 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb"] Oct 30 19:03:26.828443 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:26.828386 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-16b13-predictor-69fc8cd474-jrkjb"] Oct 30 19:03:26.886205 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:26.886163 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" path="/var/lib/kubelet/pods/6f6b16c0-708b-4362-8bf0-156a9c785378/volumes" Oct 30 19:03:27.704340 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:27.704289 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:27.880645 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:27.880609 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:28.394530 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.394496 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7"] Oct 30 19:03:28.394946 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.394928 4494 cpu_manager.go:414] "containerMap: removing container" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kserve-container" Oct 30 19:03:28.395031 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.394947 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kserve-container" Oct 30 19:03:28.395031 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.394993 4494 cpu_manager.go:414] "containerMap: removing container" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kube-rbac-proxy" Oct 30 19:03:28.395031 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.395001 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kube-rbac-proxy" Oct 30 19:03:28.395188 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.395091 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kube-rbac-proxy" Oct 30 19:03:28.395188 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.395107 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f6b16c0-708b-4362-8bf0-156a9c785378" containerName="kserve-container" Oct 30 19:03:28.399918 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.399894 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:28.402313 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.402265 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:28.421110 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.421081 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7"] Oct 30 19:03:28.433958 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.433920 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-f31293434f\"/\"error-404-isvc-59ec6-predictor-serving-cert\"" Oct 30 19:03:28.433958 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.433919 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"error-404-isvc-59ec6-kube-rbac-proxy-sar-config\"" Oct 30 19:03:28.434215 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.434041 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"kube-root-ca.crt\"" Oct 30 19:03:28.504311 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.504268 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dba0f68d-4bf3-4c0e-889f-d4921860ffab-proxy-tls\") pod \"error-404-isvc-59ec6-predictor-7b488786c6-4kbk7\" (UID: \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\") " pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:28.504311 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.504307 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-59ec6-predictor-7b488786c6-4kbk7\" (UID: \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\") " pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:28.504599 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.504509 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxswl\" (UniqueName: \"kubernetes.io/projected/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-api-access-sxswl\") pod \"error-404-isvc-59ec6-predictor-7b488786c6-4kbk7\" (UID: \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\") " pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:28.605710 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.605666 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxswl\" (UniqueName: \"kubernetes.io/projected/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-api-access-sxswl\") pod \"error-404-isvc-59ec6-predictor-7b488786c6-4kbk7\" (UID: \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\") " pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:28.605923 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.605729 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dba0f68d-4bf3-4c0e-889f-d4921860ffab-proxy-tls\") pod \"error-404-isvc-59ec6-predictor-7b488786c6-4kbk7\" (UID: \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\") " pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:28.605923 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.605753 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-59ec6-predictor-7b488786c6-4kbk7\" (UID: \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\") " pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:28.606440 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.606396 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-59ec6-predictor-7b488786c6-4kbk7\" (UID: \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\") " pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:28.608168 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.608145 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dba0f68d-4bf3-4c0e-889f-d4921860ffab-proxy-tls\") pod \"error-404-isvc-59ec6-predictor-7b488786c6-4kbk7\" (UID: \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\") " pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:28.631969 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.631928 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxswl\" (UniqueName: \"kubernetes.io/projected/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-api-access-sxswl\") pod \"error-404-isvc-59ec6-predictor-7b488786c6-4kbk7\" (UID: \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\") " pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:28.688486 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.688452 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:28.715080 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:28.715043 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:29.014529 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:29.014503 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7"] Oct 30 19:03:29.017160 ip-10-0-135-218 kubenswrapper[4494]: W1030 19:03:29.017128 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba0f68d_4bf3_4c0e_889f_d4921860ffab.slice/crio-06a4577e62382eba85371ebeed504239ecd33eb713de560136bb6fef9cb671c5 WatchSource:0}: Error finding container 06a4577e62382eba85371ebeed504239ecd33eb713de560136bb6fef9cb671c5: Status 404 returned error can't find the container with id 06a4577e62382eba85371ebeed504239ecd33eb713de560136bb6fef9cb671c5 Oct 30 19:03:29.771370 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:29.771331 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" event={"ID":"dba0f68d-4bf3-4c0e-889f-d4921860ffab","Type":"ContainerStarted","Data":"36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f"} Oct 30 19:03:29.771583 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:29.771392 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" event={"ID":"dba0f68d-4bf3-4c0e-889f-d4921860ffab","Type":"ContainerStarted","Data":"fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca"} Oct 30 19:03:29.771583 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:29.771484 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" event={"ID":"dba0f68d-4bf3-4c0e-889f-d4921860ffab","Type":"ContainerStarted","Data":"06a4577e62382eba85371ebeed504239ecd33eb713de560136bb6fef9cb671c5"} Oct 30 19:03:29.771583 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:29.771511 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:29.771583 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:29.771531 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:29.773042 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:29.773012 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused" Oct 30 19:03:29.818031 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:29.817971 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" podStartSLOduration=1.8179528409999999 podStartE2EDuration="1.817952841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:03:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:03:29.817693917 +0000 UTC m=+1635.046543461" watchObservedRunningTime="2026-10-30 19:03:29.817952841 +0000 UTC m=+1635.046802389" Oct 30 19:03:30.776106 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:30.776068 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused" Oct 30 19:03:35.780663 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:35.780630 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:03:35.781161 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:35.781135 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused" Oct 30 19:03:39.649815 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:39.649783 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:40.621615 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:40.621558 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:45.781287 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:45.781244 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused" Oct 30 19:03:53.733495 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:03:53.733459 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:03:55.781434 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:55.781379 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused" Oct 30 19:03:57.175516 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:57.175483 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:03:58.149508 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:03:58.149475 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:04:04.103743 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:04:04.103655 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:04:05.781817 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:04:05.781771 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused" Oct 30 19:04:15.782054 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:04:15.782015 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused" Oct 30 19:04:23.733113 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:04:23.733077 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:04:25.782134 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:04:25.782105 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:04:37.879635 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:04:37.879594 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:04:39.593016 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:04:39.592985 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:04:53.732813 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:04:53.732776 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:05:04.224692 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:05:04.224649 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:05:23.734061 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:05:23.734021 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:05:39.686848 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:05:39.686811 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:05:53.732770 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:05:53.732732 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:05:55.712032 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:05:55.711997 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:06:04.358360 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:06:04.358314 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:06:15.035424 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:06:15.035381 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:06:15.037728 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:06:15.037708 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:06:15.045187 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:06:15.045163 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:06:15.047590 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:06:15.047570 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:06:23.733515 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:06:23.733469 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:06:31.650212 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:06:31.650171 4494 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" podUID="0a1141f188cb159776b4a1af048cbc31" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded" Oct 30 19:06:53.733480 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:06:53.733440 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:06:55.834522 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:06:55.834488 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:07:04.488169 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:07:04.488086 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:07:23.736714 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:07:23.736663 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:07:53.734711 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:07:53.734667 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:08:04.628173 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:08:04.628137 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:08:06.562251 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:08:06.562212 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:08:06.973988 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:08:06.973954 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:08:23.735731 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:08:23.735694 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:08:42.887073 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:08:42.886996 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:08:53.734384 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:08:53.734343 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:09:04.728093 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:09:04.728052 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:09:23.734297 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:09:23.734253 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:09:29.425641 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:09:29.425601 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:09:30.700124 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:09:30.700093 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:09:53.734713 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:09:53.734671 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:10:03.248329 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:03.248237 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf"] Oct 30 19:10:03.248904 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:03.248500 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kserve-container" containerID="cri-o://75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77" gracePeriod=30 Oct 30 19:10:03.248904 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:03.248723 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kube-rbac-proxy" containerID="cri-o://8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c" gracePeriod=30 Oct 30 19:10:03.372059 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:03.372031 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:10:03.575693 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:03.575605 4494 generic.go:356] "Generic (PLEG): container finished" podID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerID="8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c" exitCode=0 Oct 30 19:10:03.575693 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:03.575676 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" event={"ID":"f4ce5680-a3f6-49f1-bd91-596f00c1fe56","Type":"ContainerDied","Data":"8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c"} Oct 30 19:10:04.813121 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:04.813077 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:10:05.012057 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:05.012018 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.36:8643/healthz\": dial tcp 10.134.0.36:8643: connect: connection refused" Oct 30 19:10:05.017396 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:05.017366 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused" Oct 30 19:10:06.905388 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:06.905354 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:10:07.058427 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.058310 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-proxy-tls\") pod \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\" (UID: \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\") " Oct 30 19:10:07.058427 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.058366 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-api-access-gjszd\" (UniqueName: \"kubernetes.io/projected/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-api-access-gjszd\") pod \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\" (UID: \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\") " Oct 30 19:10:07.058629 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.058433 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-rbac-proxy-sar-config\") pod \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\" (UID: \"f4ce5680-a3f6-49f1-bd91-596f00c1fe56\") " Oct 30 19:10:07.058891 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.058854 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-rbac-proxy-sar-config" pod "f4ce5680-a3f6-49f1-bd91-596f00c1fe56" (UID: "f4ce5680-a3f6-49f1-bd91-596f00c1fe56"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:10:07.060516 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.060494 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-proxy-tls" pod "f4ce5680-a3f6-49f1-bd91-596f00c1fe56" (UID: "f4ce5680-a3f6-49f1-bd91-596f00c1fe56"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:10:07.060595 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.060536 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-api-access-gjszd" pod "f4ce5680-a3f6-49f1-bd91-596f00c1fe56" (UID: "f4ce5680-a3f6-49f1-bd91-596f00c1fe56"). InnerVolumeSpecName "kube-api-access-gjszd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 19:10:07.159551 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.159509 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:10:07.159551 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.159542 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjszd\" (UniqueName: \"kubernetes.io/projected/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-api-access-gjszd\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:10:07.159551 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.159553 4494 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4ce5680-a3f6-49f1-bd91-596f00c1fe56-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:10:07.594800 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.594760 4494 generic.go:356] "Generic (PLEG): container finished" podID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerID="75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77" exitCode=0 Oct 30 19:10:07.595016 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.594834 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" Oct 30 19:10:07.595016 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.594846 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" event={"ID":"f4ce5680-a3f6-49f1-bd91-596f00c1fe56","Type":"ContainerDied","Data":"75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77"} Oct 30 19:10:07.595016 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.594955 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf" event={"ID":"f4ce5680-a3f6-49f1-bd91-596f00c1fe56","Type":"ContainerDied","Data":"ac0227d063339852f521b0892d7a69a29a82aeb4e2a6c482783def026018f915"} Oct 30 19:10:07.595016 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.594992 4494 scope.go:122] "RemoveContainer" containerID="8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c" Oct 30 19:10:07.604520 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.604495 4494 scope.go:122] "RemoveContainer" containerID="75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77" Oct 30 19:10:07.612471 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.612453 4494 scope.go:122] "RemoveContainer" containerID="8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c" Oct 30 19:10:07.612794 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:10:07.612772 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c\": container with ID starting with 8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c not found: ID does not exist" containerID="8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c" Oct 30 19:10:07.612855 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.612804 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c"} err="failed to get container status \"8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c\": rpc error: code = NotFound desc = could not find container \"8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c\": container with ID starting with 8d26b31f61446d133643b3daa7b1902a068252d24dffd2089de6cbf9277eea9c not found: ID does not exist" Oct 30 19:10:07.612855 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.612824 4494 scope.go:122] "RemoveContainer" containerID="75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77" Oct 30 19:10:07.613128 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:10:07.613109 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77\": container with ID starting with 75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77 not found: ID does not exist" containerID="75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77" Oct 30 19:10:07.613162 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.613136 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77"} err="failed to get container status \"75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77\": rpc error: code = NotFound desc = could not find container \"75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77\": container with ID starting with 75db395d713a1358a4a2e36360fc1ca2d4c2a6e23bdcecc07455c3fc02052c77 not found: ID does not exist" Oct 30 19:10:07.653226 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.653193 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf"] Oct 30 19:10:07.667841 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:07.667805 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-08863-predictor-d696dcf74-q7pkf"] Oct 30 19:10:08.715099 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:08.715067 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:10:08.885370 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:08.885337 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" path="/var/lib/kubelet/pods/f4ce5680-a3f6-49f1-bd91-596f00c1fe56/volumes" Oct 30 19:10:08.890789 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:08.890740 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:10:09.119604 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.119523 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb"] Oct 30 19:10:09.119920 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.119908 4494 cpu_manager.go:414] "containerMap: removing container" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kube-rbac-proxy" Oct 30 19:10:09.119963 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.119921 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kube-rbac-proxy" Oct 30 19:10:09.119963 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.119941 4494 cpu_manager.go:414] "containerMap: removing container" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kserve-container" Oct 30 19:10:09.119963 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.119946 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kserve-container" Oct 30 19:10:09.120054 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.119998 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kube-rbac-proxy" Oct 30 19:10:09.120054 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.120008 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4ce5680-a3f6-49f1-bd91-596f00c1fe56" containerName="kserve-container" Oct 30 19:10:09.123173 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.123147 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:09.125915 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.125887 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:10:09.145317 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.145280 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"error-404-isvc-6c6a7-kube-rbac-proxy-sar-config\"" Oct 30 19:10:09.156204 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.156167 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"kube-root-ca.crt\"" Oct 30 19:10:09.156394 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.156282 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-89b2ccc844\"/\"error-404-isvc-6c6a7-predictor-serving-cert\"" Oct 30 19:10:09.157752 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.157727 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb"] Oct 30 19:10:09.277078 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.277032 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-proxy-tls\") pod \"error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb\" (UID: \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:09.277266 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.277137 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b28k7\" (UniqueName: \"kubernetes.io/projected/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-api-access-b28k7\") pod \"error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb\" (UID: \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:09.277266 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.277203 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb\" (UID: \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:09.300523 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.300492 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:10:09.378018 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.377923 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-proxy-tls\") pod \"error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb\" (UID: \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:09.378018 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.377984 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b28k7\" (UniqueName: \"kubernetes.io/projected/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-api-access-b28k7\") pod \"error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb\" (UID: \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:09.378018 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.378016 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb\" (UID: \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:09.378763 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.378742 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb\" (UID: \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:09.380535 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.380511 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-proxy-tls\") pod \"error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb\" (UID: \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:09.404153 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.404118 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b28k7\" (UniqueName: \"kubernetes.io/projected/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-api-access-b28k7\") pod \"error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb\" (UID: \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:09.438621 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.438587 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:09.742431 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:09.742385 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb"] Oct 30 19:10:09.744837 ip-10-0-135-218 kubenswrapper[4494]: W1030 19:10:09.744808 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59a3a50_3f75_410a_92bb_6d8fd4342ddf.slice/crio-1b9e85217c1cfb5423a50f54423ce09a25e12a053ff2a74e90edae7a66559d0a WatchSource:0}: Error finding container 1b9e85217c1cfb5423a50f54423ce09a25e12a053ff2a74e90edae7a66559d0a: Status 404 returned error can't find the container with id 1b9e85217c1cfb5423a50f54423ce09a25e12a053ff2a74e90edae7a66559d0a Oct 30 19:10:10.610962 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:10.610925 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" event={"ID":"f59a3a50-3f75-410a-92bb-6d8fd4342ddf","Type":"ContainerStarted","Data":"57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576"} Oct 30 19:10:10.611164 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:10.610996 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" event={"ID":"f59a3a50-3f75-410a-92bb-6d8fd4342ddf","Type":"ContainerStarted","Data":"dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38"} Oct 30 19:10:10.611164 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:10.611031 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" event={"ID":"f59a3a50-3f75-410a-92bb-6d8fd4342ddf","Type":"ContainerStarted","Data":"1b9e85217c1cfb5423a50f54423ce09a25e12a053ff2a74e90edae7a66559d0a"} Oct 30 19:10:10.611164 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:10.611134 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:10.658224 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:10.658159 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" podStartSLOduration=1.658145133 podStartE2EDuration="1.658145133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:10:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:10:10.657844997 +0000 UTC m=+2035.886694544" watchObservedRunningTime="2026-10-30 19:10:10.658145133 +0000 UTC m=+2035.886994680" Oct 30 19:10:11.615676 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:11.615634 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:11.617111 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:11.617081 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused" Oct 30 19:10:12.619766 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:12.619720 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused" Oct 30 19:10:17.624520 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:17.624484 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:10:17.625136 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:17.625109 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused" Oct 30 19:10:23.734064 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:10:23.734019 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:10:27.626006 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:27.625961 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused" Oct 30 19:10:32.833997 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:32.833959 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:10:37.625519 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:37.625478 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused" Oct 30 19:10:47.625480 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:47.625436 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused" Oct 30 19:10:53.734455 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:10:53.734418 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:10:57.625939 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:10:57.625895 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused" Oct 30 19:11:04.978075 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:04.978031 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:11:07.625567 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:07.625534 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:11:15.067657 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:15.067627 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:11:15.072895 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:15.072866 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:11:15.078151 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:15.078125 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:11:15.083550 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:15.083525 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:11:18.990625 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:18.990587 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:11:19.164971 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:19.164938 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:11:23.734823 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:11:23.734780 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:11:30.304838 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:30.304757 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb"] Oct 30 19:11:30.305321 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:30.305016 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kserve-container" containerID="cri-o://dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38" gracePeriod=30 Oct 30 19:11:30.305321 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:30.305054 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kube-rbac-proxy" containerID="cri-o://57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576" gracePeriod=30 Oct 30 19:11:30.420839 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:30.420809 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:11:30.605061 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:30.604980 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:11:30.966584 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:30.966545 4494 generic.go:356] "Generic (PLEG): container finished" podID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerID="57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576" exitCode=0 Oct 30 19:11:30.966768 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:30.966605 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" event={"ID":"f59a3a50-3f75-410a-92bb-6d8fd4342ddf","Type":"ContainerDied","Data":"57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576"} Oct 30 19:11:32.620765 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:32.620723 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.39:8643/healthz\": dial tcp 10.134.0.39:8643: connect: connection refused" Oct 30 19:11:34.149141 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.149115 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:11:34.175918 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.175885 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-rbac-proxy-sar-config\") pod \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\" (UID: \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\") " Oct 30 19:11:34.176089 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.175927 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-proxy-tls\" (UniqueName: \"kubernetes.io/secret/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-proxy-tls\") pod \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\" (UID: \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\") " Oct 30 19:11:34.176089 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.175962 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-api-access-b28k7\" (UniqueName: \"kubernetes.io/projected/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-api-access-b28k7\") pod \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\" (UID: \"f59a3a50-3f75-410a-92bb-6d8fd4342ddf\") " Oct 30 19:11:34.176271 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.176246 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-rbac-proxy-sar-config" pod "f59a3a50-3f75-410a-92bb-6d8fd4342ddf" (UID: "f59a3a50-3f75-410a-92bb-6d8fd4342ddf"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:11:34.178039 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.178015 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-api-access-b28k7" pod "f59a3a50-3f75-410a-92bb-6d8fd4342ddf" (UID: "f59a3a50-3f75-410a-92bb-6d8fd4342ddf"). InnerVolumeSpecName "kube-api-access-b28k7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 19:11:34.178106 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.178090 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-proxy-tls" pod "f59a3a50-3f75-410a-92bb-6d8fd4342ddf" (UID: "f59a3a50-3f75-410a-92bb-6d8fd4342ddf"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:11:34.277174 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.277082 4494 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:11:34.277174 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.277122 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:11:34.277174 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.277133 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b28k7\" (UniqueName: \"kubernetes.io/projected/f59a3a50-3f75-410a-92bb-6d8fd4342ddf-kube-api-access-b28k7\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:11:34.985704 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.985669 4494 generic.go:356] "Generic (PLEG): container finished" podID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerID="dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38" exitCode=0 Oct 30 19:11:34.985904 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.985727 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" Oct 30 19:11:34.985904 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.985733 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" event={"ID":"f59a3a50-3f75-410a-92bb-6d8fd4342ddf","Type":"ContainerDied","Data":"dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38"} Oct 30 19:11:34.985904 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.985798 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb" event={"ID":"f59a3a50-3f75-410a-92bb-6d8fd4342ddf","Type":"ContainerDied","Data":"1b9e85217c1cfb5423a50f54423ce09a25e12a053ff2a74e90edae7a66559d0a"} Oct 30 19:11:34.985904 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.985828 4494 scope.go:122] "RemoveContainer" containerID="57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576" Oct 30 19:11:34.994437 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:34.994416 4494 scope.go:122] "RemoveContainer" containerID="dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38" Oct 30 19:11:35.002439 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:35.002415 4494 scope.go:122] "RemoveContainer" containerID="57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576" Oct 30 19:11:35.002770 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:11:35.002748 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576\": container with ID starting with 57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576 not found: ID does not exist" containerID="57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576" Oct 30 19:11:35.002860 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:35.002774 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576"} err="failed to get container status \"57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576\": rpc error: code = NotFound desc = could not find container \"57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576\": container with ID starting with 57f499d310fce76a9dae41293f4d6cc23f6858f2537034168ad5d0e51b2cd576 not found: ID does not exist" Oct 30 19:11:35.002860 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:35.002792 4494 scope.go:122] "RemoveContainer" containerID="dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38" Oct 30 19:11:35.003087 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:11:35.003067 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38\": container with ID starting with dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38 not found: ID does not exist" containerID="dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38" Oct 30 19:11:35.003128 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:35.003095 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38"} err="failed to get container status \"dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38\": rpc error: code = NotFound desc = could not find container \"dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38\": container with ID starting with dab6d338efb7bebe4e5a14718752ad0fe77964f0d666d27b58c06ec35b21ae38 not found: ID does not exist" Oct 30 19:11:35.050081 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:35.050038 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb"] Oct 30 19:11:35.064597 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:35.064567 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-6c6a7-predictor-84cc8bdc8b-psxgb"] Oct 30 19:11:35.775002 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:35.774962 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:11:35.977922 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:35.977884 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:11:36.185307 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.185276 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf"] Oct 30 19:11:36.185678 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.185664 4494 cpu_manager.go:414] "containerMap: removing container" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kube-rbac-proxy" Oct 30 19:11:36.185731 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.185679 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kube-rbac-proxy" Oct 30 19:11:36.185731 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.185702 4494 cpu_manager.go:414] "containerMap: removing container" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kserve-container" Oct 30 19:11:36.185731 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.185707 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kserve-container" Oct 30 19:11:36.185833 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.185771 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kserve-container" Oct 30 19:11:36.185833 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.185784 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" containerName="kube-rbac-proxy" Oct 30 19:11:36.190534 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.190502 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:36.196199 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.196162 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:11:36.224856 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.224819 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"error-404-isvc-10b08-kube-rbac-proxy-sar-config\"" Oct 30 19:11:36.225051 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.224873 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-89b2ccc844\"/\"kube-root-ca.crt\"" Oct 30 19:11:36.225051 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.224906 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-89b2ccc844\"/\"error-404-isvc-10b08-predictor-serving-cert\"" Oct 30 19:11:36.226415 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.226378 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf"] Oct 30 19:11:36.293762 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.293722 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-proxy-tls\") pod \"error-404-isvc-10b08-predictor-9f9545fd6-7jgzf\" (UID: \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:36.293762 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.293762 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-10b08-predictor-9f9545fd6-7jgzf\" (UID: \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:36.293983 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.293839 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nwnt\" (UniqueName: \"kubernetes.io/projected/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-api-access-2nwnt\") pod \"error-404-isvc-10b08-predictor-9f9545fd6-7jgzf\" (UID: \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:36.381610 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.381571 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:11:36.394806 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.394772 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-proxy-tls\") pod \"error-404-isvc-10b08-predictor-9f9545fd6-7jgzf\" (UID: \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:36.394885 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.394813 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-10b08-predictor-9f9545fd6-7jgzf\" (UID: \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:36.394977 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.394942 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nwnt\" (UniqueName: \"kubernetes.io/projected/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-api-access-2nwnt\") pod \"error-404-isvc-10b08-predictor-9f9545fd6-7jgzf\" (UID: \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:36.395614 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.395592 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-10b08-predictor-9f9545fd6-7jgzf\" (UID: \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:36.397339 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.397319 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-proxy-tls\") pod \"error-404-isvc-10b08-predictor-9f9545fd6-7jgzf\" (UID: \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:36.420692 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.420658 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nwnt\" (UniqueName: \"kubernetes.io/projected/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-api-access-2nwnt\") pod \"error-404-isvc-10b08-predictor-9f9545fd6-7jgzf\" (UID: \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\") " pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:36.505645 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.505553 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:36.803663 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.803615 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf"] Oct 30 19:11:36.805919 ip-10-0-135-218 kubenswrapper[4494]: W1030 19:11:36.805888 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47dddda4_9eb2_4f24_a6c9_77facb8c4d64.slice/crio-8b3b9b01b6983eb37b835822cceb2124d89cc98483d42d5908273a3a99a9ce2a WatchSource:0}: Error finding container 8b3b9b01b6983eb37b835822cceb2124d89cc98483d42d5908273a3a99a9ce2a: Status 404 returned error can't find the container with id 8b3b9b01b6983eb37b835822cceb2124d89cc98483d42d5908273a3a99a9ce2a Oct 30 19:11:36.887012 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.886981 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f59a3a50-3f75-410a-92bb-6d8fd4342ddf" path="/var/lib/kubelet/pods/f59a3a50-3f75-410a-92bb-6d8fd4342ddf/volumes" Oct 30 19:11:36.998745 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.998702 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" event={"ID":"47dddda4-9eb2-4f24-a6c9-77facb8c4d64","Type":"ContainerStarted","Data":"7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9"} Oct 30 19:11:36.998923 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.998779 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" event={"ID":"47dddda4-9eb2-4f24-a6c9-77facb8c4d64","Type":"ContainerStarted","Data":"e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381"} Oct 30 19:11:36.998923 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.998814 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" event={"ID":"47dddda4-9eb2-4f24-a6c9-77facb8c4d64","Type":"ContainerStarted","Data":"8b3b9b01b6983eb37b835822cceb2124d89cc98483d42d5908273a3a99a9ce2a"} Oct 30 19:11:36.998923 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:36.998904 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:37.051596 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:37.051536 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" podStartSLOduration=1.051520508 podStartE2EDuration="1.051520508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:11:37.051378596 +0000 UTC m=+2122.280228142" watchObservedRunningTime="2026-10-30 19:11:37.051520508 +0000 UTC m=+2122.280370038" Oct 30 19:11:38.003658 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:38.003627 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:38.004869 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:38.004842 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused" Oct 30 19:11:39.007812 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:39.007769 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused" Oct 30 19:11:41.455182 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:41.455134 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:11:41.636226 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:41.636168 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:11:44.012871 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:44.012838 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:11:44.013337 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:44.013308 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused" Oct 30 19:11:53.735267 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:11:53.735220 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:11:54.014281 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:11:54.014190 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused" Oct 30 19:12:04.013546 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:04.013503 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused" Oct 30 19:12:05.084331 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:05.084269 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:12:05.275341 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:05.275305 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:12:14.014229 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:14.014191 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused" Oct 30 19:12:23.734935 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:12:23.734890 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:12:24.014000 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:24.013912 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused" Oct 30 19:12:34.014565 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:34.014527 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:12:45.953952 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:45.953921 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:12:46.195635 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:46.195604 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:12:53.287539 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:53.287504 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7"] Oct 30 19:12:53.288006 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:53.287750 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kserve-container" containerID="cri-o://fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca" gracePeriod=30 Oct 30 19:12:53.288006 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:53.287792 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kube-rbac-proxy" containerID="cri-o://36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f" gracePeriod=30 Oct 30 19:12:53.418653 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:53.418604 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:12:53.595897 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:53.595808 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:12:53.734649 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:12:53.734612 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:12:54.350641 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:54.350604 4494 generic.go:356] "Generic (PLEG): container finished" podID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerID="36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f" exitCode=0 Oct 30 19:12:54.351048 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:54.350676 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" event={"ID":"dba0f68d-4bf3-4c0e-889f-d4921860ffab","Type":"ContainerDied","Data":"36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f"} Oct 30 19:12:55.777238 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:55.777198 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.38:8643/healthz\": dial tcp 10.134.0.38:8643: connect: connection refused" Oct 30 19:12:55.781578 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:55.781549 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused" Oct 30 19:12:57.148283 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.148253 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:12:57.295705 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.295609 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dba0f68d-4bf3-4c0e-889f-d4921860ffab-proxy-tls\" (UniqueName: \"kubernetes.io/secret/dba0f68d-4bf3-4c0e-889f-d4921860ffab-proxy-tls\") pod \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\" (UID: \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\") " Oct 30 19:12:57.295869 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.295708 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-rbac-proxy-sar-config\") pod \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\" (UID: \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\") " Oct 30 19:12:57.295869 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.295740 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-api-access-sxswl\" (UniqueName: \"kubernetes.io/projected/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-api-access-sxswl\") pod \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\" (UID: \"dba0f68d-4bf3-4c0e-889f-d4921860ffab\") " Oct 30 19:12:57.296113 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.296085 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-rbac-proxy-sar-config" pod "dba0f68d-4bf3-4c0e-889f-d4921860ffab" (UID: "dba0f68d-4bf3-4c0e-889f-d4921860ffab"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:12:57.297941 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.297913 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-api-access-sxswl" pod "dba0f68d-4bf3-4c0e-889f-d4921860ffab" (UID: "dba0f68d-4bf3-4c0e-889f-d4921860ffab"). InnerVolumeSpecName "kube-api-access-sxswl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 19:12:57.298057 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.297913 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dba0f68d-4bf3-4c0e-889f-d4921860ffab-proxy-tls" pod "dba0f68d-4bf3-4c0e-889f-d4921860ffab" (UID: "dba0f68d-4bf3-4c0e-889f-d4921860ffab"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:12:57.370693 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.370659 4494 generic.go:356] "Generic (PLEG): container finished" podID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerID="fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca" exitCode=0 Oct 30 19:12:57.370894 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.370722 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" Oct 30 19:12:57.370894 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.370743 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" event={"ID":"dba0f68d-4bf3-4c0e-889f-d4921860ffab","Type":"ContainerDied","Data":"fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca"} Oct 30 19:12:57.370894 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.370839 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7" event={"ID":"dba0f68d-4bf3-4c0e-889f-d4921860ffab","Type":"ContainerDied","Data":"06a4577e62382eba85371ebeed504239ecd33eb713de560136bb6fef9cb671c5"} Oct 30 19:12:57.370894 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.370874 4494 scope.go:122] "RemoveContainer" containerID="36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f" Oct 30 19:12:57.379559 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.379540 4494 scope.go:122] "RemoveContainer" containerID="fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca" Oct 30 19:12:57.387517 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.387493 4494 scope.go:122] "RemoveContainer" containerID="36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f" Oct 30 19:12:57.387931 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:12:57.387906 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f\": container with ID starting with 36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f not found: ID does not exist" containerID="36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f" Oct 30 19:12:57.388032 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.387940 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f"} err="failed to get container status \"36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f\": rpc error: code = NotFound desc = could not find container \"36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f\": container with ID starting with 36b1a3c6cc3c8a4c8131fc4dc1e3e91b4b50a04fdf39fcf72436135e9cd0d99f not found: ID does not exist" Oct 30 19:12:57.388032 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.387960 4494 scope.go:122] "RemoveContainer" containerID="fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca" Oct 30 19:12:57.388266 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:12:57.388245 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca\": container with ID starting with fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca not found: ID does not exist" containerID="fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca" Oct 30 19:12:57.388320 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.388274 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca"} err="failed to get container status \"fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca\": rpc error: code = NotFound desc = could not find container \"fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca\": container with ID starting with fba3a47fef2ed115f71d831af8db93f3d97c35a20573803e81427035524a05ca not found: ID does not exist" Oct 30 19:12:57.396752 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.396725 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxswl\" (UniqueName: \"kubernetes.io/projected/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-api-access-sxswl\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:12:57.396752 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.396751 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dba0f68d-4bf3-4c0e-889f-d4921860ffab-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:12:57.396931 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.396764 4494 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dba0f68d-4bf3-4c0e-889f-d4921860ffab-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:12:57.431217 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.431178 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7"] Oct 30 19:12:57.435510 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:57.435473 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-59ec6-predictor-7b488786c6-4kbk7"] Oct 30 19:12:58.762711 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:58.762629 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:12:58.885552 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:58.885508 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" path="/var/lib/kubelet/pods/dba0f68d-4bf3-4c0e-889f-d4921860ffab/volumes" Oct 30 19:12:58.936029 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:58.935993 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:12:59.160619 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.160542 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr"] Oct 30 19:12:59.160947 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.160935 4494 cpu_manager.go:414] "containerMap: removing container" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kserve-container" Oct 30 19:12:59.160994 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.160948 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kserve-container" Oct 30 19:12:59.160994 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.160959 4494 cpu_manager.go:414] "containerMap: removing container" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kube-rbac-proxy" Oct 30 19:12:59.160994 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.160964 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kube-rbac-proxy" Oct 30 19:12:59.161084 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.161017 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kserve-container" Oct 30 19:12:59.161084 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.161025 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="dba0f68d-4bf3-4c0e-889f-d4921860ffab" containerName="kube-rbac-proxy" Oct 30 19:12:59.165543 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.165520 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:12:59.184668 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.184634 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr"] Oct 30 19:12:59.186628 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.186594 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:12:59.197612 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.197577 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-f31293434f\"/\"error-404-isvc-7130d-predictor-serving-cert\"" Oct 30 19:12:59.197612 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.197578 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"kube-root-ca.crt\"" Oct 30 19:12:59.197811 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.197618 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-f31293434f\"/\"error-404-isvc-7130d-kube-rbac-proxy-sar-config\"" Oct 30 19:12:59.312282 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.312236 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62bd3804-f241-40c0-b9ec-5b17688fecaf-proxy-tls\") pod \"error-404-isvc-7130d-predictor-696c4954db-ncqsr\" (UID: \"62bd3804-f241-40c0-b9ec-5b17688fecaf\") " pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:12:59.312557 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.312393 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7130d-predictor-696c4954db-ncqsr\" (UID: \"62bd3804-f241-40c0-b9ec-5b17688fecaf\") " pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:12:59.312557 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.312470 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkn4r\" (UniqueName: \"kubernetes.io/projected/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-api-access-bkn4r\") pod \"error-404-isvc-7130d-predictor-696c4954db-ncqsr\" (UID: \"62bd3804-f241-40c0-b9ec-5b17688fecaf\") " pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:12:59.367432 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.367382 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:12:59.413657 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.413619 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7130d-predictor-696c4954db-ncqsr\" (UID: \"62bd3804-f241-40c0-b9ec-5b17688fecaf\") " pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:12:59.413855 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.413664 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkn4r\" (UniqueName: \"kubernetes.io/projected/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-api-access-bkn4r\") pod \"error-404-isvc-7130d-predictor-696c4954db-ncqsr\" (UID: \"62bd3804-f241-40c0-b9ec-5b17688fecaf\") " pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:12:59.413855 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.413708 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62bd3804-f241-40c0-b9ec-5b17688fecaf-proxy-tls\") pod \"error-404-isvc-7130d-predictor-696c4954db-ncqsr\" (UID: \"62bd3804-f241-40c0-b9ec-5b17688fecaf\") " pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:12:59.414329 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.414302 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7130d-predictor-696c4954db-ncqsr\" (UID: \"62bd3804-f241-40c0-b9ec-5b17688fecaf\") " pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:12:59.416136 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.416115 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62bd3804-f241-40c0-b9ec-5b17688fecaf-proxy-tls\") pod \"error-404-isvc-7130d-predictor-696c4954db-ncqsr\" (UID: \"62bd3804-f241-40c0-b9ec-5b17688fecaf\") " pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:12:59.439693 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.439656 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkn4r\" (UniqueName: \"kubernetes.io/projected/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-api-access-bkn4r\") pod \"error-404-isvc-7130d-predictor-696c4954db-ncqsr\" (UID: \"62bd3804-f241-40c0-b9ec-5b17688fecaf\") " pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:12:59.480506 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.480468 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:12:59.778326 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:12:59.778293 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr"] Oct 30 19:12:59.778771 ip-10-0-135-218 kubenswrapper[4494]: W1030 19:12:59.778619 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bd3804_f241_40c0_b9ec_5b17688fecaf.slice/crio-a66664d2be0e31105b826bdaf23128de190cd7c3462d215eddbd06f38764d6f7 WatchSource:0}: Error finding container a66664d2be0e31105b826bdaf23128de190cd7c3462d215eddbd06f38764d6f7: Status 404 returned error can't find the container with id a66664d2be0e31105b826bdaf23128de190cd7c3462d215eddbd06f38764d6f7 Oct 30 19:13:00.386274 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:00.386236 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" event={"ID":"62bd3804-f241-40c0-b9ec-5b17688fecaf","Type":"ContainerStarted","Data":"e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870"} Oct 30 19:13:00.386481 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:00.386301 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" event={"ID":"62bd3804-f241-40c0-b9ec-5b17688fecaf","Type":"ContainerStarted","Data":"eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2"} Oct 30 19:13:00.386481 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:00.386329 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" event={"ID":"62bd3804-f241-40c0-b9ec-5b17688fecaf","Type":"ContainerStarted","Data":"a66664d2be0e31105b826bdaf23128de190cd7c3462d215eddbd06f38764d6f7"} Oct 30 19:13:00.386481 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:00.386362 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:13:00.436061 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:00.435998 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" podStartSLOduration=1.435983399 podStartE2EDuration="1.435983399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:12:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:13:00.434881081 +0000 UTC m=+2205.663730628" watchObservedRunningTime="2026-10-30 19:13:00.435983399 +0000 UTC m=+2205.664832946" Oct 30 19:13:01.391141 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:01.391098 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:13:01.392603 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:01.392572 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused" Oct 30 19:13:02.395471 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:02.395424 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused" Oct 30 19:13:05.229203 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:05.229168 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:13:07.400449 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:07.400391 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:13:07.400955 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:07.400930 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused" Oct 30 19:13:17.401906 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:17.401859 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused" Oct 30 19:13:23.733869 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:13:23.733828 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:13:27.401809 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:27.401767 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused" Oct 30 19:13:37.401422 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:37.401374 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused" Oct 30 19:13:47.401087 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:47.401038 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused" Oct 30 19:13:53.734305 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:13:53.734268 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:13:57.402052 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:13:57.402024 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:14:05.339182 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:14:05.339144 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:14:08.951211 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:14:08.951172 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:14:09.135266 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:14:09.135229 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:14:19.016821 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:14:19.016785 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:14:23.734748 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:14:23.734701 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:14:35.629206 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:14:35.629115 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:14:36.665765 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:14:36.665730 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:14:53.735295 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:14:53.735253 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:15:05.461394 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:15:05.461352 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:15:23.735005 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:15:23.734962 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:15:53.734057 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:15:53.734019 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:16:01.529036 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:16:01.528951 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:16:02.626707 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:16:02.626671 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:16:05.561914 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:16:05.561866 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:16:15.096601 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:16:15.096567 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:16:15.103343 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:16:15.103304 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:16:15.106931 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:16:15.106903 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:16:15.113719 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:16:15.113697 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:16:23.734162 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:16:23.734118 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:16:53.734745 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:16:53.734704 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:17:00.112470 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:17:00.112436 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:17:05.736355 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:17:05.736321 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:17:23.733928 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:17:23.733890 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:17:38.690447 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:17:38.690346 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:17:39.763188 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:17:39.763137 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:17:53.734634 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:17:53.734590 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:18:05.820241 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:18:05.820194 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:18:23.734764 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:18:23.734720 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:18:53.733813 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:18:53.733774 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:19:05.956398 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:19:05.956315 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:19:23.734392 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:19:23.734347 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:19:53.733958 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:19:53.733913 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:20:06.106882 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:20:06.106845 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:20:23.736205 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:20:23.736164 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:20:39.882192 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:20:39.882111 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:20:53.733859 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:20:53.733818 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:21:01.535833 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:01.535795 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf"] Oct 30 19:21:01.536355 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:01.536040 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kserve-container" containerID="cri-o://e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381" gracePeriod=30 Oct 30 19:21:01.536355 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:01.536071 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kube-rbac-proxy" containerID="cri-o://7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9" gracePeriod=30 Oct 30 19:21:01.581995 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:01.581961 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:21:01.768454 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:01.768380 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:21:02.547207 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:02.547154 4494 generic.go:356] "Generic (PLEG): container finished" podID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerID="7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9" exitCode=0 Oct 30 19:21:02.547641 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:02.547240 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" event={"ID":"47dddda4-9eb2-4f24-a6c9-77facb8c4d64","Type":"ContainerDied","Data":"7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9"} Oct 30 19:21:04.008005 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:04.007955 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.40:8643/healthz\": dial tcp 10.134.0.40:8643: connect: connection refused" Oct 30 19:21:04.013526 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:04.013489 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused" Oct 30 19:21:05.495705 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.495678 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:21:05.556229 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.556147 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-api-access-2nwnt\" (UniqueName: \"kubernetes.io/projected/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-api-access-2nwnt\") pod \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\" (UID: \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\") " Oct 30 19:21:05.556396 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.556257 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-proxy-tls\" (UniqueName: \"kubernetes.io/secret/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-proxy-tls\") pod \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\" (UID: \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\") " Oct 30 19:21:05.556396 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.556294 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-rbac-proxy-sar-config\") pod \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\" (UID: \"47dddda4-9eb2-4f24-a6c9-77facb8c4d64\") " Oct 30 19:21:05.556637 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.556611 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-rbac-proxy-sar-config" pod "47dddda4-9eb2-4f24-a6c9-77facb8c4d64" (UID: "47dddda4-9eb2-4f24-a6c9-77facb8c4d64"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:21:05.558425 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.558380 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-proxy-tls" pod "47dddda4-9eb2-4f24-a6c9-77facb8c4d64" (UID: "47dddda4-9eb2-4f24-a6c9-77facb8c4d64"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:21:05.558545 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.558482 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-api-access-2nwnt" pod "47dddda4-9eb2-4f24-a6c9-77facb8c4d64" (UID: "47dddda4-9eb2-4f24-a6c9-77facb8c4d64"). InnerVolumeSpecName "kube-api-access-2nwnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 19:21:05.563365 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.563260 4494 generic.go:356] "Generic (PLEG): container finished" podID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerID="e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381" exitCode=0 Oct 30 19:21:05.563365 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.563306 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" event={"ID":"47dddda4-9eb2-4f24-a6c9-77facb8c4d64","Type":"ContainerDied","Data":"e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381"} Oct 30 19:21:05.563365 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.563312 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" Oct 30 19:21:05.563365 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.563352 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf" event={"ID":"47dddda4-9eb2-4f24-a6c9-77facb8c4d64","Type":"ContainerDied","Data":"8b3b9b01b6983eb37b835822cceb2124d89cc98483d42d5908273a3a99a9ce2a"} Oct 30 19:21:05.572753 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.563388 4494 scope.go:122] "RemoveContainer" containerID="7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9" Oct 30 19:21:05.576213 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.576188 4494 scope.go:122] "RemoveContainer" containerID="e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381" Oct 30 19:21:05.584475 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.584453 4494 scope.go:122] "RemoveContainer" containerID="7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9" Oct 30 19:21:05.584803 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:21:05.584783 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9\": container with ID starting with 7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9 not found: ID does not exist" containerID="7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9" Oct 30 19:21:05.584852 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.584815 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9"} err="failed to get container status \"7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9\": rpc error: code = NotFound desc = could not find container \"7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9\": container with ID starting with 7bdb80cde11db43e8e0d40b400c80c685308daa9d74fdf55d87ff432bac89bf9 not found: ID does not exist" Oct 30 19:21:05.584852 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.584833 4494 scope.go:122] "RemoveContainer" containerID="e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381" Oct 30 19:21:05.585067 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:21:05.585047 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381\": container with ID starting with e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381 not found: ID does not exist" containerID="e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381" Oct 30 19:21:05.585111 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.585074 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381"} err="failed to get container status \"e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381\": rpc error: code = NotFound desc = could not find container \"e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381\": container with ID starting with e461e56b01a6d9b8294cd918376344a98931ffd53168977eeb04f7f4a094b381 not found: ID does not exist" Oct 30 19:21:05.622825 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.622783 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf"] Oct 30 19:21:05.626921 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.626882 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-89b2ccc844/error-404-isvc-10b08-predictor-9f9545fd6-7jgzf"] Oct 30 19:21:05.657347 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.657312 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:21:05.657347 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.657340 4494 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:21:05.657347 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:05.657350 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nwnt\" (UniqueName: \"kubernetes.io/projected/47dddda4-9eb2-4f24-a6c9-77facb8c4d64-kube-api-access-2nwnt\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:21:06.196277 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:06.196240 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:21:06.381652 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:06.381588 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:21:06.885223 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:06.885189 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" path="/var/lib/kubelet/pods/47dddda4-9eb2-4f24-a6c9-77facb8c4d64/volumes" Oct 30 19:21:11.275564 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:11.275527 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh"] Oct 30 19:21:11.275989 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:11.275734 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" podUID="de3c5cf8-8c59-4059-8595-de29a650a44f" containerName="switch-graph-3e736" containerID="cri-o://79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458" gracePeriod=30 Oct 30 19:21:11.290358 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:11.290315 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s"] Oct 30 19:21:11.290615 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:11.290590 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" podUID="e5151264-c383-46cc-ab7a-9e38823ef86f" containerName="switch-graph-d7605" containerID="cri-o://d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea" gracePeriod=30 Oct 30 19:21:11.469587 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:11.469551 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:21:13.067848 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:13.067807 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" podUID="de3c5cf8-8c59-4059-8595-de29a650a44f" containerName="switch-graph-3e736" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:21:15.128153 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:15.128124 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:21:15.132993 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:15.132958 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:21:15.138448 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:15.138424 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:21:15.143146 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:15.143122 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:21:15.473909 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:15.473865 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" podUID="e5151264-c383-46cc-ab7a-9e38823ef86f" containerName="switch-graph-d7605" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:21:18.067333 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:18.067290 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" podUID="de3c5cf8-8c59-4059-8595-de29a650a44f" containerName="switch-graph-3e736" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:21:20.474340 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:20.474294 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" podUID="e5151264-c383-46cc-ab7a-9e38823ef86f" containerName="switch-graph-d7605" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:21:23.067561 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:23.067518 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" podUID="de3c5cf8-8c59-4059-8595-de29a650a44f" containerName="switch-graph-3e736" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:21:23.068069 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:23.067653 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 19:21:23.735220 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:21:23.735179 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:21:25.474510 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:25.474471 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" podUID="e5151264-c383-46cc-ab7a-9e38823ef86f" containerName="switch-graph-d7605" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:21:25.475076 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:25.474594 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 19:21:28.067205 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:28.067152 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" podUID="de3c5cf8-8c59-4059-8595-de29a650a44f" containerName="switch-graph-3e736" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:21:30.473522 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:30.473480 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" podUID="e5151264-c383-46cc-ab7a-9e38823ef86f" containerName="switch-graph-d7605" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:21:33.067213 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:33.067166 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" podUID="de3c5cf8-8c59-4059-8595-de29a650a44f" containerName="switch-graph-3e736" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:21:35.474436 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:35.474382 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" podUID="e5151264-c383-46cc-ab7a-9e38823ef86f" containerName="switch-graph-d7605" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:21:38.067717 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:38.067680 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" podUID="de3c5cf8-8c59-4059-8595-de29a650a44f" containerName="switch-graph-3e736" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:21:40.474168 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:40.474123 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" podUID="e5151264-c383-46cc-ab7a-9e38823ef86f" containerName="switch-graph-d7605" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:21:41.424568 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.424536 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 19:21:41.451666 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.451640 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 19:21:41.574735 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.574490 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e5151264-c383-46cc-ab7a-9e38823ef86f-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5151264-c383-46cc-ab7a-9e38823ef86f-openshift-service-ca-bundle\") pod \"e5151264-c383-46cc-ab7a-9e38823ef86f\" (UID: \"e5151264-c383-46cc-ab7a-9e38823ef86f\") " Oct 30 19:21:41.574735 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.574583 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e5151264-c383-46cc-ab7a-9e38823ef86f-proxy-tls\" (UniqueName: \"kubernetes.io/secret/e5151264-c383-46cc-ab7a-9e38823ef86f-proxy-tls\") pod \"e5151264-c383-46cc-ab7a-9e38823ef86f\" (UID: \"e5151264-c383-46cc-ab7a-9e38823ef86f\") " Oct 30 19:21:41.574735 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.574666 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de3c5cf8-8c59-4059-8595-de29a650a44f-proxy-tls\" (UniqueName: \"kubernetes.io/secret/de3c5cf8-8c59-4059-8595-de29a650a44f-proxy-tls\") pod \"de3c5cf8-8c59-4059-8595-de29a650a44f\" (UID: \"de3c5cf8-8c59-4059-8595-de29a650a44f\") " Oct 30 19:21:41.574735 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.574695 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/de3c5cf8-8c59-4059-8595-de29a650a44f-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3c5cf8-8c59-4059-8595-de29a650a44f-openshift-service-ca-bundle\") pod \"de3c5cf8-8c59-4059-8595-de29a650a44f\" (UID: \"de3c5cf8-8c59-4059-8595-de29a650a44f\") " Oct 30 19:21:41.575277 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.574998 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5151264-c383-46cc-ab7a-9e38823ef86f-openshift-service-ca-bundle" pod "e5151264-c383-46cc-ab7a-9e38823ef86f" (UID: "e5151264-c383-46cc-ab7a-9e38823ef86f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:21:41.575277 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.575144 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de3c5cf8-8c59-4059-8595-de29a650a44f-openshift-service-ca-bundle" pod "de3c5cf8-8c59-4059-8595-de29a650a44f" (UID: "de3c5cf8-8c59-4059-8595-de29a650a44f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:21:41.576862 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.576837 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de3c5cf8-8c59-4059-8595-de29a650a44f-proxy-tls" pod "de3c5cf8-8c59-4059-8595-de29a650a44f" (UID: "de3c5cf8-8c59-4059-8595-de29a650a44f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:21:41.576965 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.576871 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5151264-c383-46cc-ab7a-9e38823ef86f-proxy-tls" pod "e5151264-c383-46cc-ab7a-9e38823ef86f" (UID: "e5151264-c383-46cc-ab7a-9e38823ef86f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:21:41.675501 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.675454 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e5151264-c383-46cc-ab7a-9e38823ef86f-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:21:41.675501 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.675492 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/de3c5cf8-8c59-4059-8595-de29a650a44f-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:21:41.675501 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.675505 4494 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de3c5cf8-8c59-4059-8595-de29a650a44f-openshift-service-ca-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:21:41.675768 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.675520 4494 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5151264-c383-46cc-ab7a-9e38823ef86f-openshift-service-ca-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:21:41.725372 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.725335 4494 generic.go:356] "Generic (PLEG): container finished" podID="e5151264-c383-46cc-ab7a-9e38823ef86f" containerID="d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea" exitCode=0 Oct 30 19:21:41.725551 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.725383 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" Oct 30 19:21:41.725551 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.725428 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" event={"ID":"e5151264-c383-46cc-ab7a-9e38823ef86f","Type":"ContainerDied","Data":"d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea"} Oct 30 19:21:41.725551 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.725487 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s" event={"ID":"e5151264-c383-46cc-ab7a-9e38823ef86f","Type":"ContainerDied","Data":"1c132da9e2eb4d077a7bbde55f5b0fad87477777ceb701c54b90441df00d092e"} Oct 30 19:21:41.725551 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.725514 4494 scope.go:122] "RemoveContainer" containerID="d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea" Oct 30 19:21:41.726771 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.726742 4494 generic.go:356] "Generic (PLEG): container finished" podID="de3c5cf8-8c59-4059-8595-de29a650a44f" containerID="79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458" exitCode=0 Oct 30 19:21:41.726916 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.726776 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" event={"ID":"de3c5cf8-8c59-4059-8595-de29a650a44f","Type":"ContainerDied","Data":"79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458"} Oct 30 19:21:41.726916 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.726785 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" Oct 30 19:21:41.726916 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.726814 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh" event={"ID":"de3c5cf8-8c59-4059-8595-de29a650a44f","Type":"ContainerDied","Data":"4d7df37bfcdeefea7dfd5aa9331c9645239cb860bee8060c3788e714ec4071bc"} Oct 30 19:21:41.735390 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.735303 4494 scope.go:122] "RemoveContainer" containerID="d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea" Oct 30 19:21:41.735743 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:21:41.735717 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea\": container with ID starting with d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea not found: ID does not exist" containerID="d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea" Oct 30 19:21:41.735798 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.735757 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea"} err="failed to get container status \"d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea\": rpc error: code = NotFound desc = could not find container \"d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea\": container with ID starting with d1577550dac7c50a6a35404aae163dd628de8d6cbd99d2e31fa081aedbee78ea not found: ID does not exist" Oct 30 19:21:41.735798 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.735778 4494 scope.go:122] "RemoveContainer" containerID="79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458" Oct 30 19:21:41.743976 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.743957 4494 scope.go:122] "RemoveContainer" containerID="79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458" Oct 30 19:21:41.744251 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:21:41.744228 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458\": container with ID starting with 79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458 not found: ID does not exist" containerID="79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458" Oct 30 19:21:41.744321 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.744259 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458"} err="failed to get container status \"79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458\": rpc error: code = NotFound desc = could not find container \"79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458\": container with ID starting with 79eb0d7e6855c4eb003a98cbccef0970ebfa9fc2951f4a9a38e08017f54fe458 not found: ID does not exist" Oct 30 19:21:41.785150 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.785111 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s"] Oct 30 19:21:41.789435 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.789390 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-89b2ccc844/switch-graph-d7605-8dd78bcbc-2dl8s"] Oct 30 19:21:41.837982 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.837897 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh"] Oct 30 19:21:41.842925 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:41.842894 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-89b2ccc844/switch-graph-3e736-6d55944d8b-nf5kh"] Oct 30 19:21:42.886224 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:42.886177 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de3c5cf8-8c59-4059-8595-de29a650a44f" path="/var/lib/kubelet/pods/de3c5cf8-8c59-4059-8595-de29a650a44f/volumes" Oct 30 19:21:42.886762 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:42.886718 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e5151264-c383-46cc-ab7a-9e38823ef86f" path="/var/lib/kubelet/pods/e5151264-c383-46cc-ab7a-9e38823ef86f/volumes" Oct 30 19:21:49.107817 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:49.107764 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:21:49.292020 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:49.291980 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:21:49.472087 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:49.472043 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:21:49.649073 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:49.649024 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:21:50.529607 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:50.529571 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:21:53.734903 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:21:53.734862 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:21:55.984671 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:55.984632 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:21:56.154290 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:21:56.154251 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:22:06.334428 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:22:06.334332 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:22:23.733878 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:22:23.733834 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:22:31.650744 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:22:31.650696 4494 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" podUID="0a1141f188cb159776b4a1af048cbc31" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 19:22:53.734385 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:22:53.734343 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:23:06.445659 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:23:06.445594 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:23:23.733779 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:23:23.733734 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:23:53.736704 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:23:53.736609 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:24:06.582667 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:24:06.582628 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:24:23.733758 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:24:23.733716 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:24:31.650504 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:24:31.650400 4494 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" podUID="0a1141f188cb159776b4a1af048cbc31" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded" Oct 30 19:24:53.734318 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:24:53.734282 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:25:06.696135 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:25:06.696030 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:25:20.176574 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:25:20.176538 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:25:23.733476 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:25:23.733428 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:25:53.734585 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:25:53.734547 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:26:06.823819 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:26:06.823769 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:26:15.157192 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:26:15.157151 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:26:15.162520 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:26:15.162495 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:26:15.168565 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:26:15.168541 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:26:15.173727 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:26:15.173702 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:26:23.734879 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:26:23.734839 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:26:31.650585 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:26:31.650482 4494 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" podUID="0a1141f188cb159776b4a1af048cbc31" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 19:26:31.650585 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:26:31.650582 4494 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" Oct 30 19:26:31.651220 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:26:31.650964 4494 kuberuntime_manager.go:1329] "Message for Container of pod" containerName="haproxy" containerStatusID={"Type":"cri-o","ID":"94599eda7c4a08d8c6f9b66ee5c859cc1db1e847fc6b5935dbde3a75ee19ae07"} pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" containerMessage="Container haproxy failed liveness probe, will be restarted" Oct 30 19:26:31.651220 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:26:31.651003 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" podUID="0a1141f188cb159776b4a1af048cbc31" containerName="haproxy" containerID="cri-o://94599eda7c4a08d8c6f9b66ee5c859cc1db1e847fc6b5935dbde3a75ee19ae07" gracePeriod=30 Oct 30 19:26:38.124760 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:26:38.124718 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:26:39.343149 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:26:39.343107 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:26:53.733809 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:26:53.733768 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:27:02.106502 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:27:02.106465 4494 generic.go:356] "Generic (PLEG): container finished" podID="0a1141f188cb159776b4a1af048cbc31" containerID="94599eda7c4a08d8c6f9b66ee5c859cc1db1e847fc6b5935dbde3a75ee19ae07" exitCode=137 Oct 30 19:27:02.106917 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:27:02.106536 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" event={"ID":"0a1141f188cb159776b4a1af048cbc31","Type":"ContainerDied","Data":"94599eda7c4a08d8c6f9b66ee5c859cc1db1e847fc6b5935dbde3a75ee19ae07"} Oct 30 19:27:02.106917 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:27:02.106586 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" event={"ID":"0a1141f188cb159776b4a1af048cbc31","Type":"ContainerStarted","Data":"0710cfe92441a4f628e681161811100d18e89bb64332362d4107384779c13bdf"} Oct 30 19:27:06.970018 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:27:06.969968 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:27:23.734142 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:27:23.734093 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:27:53.734881 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:27:53.734833 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:28:05.179482 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:28:05.179390 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:28:06.190490 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:28:06.190458 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:28:07.062340 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:28:07.062275 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:28:23.734119 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:28:23.734074 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:28:53.734116 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:28:53.734076 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:29:07.213336 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:29:07.213294 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:29:23.734597 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:29:23.734551 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:29:53.733300 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:29:53.733217 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:30:07.381698 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:07.381651 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:30:23.734961 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:30:23.734922 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:30:29.727770 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:29.727733 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr"] Oct 30 19:30:29.728347 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:29.727999 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kserve-container" containerID="cri-o://eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2" gracePeriod=30 Oct 30 19:30:29.728347 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:29.728051 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kube-rbac-proxy" containerID="cri-o://e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870" gracePeriod=30 Oct 30 19:30:29.849744 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:29.849713 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:30:29.998844 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:29.998760 4494 generic.go:356] "Generic (PLEG): container finished" podID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerID="e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870" exitCode=0 Oct 30 19:30:29.998844 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:29.998800 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" event={"ID":"62bd3804-f241-40c0-b9ec-5b17688fecaf","Type":"ContainerDied","Data":"e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870"} Oct 30 19:30:30.035797 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:30.035764 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:30:32.396490 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:32.396450 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.41:8643/healthz\": dial tcp 10.134.0.41:8643: connect: connection refused" Oct 30 19:30:33.367993 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:33.367967 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:30:33.521629 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:33.521537 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-api-access-bkn4r\" (UniqueName: \"kubernetes.io/projected/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-api-access-bkn4r\") pod \"62bd3804-f241-40c0-b9ec-5b17688fecaf\" (UID: \"62bd3804-f241-40c0-b9ec-5b17688fecaf\") " Oct 30 19:30:33.521989 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:33.521638 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/62bd3804-f241-40c0-b9ec-5b17688fecaf-proxy-tls\" (UniqueName: \"kubernetes.io/secret/62bd3804-f241-40c0-b9ec-5b17688fecaf-proxy-tls\") pod \"62bd3804-f241-40c0-b9ec-5b17688fecaf\" (UID: \"62bd3804-f241-40c0-b9ec-5b17688fecaf\") " Oct 30 19:30:33.521989 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:33.521693 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-rbac-proxy-sar-config\") pod \"62bd3804-f241-40c0-b9ec-5b17688fecaf\" (UID: \"62bd3804-f241-40c0-b9ec-5b17688fecaf\") " Oct 30 19:30:33.522091 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:33.522068 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-rbac-proxy-sar-config" pod "62bd3804-f241-40c0-b9ec-5b17688fecaf" (UID: "62bd3804-f241-40c0-b9ec-5b17688fecaf"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:30:33.523716 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:33.523676 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-api-access-bkn4r" pod "62bd3804-f241-40c0-b9ec-5b17688fecaf" (UID: "62bd3804-f241-40c0-b9ec-5b17688fecaf"). InnerVolumeSpecName "kube-api-access-bkn4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 19:30:33.523827 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:33.523743 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62bd3804-f241-40c0-b9ec-5b17688fecaf-proxy-tls" pod "62bd3804-f241-40c0-b9ec-5b17688fecaf" (UID: "62bd3804-f241-40c0-b9ec-5b17688fecaf"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:30:33.622965 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:33.622929 4494 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkn4r\" (UniqueName: \"kubernetes.io/projected/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-api-access-bkn4r\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:30:33.622965 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:33.622959 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62bd3804-f241-40c0-b9ec-5b17688fecaf-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:30:33.622965 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:33.622968 4494 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62bd3804-f241-40c0-b9ec-5b17688fecaf-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:30:34.017939 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.017903 4494 generic.go:356] "Generic (PLEG): container finished" podID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerID="eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2" exitCode=0 Oct 30 19:30:34.018096 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.017950 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" Oct 30 19:30:34.018096 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.017984 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" event={"ID":"62bd3804-f241-40c0-b9ec-5b17688fecaf","Type":"ContainerDied","Data":"eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2"} Oct 30 19:30:34.018096 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.018045 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr" event={"ID":"62bd3804-f241-40c0-b9ec-5b17688fecaf","Type":"ContainerDied","Data":"a66664d2be0e31105b826bdaf23128de190cd7c3462d215eddbd06f38764d6f7"} Oct 30 19:30:34.018096 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.018072 4494 scope.go:122] "RemoveContainer" containerID="e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870" Oct 30 19:30:34.027762 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.027745 4494 scope.go:122] "RemoveContainer" containerID="eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2" Oct 30 19:30:34.035438 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.035385 4494 scope.go:122] "RemoveContainer" containerID="e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870" Oct 30 19:30:34.035708 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:30:34.035687 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870\": container with ID starting with e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870 not found: ID does not exist" containerID="e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870" Oct 30 19:30:34.035791 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.035717 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870"} err="failed to get container status \"e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870\": rpc error: code = NotFound desc = could not find container \"e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870\": container with ID starting with e0a7828c64f1b30ba695e9276ee991b87af206ad501b0fdb02cb5a0633c10870 not found: ID does not exist" Oct 30 19:30:34.035791 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.035734 4494 scope.go:122] "RemoveContainer" containerID="eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2" Oct 30 19:30:34.035991 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:30:34.035975 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2\": container with ID starting with eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2 not found: ID does not exist" containerID="eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2" Oct 30 19:30:34.036051 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.035993 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2"} err="failed to get container status \"eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2\": rpc error: code = NotFound desc = could not find container \"eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2\": container with ID starting with eeb40aac007af41af67382a4fdaea0e19c21781ccbe3f987f4a84ec4b41bd7a2 not found: ID does not exist" Oct 30 19:30:34.076781 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.076747 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr"] Oct 30 19:30:34.081781 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.081753 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-f31293434f/error-404-isvc-7130d-predictor-696c4954db-ncqsr"] Oct 30 19:30:34.625724 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.625672 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:30:34.884982 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:34.884907 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" path="/var/lib/kubelet/pods/62bd3804-f241-40c0-b9ec-5b17688fecaf/volumes" Oct 30 19:30:35.844457 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:35.844422 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:30:36.091647 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:36.091602 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:30:39.453323 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:39.453291 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl"] Oct 30 19:30:39.453801 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:39.453521 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" podUID="23281269-2b00-446c-851c-aceff20ac39d" containerName="model-chainer" containerID="cri-o://6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc" gracePeriod=30 Oct 30 19:30:39.472140 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:39.472100 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx"] Oct 30 19:30:39.472375 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:39.472350 4494 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" podUID="8602043f-b522-4116-bbc0-6ba397f2d54c" containerName="sequence-graph-90935" containerID="cri-o://820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab" gracePeriod=30 Oct 30 19:30:39.644004 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:39.643970 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:30:41.212364 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:41.212326 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" podUID="8602043f-b522-4116-bbc0-6ba397f2d54c" containerName="sequence-graph-90935" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:30:41.821896 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:41.821845 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" podUID="23281269-2b00-446c-851c-aceff20ac39d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:30:46.212730 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:46.212692 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" podUID="8602043f-b522-4116-bbc0-6ba397f2d54c" containerName="sequence-graph-90935" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:30:46.822226 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:46.822182 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" podUID="23281269-2b00-446c-851c-aceff20ac39d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:30:51.212670 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:51.212631 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" podUID="8602043f-b522-4116-bbc0-6ba397f2d54c" containerName="sequence-graph-90935" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:30:51.213148 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:51.212739 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 19:30:51.821995 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:51.821953 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" podUID="23281269-2b00-446c-851c-aceff20ac39d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:30:51.822210 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:51.822079 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 19:30:53.733956 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:30:53.733911 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:30:56.213012 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:56.212971 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" podUID="8602043f-b522-4116-bbc0-6ba397f2d54c" containerName="sequence-graph-90935" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:30:56.821151 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:30:56.821109 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" podUID="23281269-2b00-446c-851c-aceff20ac39d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:31:01.212374 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:01.212288 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" podUID="8602043f-b522-4116-bbc0-6ba397f2d54c" containerName="sequence-graph-90935" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:31:01.822162 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:01.822124 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" podUID="23281269-2b00-446c-851c-aceff20ac39d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:31:06.212580 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:06.212540 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" podUID="8602043f-b522-4116-bbc0-6ba397f2d54c" containerName="sequence-graph-90935" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:31:06.821308 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:06.821268 4494 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" podUID="23281269-2b00-446c-851c-aceff20ac39d" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 19:31:07.478634 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:07.478595 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:31:09.608016 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.607988 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 19:31:09.623636 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.623608 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 19:31:09.729926 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.729834 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/23281269-2b00-446c-851c-aceff20ac39d-proxy-tls\" (UniqueName: \"kubernetes.io/secret/23281269-2b00-446c-851c-aceff20ac39d-proxy-tls\") pod \"23281269-2b00-446c-851c-aceff20ac39d\" (UID: \"23281269-2b00-446c-851c-aceff20ac39d\") " Oct 30 19:31:09.729926 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.729923 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/23281269-2b00-446c-851c-aceff20ac39d-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23281269-2b00-446c-851c-aceff20ac39d-openshift-service-ca-bundle\") pod \"23281269-2b00-446c-851c-aceff20ac39d\" (UID: \"23281269-2b00-446c-851c-aceff20ac39d\") " Oct 30 19:31:09.730166 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.729959 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8602043f-b522-4116-bbc0-6ba397f2d54c-proxy-tls\" (UniqueName: \"kubernetes.io/secret/8602043f-b522-4116-bbc0-6ba397f2d54c-proxy-tls\") pod \"8602043f-b522-4116-bbc0-6ba397f2d54c\" (UID: \"8602043f-b522-4116-bbc0-6ba397f2d54c\") " Oct 30 19:31:09.730166 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.729999 4494 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8602043f-b522-4116-bbc0-6ba397f2d54c-openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8602043f-b522-4116-bbc0-6ba397f2d54c-openshift-service-ca-bundle\") pod \"8602043f-b522-4116-bbc0-6ba397f2d54c\" (UID: \"8602043f-b522-4116-bbc0-6ba397f2d54c\") " Oct 30 19:31:09.730351 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.730315 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23281269-2b00-446c-851c-aceff20ac39d-openshift-service-ca-bundle" pod "23281269-2b00-446c-851c-aceff20ac39d" (UID: "23281269-2b00-446c-851c-aceff20ac39d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:31:09.730455 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.730358 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8602043f-b522-4116-bbc0-6ba397f2d54c-openshift-service-ca-bundle" pod "8602043f-b522-4116-bbc0-6ba397f2d54c" (UID: "8602043f-b522-4116-bbc0-6ba397f2d54c"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 19:31:09.732185 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.732155 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8602043f-b522-4116-bbc0-6ba397f2d54c-proxy-tls" pod "8602043f-b522-4116-bbc0-6ba397f2d54c" (UID: "8602043f-b522-4116-bbc0-6ba397f2d54c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:31:09.732329 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.732185 4494 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23281269-2b00-446c-851c-aceff20ac39d-proxy-tls" pod "23281269-2b00-446c-851c-aceff20ac39d" (UID: "23281269-2b00-446c-851c-aceff20ac39d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 19:31:09.831360 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.831316 4494 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23281269-2b00-446c-851c-aceff20ac39d-openshift-service-ca-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:31:09.831360 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.831349 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8602043f-b522-4116-bbc0-6ba397f2d54c-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:31:09.831360 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.831358 4494 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8602043f-b522-4116-bbc0-6ba397f2d54c-openshift-service-ca-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:31:09.831360 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:09.831368 4494 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/23281269-2b00-446c-851c-aceff20ac39d-proxy-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\"" Oct 30 19:31:10.172713 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.172673 4494 generic.go:356] "Generic (PLEG): container finished" podID="8602043f-b522-4116-bbc0-6ba397f2d54c" containerID="820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab" exitCode=137 Oct 30 19:31:10.172900 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.172730 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" Oct 30 19:31:10.172900 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.172751 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" event={"ID":"8602043f-b522-4116-bbc0-6ba397f2d54c","Type":"ContainerDied","Data":"820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab"} Oct 30 19:31:10.172900 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.172801 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx" event={"ID":"8602043f-b522-4116-bbc0-6ba397f2d54c","Type":"ContainerDied","Data":"49c9bd9896cf659de733a14ea2d019119f58a99b708d360fd070a53f26a8f475"} Oct 30 19:31:10.172900 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.172822 4494 scope.go:122] "RemoveContainer" containerID="820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab" Oct 30 19:31:10.174240 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.174215 4494 generic.go:356] "Generic (PLEG): container finished" podID="23281269-2b00-446c-851c-aceff20ac39d" containerID="6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc" exitCode=0 Oct 30 19:31:10.174357 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.174247 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" event={"ID":"23281269-2b00-446c-851c-aceff20ac39d","Type":"ContainerDied","Data":"6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc"} Oct 30 19:31:10.174357 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.174258 4494 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" Oct 30 19:31:10.174357 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.174283 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl" event={"ID":"23281269-2b00-446c-851c-aceff20ac39d","Type":"ContainerDied","Data":"09813e48e1de38f464014c9532689cc9b72f25d4dc402e32bfa10bdfb5f6ef25"} Oct 30 19:31:10.181820 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.181795 4494 scope.go:122] "RemoveContainer" containerID="820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab" Oct 30 19:31:10.182097 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:31:10.182078 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab\": container with ID starting with 820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab not found: ID does not exist" containerID="820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab" Oct 30 19:31:10.182191 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.182106 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab"} err="failed to get container status \"820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab\": rpc error: code = NotFound desc = could not find container \"820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab\": container with ID starting with 820efd5a34f65e01ad5cb4407b75dcd512723875bf6255eae9f9d0516c02dbab not found: ID does not exist" Oct 30 19:31:10.182191 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.182128 4494 scope.go:122] "RemoveContainer" containerID="6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc" Oct 30 19:31:10.190908 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.190881 4494 scope.go:122] "RemoveContainer" containerID="6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc" Oct 30 19:31:10.191206 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:31:10.191170 4494 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc\": container with ID starting with 6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc not found: ID does not exist" containerID="6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc" Oct 30 19:31:10.191260 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.191218 4494 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc"} err="failed to get container status \"6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc\": rpc error: code = NotFound desc = could not find container \"6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc\": container with ID starting with 6822a02be847dd13bf254c26585060ca0378593cecde658368db6afc4a14becc not found: ID does not exist" Oct 30 19:31:10.231444 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.231385 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl"] Oct 30 19:31:10.245987 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.245943 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-f31293434f/model-chainer-767788db4d-m27nl"] Oct 30 19:31:10.284833 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.284800 4494 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx"] Oct 30 19:31:10.289726 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.289696 4494 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-f31293434f/sequence-graph-90935-695ff6c7f6-q2vnx"] Oct 30 19:31:10.886660 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.886577 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23281269-2b00-446c-851c-aceff20ac39d" path="/var/lib/kubelet/pods/23281269-2b00-446c-851c-aceff20ac39d/volumes" Oct 30 19:31:10.887028 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:10.886920 4494 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8602043f-b522-4116-bbc0-6ba397f2d54c" path="/var/lib/kubelet/pods/8602043f-b522-4116-bbc0-6ba397f2d54c/volumes" Oct 30 19:31:15.184648 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:15.184617 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:31:15.192807 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:15.192783 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:31:15.196688 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:15.196664 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:31:15.202731 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:15.202703 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vksqc_007a2514-b71b-4588-ad8c-3cc364e353d6/ovn-acl-logging/0.log" Oct 30 19:31:18.118932 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:18.118895 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:31:19.835664 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:19.835606 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:31:23.733400 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:31:23.733357 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:31:24.396827 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:24.396771 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:31:24.573172 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:24.573138 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:31:39.831595 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:39.831538 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:31:40.927392 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:40.927352 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:31:53.734948 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:31:53.734906 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:31:54.936483 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:54.936445 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:31:55.991679 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:31:55.991643 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:32:02.743097 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.743044 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:32:02.957682 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.957646 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l9qnr/must-gather-ht7jn"] Oct 30 19:32:02.958051 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958032 4494 cpu_manager.go:414] "containerMap: removing container" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kserve-container" Oct 30 19:32:02.958136 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958053 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kserve-container" Oct 30 19:32:02.958136 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958078 4494 cpu_manager.go:414] "containerMap: removing container" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kube-rbac-proxy" Oct 30 19:32:02.958136 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958086 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kube-rbac-proxy" Oct 30 19:32:02.958136 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958102 4494 cpu_manager.go:414] "containerMap: removing container" podUID="8602043f-b522-4116-bbc0-6ba397f2d54c" containerName="sequence-graph-90935" Oct 30 19:32:02.958136 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958109 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8602043f-b522-4116-bbc0-6ba397f2d54c" containerName="sequence-graph-90935" Oct 30 19:32:02.958136 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958128 4494 cpu_manager.go:414] "containerMap: removing container" podUID="23281269-2b00-446c-851c-aceff20ac39d" containerName="model-chainer" Oct 30 19:32:02.958136 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958135 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23281269-2b00-446c-851c-aceff20ac39d" containerName="model-chainer" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958144 4494 cpu_manager.go:414] "containerMap: removing container" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kserve-container" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958152 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kserve-container" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958167 4494 cpu_manager.go:414] "containerMap: removing container" podUID="de3c5cf8-8c59-4059-8595-de29a650a44f" containerName="switch-graph-3e736" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958174 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de3c5cf8-8c59-4059-8595-de29a650a44f" containerName="switch-graph-3e736" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958203 4494 cpu_manager.go:414] "containerMap: removing container" podUID="e5151264-c383-46cc-ab7a-9e38823ef86f" containerName="switch-graph-d7605" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958213 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e5151264-c383-46cc-ab7a-9e38823ef86f" containerName="switch-graph-d7605" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958225 4494 cpu_manager.go:414] "containerMap: removing container" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kube-rbac-proxy" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958232 4494 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kube-rbac-proxy" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958311 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="8602043f-b522-4116-bbc0-6ba397f2d54c" containerName="sequence-graph-90935" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958324 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="23281269-2b00-446c-851c-aceff20ac39d" containerName="model-chainer" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958333 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kserve-container" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958343 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="de3c5cf8-8c59-4059-8595-de29a650a44f" containerName="switch-graph-3e736" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958357 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="e5151264-c383-46cc-ab7a-9e38823ef86f" containerName="switch-graph-d7605" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958368 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="47dddda4-9eb2-4f24-a6c9-77facb8c4d64" containerName="kube-rbac-proxy" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958377 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kserve-container" Oct 30 19:32:02.958505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.958385 4494 memory_manager.go:365] "RemoveStaleState removing state" podUID="62bd3804-f241-40c0-b9ec-5b17688fecaf" containerName="kube-rbac-proxy" Oct 30 19:32:02.961650 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.961628 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l9qnr/must-gather-ht7jn" Oct 30 19:32:02.972268 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.972241 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knqwq\" (UniqueName: \"kubernetes.io/projected/bee7b917-a281-4355-9ed3-485a83c3d90e-kube-api-access-knqwq\") pod \"must-gather-ht7jn\" (UID: \"bee7b917-a281-4355-9ed3-485a83c3d90e\") " pod="openshift-must-gather-l9qnr/must-gather-ht7jn" Oct 30 19:32:02.972373 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.972278 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bee7b917-a281-4355-9ed3-485a83c3d90e-must-gather-output\") pod \"must-gather-ht7jn\" (UID: \"bee7b917-a281-4355-9ed3-485a83c3d90e\") " pod="openshift-must-gather-l9qnr/must-gather-ht7jn" Oct 30 19:32:02.988321 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:02.988292 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l9qnr\"/\"kube-root-ca.crt\"" Oct 30 19:32:03.001809 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:03.001730 4494 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l9qnr\"/\"openshift-service-ca.crt\"" Oct 30 19:32:03.001809 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:03.001744 4494 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l9qnr\"/\"default-dockercfg-k67xk\"" Oct 30 19:32:03.003365 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:03.003334 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l9qnr/must-gather-ht7jn"] Oct 30 19:32:03.024310 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:03.024274 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:32:03.073526 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:03.073490 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knqwq\" (UniqueName: \"kubernetes.io/projected/bee7b917-a281-4355-9ed3-485a83c3d90e-kube-api-access-knqwq\") pod \"must-gather-ht7jn\" (UID: \"bee7b917-a281-4355-9ed3-485a83c3d90e\") " pod="openshift-must-gather-l9qnr/must-gather-ht7jn" Oct 30 19:32:03.073725 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:03.073535 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bee7b917-a281-4355-9ed3-485a83c3d90e-must-gather-output\") pod \"must-gather-ht7jn\" (UID: \"bee7b917-a281-4355-9ed3-485a83c3d90e\") " pod="openshift-must-gather-l9qnr/must-gather-ht7jn" Oct 30 19:32:03.073883 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:03.073865 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bee7b917-a281-4355-9ed3-485a83c3d90e-must-gather-output\") pod \"must-gather-ht7jn\" (UID: \"bee7b917-a281-4355-9ed3-485a83c3d90e\") " pod="openshift-must-gather-l9qnr/must-gather-ht7jn" Oct 30 19:32:03.099064 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:03.099038 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knqwq\" (UniqueName: \"kubernetes.io/projected/bee7b917-a281-4355-9ed3-485a83c3d90e-kube-api-access-knqwq\") pod \"must-gather-ht7jn\" (UID: \"bee7b917-a281-4355-9ed3-485a83c3d90e\") " pod="openshift-must-gather-l9qnr/must-gather-ht7jn" Oct 30 19:32:03.213961 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:03.213914 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:32:03.288670 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:03.288579 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l9qnr/must-gather-ht7jn" Oct 30 19:32:03.582700 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:03.582664 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l9qnr/must-gather-ht7jn"] Oct 30 19:32:03.583042 ip-10-0-135-218 kubenswrapper[4494]: W1030 19:32:03.583020 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbee7b917_a281_4355_9ed3_485a83c3d90e.slice/crio-88b0e2f599b10c8e354b1415f5a5100ff09e75f17b18862ecbfde2f05f4a1475 WatchSource:0}: Error finding container 88b0e2f599b10c8e354b1415f5a5100ff09e75f17b18862ecbfde2f05f4a1475: Status 404 returned error can't find the container with id 88b0e2f599b10c8e354b1415f5a5100ff09e75f17b18862ecbfde2f05f4a1475 Oct 30 19:32:03.585037 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:03.585015 4494 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 19:32:04.398981 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:04.398934 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l9qnr/must-gather-ht7jn" event={"ID":"bee7b917-a281-4355-9ed3-485a83c3d90e","Type":"ContainerStarted","Data":"3fa22cb71d7ad097fcf2ba50325f9d44e452ea4216f1b28c822d9ece7d27e54d"} Oct 30 19:32:04.399487 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:04.398995 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l9qnr/must-gather-ht7jn" event={"ID":"bee7b917-a281-4355-9ed3-485a83c3d90e","Type":"ContainerStarted","Data":"88b0e2f599b10c8e354b1415f5a5100ff09e75f17b18862ecbfde2f05f4a1475"} Oct 30 19:32:05.405315 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:05.405271 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l9qnr/must-gather-ht7jn" event={"ID":"bee7b917-a281-4355-9ed3-485a83c3d90e","Type":"ContainerStarted","Data":"e35c5869328e43f60c74256715d38312b94d12f0f857445c8e867b727cd53023"} Oct 30 19:32:05.453056 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:05.452999 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-l9qnr/must-gather-ht7jn" podStartSLOduration=2.82058658 podStartE2EDuration="3.452982619s" totalImagesPullingTime="632.396039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 19:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:32:05.452482432 +0000 UTC m=+3350.681331979" watchObservedRunningTime="2026-10-30 19:32:05.452982619 +0000 UTC m=+3350.681832165" Oct 30 19:32:06.955928 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:06.955879 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-54kx8_3ddec812-a5d4-45b1-8a57-70a9b5914964/global-pull-secret-syncer/0.log" Oct 30 19:32:07.049460 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:07.049428 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:32:07.656143 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:07.656112 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:32:08.061419 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:08.061375 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" Oct 30 19:32:08.242255 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:08.242161 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:32:08.561620 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:08.561559 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-218.ec2.internal_0a1141f188cb159776b4a1af048cbc31/haproxy/1.log" Oct 30 19:32:08.564136 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:08.563879 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-218.ec2.internal_0a1141f188cb159776b4a1af048cbc31/haproxy/0.log" Oct 30 19:32:08.564989 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:08.564956 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:32:08.773822 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:08.772015 4494 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tlrv_60d85957-1f67-4dfc-8ad1-c30f04b0b3f7/konnectivity-agent/0.log" limit=1024 Oct 30 19:32:13.475641 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:13.475612 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7be05cd6-14a1-4990-b156-d3b0240bf6fe/alertmanager/0.log" Oct 30 19:32:13.603828 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:13.603797 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7be05cd6-14a1-4990-b156-d3b0240bf6fe/config-reloader/0.log" Oct 30 19:32:13.722216 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:13.722180 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7be05cd6-14a1-4990-b156-d3b0240bf6fe/kube-rbac-proxy-web/0.log" Oct 30 19:32:13.844347 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:13.844267 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7be05cd6-14a1-4990-b156-d3b0240bf6fe/kube-rbac-proxy/0.log" Oct 30 19:32:13.966951 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:13.966924 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7be05cd6-14a1-4990-b156-d3b0240bf6fe/kube-rbac-proxy-metric/0.log" Oct 30 19:32:14.091214 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:14.091180 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7be05cd6-14a1-4990-b156-d3b0240bf6fe/prom-label-proxy/0.log" Oct 30 19:32:14.222463 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:14.222426 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7be05cd6-14a1-4990-b156-d3b0240bf6fe/init-config-reloader/0.log" Oct 30 19:32:14.520997 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:14.520918 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/0.log" Oct 30 19:32:14.523301 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:14.523266 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-state-metrics/1.log" Oct 30 19:32:14.612867 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:14.612826 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-rbac-proxy-main/0.log" Oct 30 19:32:14.762559 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:14.762533 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-562bf_6c017ade-ad44-403b-9abb-fa8d0a4cfb62/kube-rbac-proxy-self/0.log" Oct 30 19:32:15.515963 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:15.515936 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cd8bq_77ffd04a-7f05-499a-91af-0bb3b95f906f/node-exporter/0.log" Oct 30 19:32:15.636071 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:15.636044 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cd8bq_77ffd04a-7f05-499a-91af-0bb3b95f906f/kube-rbac-proxy/0.log" Oct 30 19:32:15.754216 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:15.754189 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cd8bq_77ffd04a-7f05-499a-91af-0bb3b95f906f/init-textfile/0.log" Oct 30 19:32:16.240242 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.240199 4494 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs"] Oct 30 19:32:16.245965 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.245935 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.274542 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.273068 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs"] Oct 30 19:32:16.364262 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.364219 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-podres\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.364628 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.364327 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-sys\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.364628 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.364392 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-proc\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.364628 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.364483 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-744dm\" (UniqueName: \"kubernetes.io/projected/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-kube-api-access-744dm\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.364628 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.364619 4494 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-lib-modules\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.465552 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.465515 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-proc\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.465552 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.465561 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-744dm\" (UniqueName: \"kubernetes.io/projected/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-kube-api-access-744dm\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.465783 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.465614 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-lib-modules\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.465783 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.465638 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-podres\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.465783 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.465639 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-proc\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.465783 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.465669 4494 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-sys\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.465783 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.465727 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-sys\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.465783 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.465728 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-podres\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.465783 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.465736 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-lib-modules\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.491246 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.491171 4494 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-744dm\" (UniqueName: \"kubernetes.io/projected/47f29899-6d9d-4550-a0e6-8ebd7a849fa9-kube-api-access-744dm\") pod \"perf-node-gather-daemonset-7hmrs\" (UID: \"47f29899-6d9d-4550-a0e6-8ebd7a849fa9\") " pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.561505 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.561464 4494 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:16.874195 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:16.874158 4494 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs"] Oct 30 19:32:16.875873 ip-10-0-135-218 kubenswrapper[4494]: W1030 19:32:16.875835 4494 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod47f29899_6d9d_4550_a0e6_8ebd7a849fa9.slice/crio-456a5d8a0a37011f4d3338161e6311034b9600843362cbd8303cf4004bd42c1b WatchSource:0}: Error finding container 456a5d8a0a37011f4d3338161e6311034b9600843362cbd8303cf4004bd42c1b: Status 404 returned error can't find the container with id 456a5d8a0a37011f4d3338161e6311034b9600843362cbd8303cf4004bd42c1b Oct 30 19:32:17.488295 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:17.488247 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" event={"ID":"47f29899-6d9d-4550-a0e6-8ebd7a849fa9","Type":"ContainerStarted","Data":"80d9717d7d6b426c1cf9cbde98b1db0531e8621deda42fe5fc147b8624d92d13"} Oct 30 19:32:17.488513 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:17.488305 4494 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" event={"ID":"47f29899-6d9d-4550-a0e6-8ebd7a849fa9","Type":"ContainerStarted","Data":"456a5d8a0a37011f4d3338161e6311034b9600843362cbd8303cf4004bd42c1b"} Oct 30 19:32:17.488513 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:17.488332 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:17.500617 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:17.500584 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-6j9f5_5d75bad9-1276-44c5-a2c4-9258ac202234/prometheus-operator/0.log" Oct 30 19:32:17.534662 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:17.534599 4494 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" podStartSLOduration=1.534581475 podStartE2EDuration="1.534581475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 19:32:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 19:32:17.533238709 +0000 UTC m=+3362.762088258" watchObservedRunningTime="2026-10-30 19:32:17.534581475 +0000 UTC m=+3362.763431023" Oct 30 19:32:17.624464 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:17.624430 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-6j9f5_5d75bad9-1276-44c5-a2c4-9258ac202234/kube-rbac-proxy/0.log" Oct 30 19:32:17.744397 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:17.744318 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-5dxpj_dddc6011-5636-47a2-bc75-b1188a0b6e23/prometheus-operator-admission-webhook/0.log" Oct 30 19:32:17.870845 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:17.870797 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67c7cd68d5-brrbn_0fdaebc6-dffe-47a8-b1b1-19140f58fb2d/telemeter-client/0.log" Oct 30 19:32:17.990909 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:17.990869 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67c7cd68d5-brrbn_0fdaebc6-dffe-47a8-b1b1-19140f58fb2d/reload/0.log" Oct 30 19:32:18.107523 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:18.107449 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67c7cd68d5-brrbn_0fdaebc6-dffe-47a8-b1b1-19140f58fb2d/kube-rbac-proxy/0.log" Oct 30 19:32:18.235494 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:18.235442 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c67c49dc9-vjbwg_fc9cba1a-169c-453d-971f-9e1fa9f1da9f/thanos-query/0.log" Oct 30 19:32:18.351475 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:18.351446 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c67c49dc9-vjbwg_fc9cba1a-169c-453d-971f-9e1fa9f1da9f/kube-rbac-proxy-web/0.log" Oct 30 19:32:18.467646 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:18.467617 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c67c49dc9-vjbwg_fc9cba1a-169c-453d-971f-9e1fa9f1da9f/kube-rbac-proxy/0.log" Oct 30 19:32:18.583946 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:18.583920 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c67c49dc9-vjbwg_fc9cba1a-169c-453d-971f-9e1fa9f1da9f/prom-label-proxy/0.log" Oct 30 19:32:18.703048 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:18.703016 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c67c49dc9-vjbwg_fc9cba1a-169c-453d-971f-9e1fa9f1da9f/kube-rbac-proxy-rules/0.log" Oct 30 19:32:18.819551 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:18.819481 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c67c49dc9-vjbwg_fc9cba1a-169c-453d-971f-9e1fa9f1da9f/kube-rbac-proxy-metrics/0.log" Oct 30 19:32:21.977290 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:21.977261 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bc87676c5-q2l2m_ae0451d1-d226-4a1c-8f0b-1409eef76a09/console/0.log" Oct 30 19:32:22.116747 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:22.116715 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-cnp26_a72d383b-6b31-4a23-91c5-fe2ad5904509/download-server/0.log" Oct 30 19:32:23.503542 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:23.503505 4494 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-l9qnr/perf-node-gather-daemonset-7hmrs" Oct 30 19:32:23.737655 ip-10-0-135-218 kubenswrapper[4494]: E1030 19:32:23.737607 4494 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-jlwt8" containerName="extractor" Oct 30 19:32:25.481726 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:25.481679 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cl5d5_e6a05949-bb00-4825-8e16-28f198f39bfc/dns/0.log" Oct 30 19:32:25.616343 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:25.616315 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cl5d5_e6a05949-bb00-4825-8e16-28f198f39bfc/kube-rbac-proxy/0.log" Oct 30 19:32:26.295998 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:26.295968 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qv54m_3c7bc982-8239-4919-84ca-8b7ee2f95fc7/dns-node-resolver/0.log" Oct 30 19:32:27.877268 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:27.877232 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zcm2q_8c64ea11-4f4d-4101-9d92-684e9cd106ac/node-ca/0.log" Oct 30 19:32:30.624144 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:30.624056 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2s8kc_561cf55e-8877-4d9d-99cc-5e6ce09d70b4/serve-healthcheck-canary/0.log" Oct 30 19:32:32.822709 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:32.822680 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jlwt8_542dd4e6-a6db-48b8-b9cd-099c95ac9978/kube-rbac-proxy/0.log" Oct 30 19:32:32.958449 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:32.958395 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jlwt8_542dd4e6-a6db-48b8-b9cd-099c95ac9978/exporter/0.log" Oct 30 19:32:33.094799 ip-10-0-135-218 kubenswrapper[4494]: I1030 19:32:33.094718 4494 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jlwt8_542dd4e6-a6db-48b8-b9cd-099c95ac9978/extractor/0.log"